[source]
Whitespace
Tokens are delimited by a user-specified whitespace character.
Parameters
# |
Name |
Default |
Type |
Description |
1 |
delimiter |
' ' |
string |
The whitespace character that delimits each token. |
Example
use Rubix\ML\Extractors\Tokenizers\Whitespace;
$tokenizer = new Whitespace(',');