[source]

Whitespace#

Tokens are delimited by a user-specified whitespace character.

Parameters#

# Param Default Type Description
1 delimiter ' ' string The whitespace character that delimits each token.

Example#

use Rubix\ML\Extractors\Tokenizers\Whitespace;

$tokenizer = new Whitespace(',');