[source]

Word Tokenizer#

The Word tokenizer uses a regular expression to tokenize the words in a blob of text.

Parameters#

This tokenizer does not have any parameters.

Example#

use Rubix\ML\Extractors\Tokenizers\Word;

$tokenizer = new Word();