N T

T

Tokenizer - Class in <Unnamed>

Tokenizer takes a text file and parses it into individual tokens, returning each as a string.

Tokenizer(String) - Constructor for class Tokenizer

Constructor specifying the file to tokenize.