Clears definitions of whitespace characters.
Gets the next token from the stream started from the character linked to this state.
A textual string to be tokenized.
A tokenizer class that controls the process.
The next token from the top of the stream.
Establish the given characters as whitespace to ignore.
First character index of the interval.
Last character index of the interval.
true
if this state should ignore characters in the given range.
Generated using TypeDoc
Defines an interface for tokenizer state that processes whitespaces (' ', '\t')