Defines an interface for tokenizer state that processes comments.
Gets the next token from the stream started from the character linked to this state.
A textual string to be tokenized.
A tokenizer class that controls the process.
The next token from the top of the stream.
Generated using TypeDoc
Defines an interface for tokenizer state that processes comments.