Options
All
  • Public
  • Public/Protected
  • All
Menu

Interface ISymbolState

Defines an interface for tokenizer state that processes delimiters.

Hierarchy

Implemented by

Index

Methods

Methods

add

  • add(value: string, tokenType: TokenType): void

  • Add a multi-character symbol.

    Parameters

    • value: string

      The symbol to add, such as "=:="

    • tokenType: TokenType

      The token type

    Returns void

nextToken

  • Gets the next token from the stream started from the character linked to this state.

    Parameters

    • scanner: IScanner

      A textual string to be tokenized.

    • tokenizer: ITokenizer

      A tokenizer class that controls the process.

    Returns Token

    The next token from the top of the stream.

Generated using TypeDoc