Class Tokenizer.Token

    • Constructor Detail

      • Token

        public Token​(Tokenizer.TokenType type,
                     int position)
        A token
        Parameters:
        type - The token type
        position - The position of the token
      • Token

        public Token​(Tokenizer.TokenType type,
                     int position,
                     java.lang.String text)
        A token
        Parameters:
        type - The token type
        position - The position of the token
        text - The text for the token