TokenType

class TokenType

The possible types of token returned from each get_next_token() call.

Fields

class TokenType

BINARY: A binary integer

CHAR: A character

COMMA: A ‘,’ character

COMMENT_MULTI: Multi line comment

COMMENT_SINGLE: One line comment

EOF: The end of the file

EQUAL_SIGN: A ‘=’ character

ERROR: An error occurred

FLOAT: A floating point number

HEX: A hex integer

IDENTIFIER: An identifier

IDENTIFIER_NULL: A null identifier

INT: An integer

LEFT_BRACE: A ‘[’ character

LEFT_CURLY: A ‘{’ character

LEFT_PAREN: A ‘(’ character

NONE: Not a token

OCTAL: An octal integer

RIGHT_BRACE: A ‘]’ character

RIGHT_CURLY: A ‘}’ character

RIGHT_PAREN: A ‘)’ character

STRING: A string

SYMBOL: A symbol