Consumes input, returns result as the TOKEN yylval.
Creates a general token. Handles operators, delimiters, and reserved words.
Token type, defined in token.h
Which actual token, defined in token.h
Make a token for an identifier.
Make a token for a string.
Make a token for an integer number.
Make a token for a floating point number.