You know that nextToken
returns the value of
the TT_EOF
instance variable when there are no more tokens.
In the event that there is a token, the value returned by nextToken
depends on whether the token is a number or a string. If the token is a
number, nextToken
returns the value of the
TT_NUMBER
instance variable; if the token is a string, nextToken
returns the
value of the
TT_WORD
instance variable.