|
|
|
|
|
|
|
A token stream may produce not only number tokens, but also string tokens. Suppose, for example, that movie names are included in the input file, with delimiting double quotation marks:
"Apocalypse Now" 4 7 3 "The Sting" 8 8 7 "Bedtime for Bonzo" 2 10 5
To process such a file, you must learn how to recognize movie names. In
this chapter, you ignore them, once you recognize them; in Chapter 31, you learn how to
incorporate them into Movie instances.