Tokenizer Example Grammar: x is a variable i is an integer e is an Expression e ::= x | i | if (e1) e2 else e3 Tokens needed: Variables Integers if ( ) else