BottlScript Lexical Analysis Comment removal Token generation Tokenizer Tokens can be keywords, constants, operators, identifiers, symbols. int value = 100; int (keyword), value (identifier), = (operator), 100 (constant) and ; (symbol)