Parser is a test application that demonstrates using the Tokenizer class to parse a simple BASIC program into its constituent tokens, and then recursively match those tokens up into structures such as declarations, statements and loops, eventually condensing the whole thing down into a single "program"
Each matched structure or token appears in the list below the program text as it is matched.
The application is set to re-parse the text whenever it is changed, so try editing the program and observe how the list is regenerated.
Its functionality is similar to the YACC library from the Unix world. The Parser, in conjunction with the Tokenizer can be used to form the complete front end for a compiler, or other syntax processing tool.