Introduction
The tokenizer functions provide an interface to the
PHP tokenizer embedded in the Zend Engine. Using these
functions you may write your own PHP source analyzing
or modification tools without having to deal with the
language specification at the lexical level.
See also the appendix about tokens.
Tokenizer
