Working on the tokenizer, I realized that I missed one critical part of it: as you may need to chain several calls to do the full parsing, it is important to have a 'finalization' call to flush any parsing buffers.
This complexified the function call and I was trying to figure out how to handle this the simplest way.
To solve the issue, I decided to create two functions: one would be 'single shot' whereas the other would allow consecutive calls.
I am now working on generating a release version from the debug using a lite syntax parsing.
More news soon.
