Skip to content

Tokenizer mem

Alam Ed Arias requested to merge TokenizerMem into next

It seems Tokenizer code read past the memory block.

TokenizerMem.txt

Should just give the tokenizer extra memory or fix it STOP past a memory point?

Merge request reports