Toward a Theory of Tokenization in LLMs

LLMAG
Re-assign community