Going Beyond Tokens for Code Large Language Models

Location: Master Stage

Tokenization in LLMs is the last bit of clunkiness in an otherwise elegant, highly-optimized architecture. This talk presents interesting avenues in tokenizer-free architecture to go "beyond tokens" in order to reduce latency and improve performance.