Pre-training of Smol and Large LLM

May 7

•

16:20 - 17:00

Location: Master Stage

Explaining what's new in pre-training: optimization tricks, MoE, stability hacks, and handling long contexts—everything you need to build better LLMs.

Speakers

Elie Bakouch

Research Engineer at Hugging Face