SGLang: Efficient LLM Serving Engine

SGLang is a fast serving engine for LLMs and VLMs. It's fully open-source, incubated by LMSYS Org, with 300+ contributors worldwide. In this talk, we will introduce the key features and performance optimizations in SGLang.