SGLang:高效的开源大规模LLM服务框架.pptx

SGLang:高效的开源大规模LLM服务框架.pptx

演讲人:尹良升

•SGLangisafast-servingengineforLLMsandVLMs.

•Amongfullyopen-sourceLLMInferenceEngines,SGLangcurrentlyachievesstate-of-the-art(SOTA)

performance,andItisthefirstopen-sourceimplementationtonearlymatchthethroughputreportedintheofficialDeepSeekblogata

文档评论(0)

1亿VIP精品文档

相关文档