GPU平台上大语言模型推理工作负载的请求与词元能耗成本特征分析.pdf

GPU平台上大语言模型推理工作负载的请求与词元能耗成本特征分析.pdf

CharacterizationofRequestandTokenEnergyCosts

forLLMInferenceWorkloadsonGPUPlatforms

PrabhuVellaisamy,VanessaLam,ShawnBlanton,andJohnPaulShen

ElectricalandComputerEngineeringDepartment

文档评论(0)

1亿VIP精品文档

相关文档