Advance AI Inference with AMD EPYC™ 9005 Series Processors Infographic技术文档用户手册.pdf

DATACENTERSOLUTIONS|AMDEPYC™9005PROCESSORS

AMDEPYC™9005PROCESSORS

ADVANCEENTERPRISEAIINFERENCE

AMDLEADERSHIPENTERPRISEAIPORTFOLIO

HELPSCONSOLIDATETRADITIONALAIWORKLOADS

KeyfeaturesenableAMDEPYCtoconsolidateinfrastructure,optimize

costs,andadapttoevolvingneedsofbothtraditionalandAIworkloads.

-AdvancedMemoryManagement-HighCoreCountMultithreading

-RobustSoftwareEcosystem-LargeCacheSizes

-HardwareAcceleration

•MixedworkloadInference

•SmalltoMediumModels

AMD

•Batch/SmallScaleInference

OffersLeadership

PerformanceEfficiency

•AITrainingDedicatedDeployments

forbothCPUsGPUs

•MediumtoLargeModels

•Large-ScaleInference

LEADERSHIPENTERPRISEAICPUINFERENCEENERGYEFFICIENCYSOLUTIONS

AMDEPYCprocessorsdeliverincredibleperformanceforAIinference

~39%FasterLLM~86%Faster~128%Faster

InferenceThroughputSimilaritySearchEnd-to-EndAI

Llama3.1-8BBF16(tokens/sec)