微软：2025年AI Agent系统故障模式分类白皮书（英文版） conv.docxVIP

TaxonomyofFailureModeinAgenticAISystems

[PeteBryan,GiorgioSeveri,JorisdeGruyter,DanielJones,BlakeBullwinkel,AmandaMinnich,ShivenChawla,GaryLopez,MartinPouliot,AdamFourney,WhitneyMaxwell,KatherinePratt,SaphirQi,NinaChikanov,RomanLutz,RajaSekharRaoDheekonda,Bolor-ErdeneJagdagdorj,EugeniaKim,JustinSong,KeeganHines,DanielJones,RichardLundeen,SamVaughan,VictoriaWesterhoff,YonatanZunger,ChangKawaguchi,MarkRussinovich,RamShankarSivaKumar]

1

Contents

Abstract.....................................................................................................................................................................2Introduction............................................................................................................................................................2

Agenticsystems:Functionalityandcommonpatterns.....................................................................3Overviewoffailuremodes................................................................................................................................6

Whateffectscanthesefailuremodeshave?........................................................................................7Mitigationsanddesignconsiderations...................................................................................................8Limitationsofouranalysis...........................................................................................................................10

Casestudy:MemorypoisoningattackonanagenticAIemailassistant.......................................10

Introduction.......................................................................................................................................................10Contextandsetup...........................................................................................................................................11Baseli