多模态思维链推理：全面综述 Multimodal Chain-of-Thought Reasoning A Comprehensive Survey.pdfVIP

MultimodalChain-of-ThoughtReasoning:

AComprehensiveSurvey

112

YaotingWang,ShengqiongWu,YuechengZhang,

3451∗

WilliamWang,ZiweiLiu,JieboLuo,HaoFei

51NUS,2CUHK,3UCSB,4NTU,5UR

2SurveyProject:/yaotingwangofficial/Awesome-MCoT

0

2

rAbstract

a

MByextendingtheadvantageofchain-of-thought(CoT)reasoninginhuman-like

6step-by-stepprocessestomultimodalcontexts,multimodalCoT(MCoT)reason-

1inghasrecentlygarneredsignificantresearchattention,especiallyintheintegra-

tionwithmultimodallargelanguagemodels(MLLMs).ExistingMCoTstudies

]designvariousmethodologiesandinnovativereasoningparadigmstoaddressthe

Vuniquechallengesofimage,video,speech,audio,3D,andstructureddataacross

Cdifferentmodalities,achievingextensivesuccessinapplicationssuchasrobotics,

.healthcare,autonomousdriving,andmultimodalgeneration.However,MCoTstill

s

cpresentsdistinctchallengesandopportunitiesthatrequirefurtherfocustoensure

[consistentthrivinginthisfield,whereunfortunatelyanupdate-to-datereviewof

thisdomainislacking.Tobridgethisgap,wepresentthefirstsystematicsurveyof

1MCoTreasoning,elucidatingtherelevantfoundational