大模型学习资料包Sketch2Saliency：学习从人体绘画中检测突出对象.pdfVIP

Sketch2Saliency:LearningtoDetectSalientObjectsfromHumanDrawings

AyanKumarBhunia1SubhadeepKoley1,2AmandeepKumar*AneeshanSain1,2

PinakiNathChowdhury1,2TaoXiang1,2Yi-ZheSong1,2

1SketchX,CVSSP,UniversityofSurrey,UnitedKingdom.

2iFlyTek-SurreyJointResearchCentreonArtificialIntelligence.

{a.bhunia,s.koley,a.sain,p.chowdhury,t.xiang,y.song}@surrey.ac.uk

3Abstract

2

0Humansketchhasalreadyproveditsworthinvarious

C

N

2visualunderstandingtasks(e.g.,retrieval,segmentation,

N

rimage-captioning,etc).Inthispaper,werevealanewtrait

a

ofsketches–thattheyarealsosalient.Thisisintuitiveas

Msketchingisanaturalattentiveprocessatitscore.More

0specifically,weaimtostudyhowsketchescanbeusedasFigure1.Sequentialphoto-to-sketchgenerationwith2D-attention

2aweaklabeltodetectsalientobjectspresentinanim-toleveragesketchasaweaklabelforsalientobjectdetection.Ag-

age.Tothisend,weproposeanovelmethodthatempha-gregated2Dattention-mapstillaparticularinstantareshown.

]

sisesonhow“salientobject”couldbeexplainedbyhand-

Vdrawnsketches.Toaccomplishthis,weintroduceaphoto-i