AI 系统的安全风险和挑战-李康 .docxVIP

*??ν??????ν????????

??$FSUJ,

*ν??????

MakesurethatAIsystemsusedintheEUaresafe,transparent,traceable,non-discriminatoryandenvironmentallyfriendly.AIsystemsshouldbeoverseenbypeople,ratherthanbyautomation,topreventharmfuloutcomes.

*ν???????????

Abstract

Algorithm

System ???

*??ν????????

*??ν??????ν???Б?

/tech-policy/2024/10/bytedance-intern-fired-for-planting-malicious-code-in-ai-models/

https://www.wiz.io/blog/wiz-research-uncovers-exposed-deepseek-database-leak

*??ν??????ν???Б?

/threat-research/shadowray-ai-infrastructure-is-being-exploited-in-the-wild

???? *ν??????????

Abstract

Algorithm

System

???? *ν??????

*?????????????

*??ν????????

?????????????????????

??????????????*??????????

???????

*?????*HFOU

???*HFOU

??

andboxasksasksandbox???

andbox

asks

asks

andbox

LLMstounderstandmission

Missionbreaksdownastasks

TTTasks

Input

AgentFrontEnd

User Output SSSandbox

IntegrationOfOutcomes

LLMstoaggregate

responses Execution

andboxasksasksandbox???

andbox

asks

asks

andbox

LLMstounderstandmission

Missionbreaksdownastasks

TTTasks

??

*???????????????

$PEFYFDVUJPO

Input

AgentFrontEnd

???????????????

B????????

C???????????????

User Output SSSandbox ????

IntegrationOfOutcomes

LLMstoaggregateresponses

D--.????

Execution ????????????????

*?????????

询问Ollama给定字符串的MD5值

询问了第二遍

??????σ ?

*?????????

??????bbb

*?????????

??????bbb

*?????????

-BUFTU$IBU(150DU

???*HFOU

???σ? ?

???*HFOU

???σ? ?

*HFOUJTB(PMENJOFGPSUUBDLFST5IFUSFOEPG*HFOUFOBCMFTNPSFTZTUFNMFWFMSJTLT

ν??????????????ν????

/threat-research/shadowray-ai-infrastructure-is-being-exploited-in-the-wild

*HFOU3$YBNQMF(15@BDBEFNJD

4BOECPY

(15@BDBEFNJD?DPNNJUG

??6CVOUV

??В????

7VMOFSBCJMJUZ

??????????????? --.1*??

?????? 33???????ν???

*HFOU3$YBNQMF(15@BDBEFNJD

YQMPJUBUJPO

????33??1BZMPBEb

??1ZUIPOSBSGJMF?????????????????? FUDDSPOE

????????b

?????????? ?SFWFSTFTIFMM?

*HFOU3$YBNQMF*OWPLF*

4BOECPY

*OWPLF*WFSTJPOT_??В????

7VMO