大语言模型认识与应用 课件 .RAG-.pptxVIP

检索增强生成

目录

RAG的必要性

多种RAG系统的介绍

RAG存在的挑战

RAG的必要性

OntheafternoonofFebruary16,2023,homeownersinaHangzhoucommunity

werediscussingChatGPTintheirgroupchat.OneofthehomeownersjokinglysuggestedtryingtouseittowriteanewsarticleaboutthecancellationoftrafficrestrictionsinHangzhou.Thishomeownerthenlivestreamedthewriting

processusingChatGPTandpostedthearticleinthegroup.Somehomeowners

tookitseriously,tookscreenshots,andforwardedthem,leadingtothespreadofincorrectinformation.

TheDawnAftertheDark:AnEmpiricalStudyonFactualityHallucinationinLargeLanguageModels大型语言模型简介

[1]陈慧敏等，大语言模型时代的社会机遇与挑战.计算机研究与发展，2023

1.幻觉

You

HowmanymedalsdidChinawinintheWinterOlympics?

ChatGPT

AsofmylastupdateinJanuary2022,Chinahaswonatotalof33medalsintheWinterOlympics.Thisincludes13goldmedals,6silvermedals,and14bronzemedals.However,pleasenotethatthisinformationmightnotbeuptodate,andIrecommendcheckingthelatestofficialsourcesornewsupdatesforthemostrecentmedalcountforChinaintheWinterOlympics.

1.过时

Giganticweb-scaledatasetBaseLLMFine-tunedLLM

Specific(private)KnowledgeBase

Supervised

fine-tuning

USandintcrnationalncws

109

Logfilesanderrorreports

79

License,termsofuse,copyrightnotices

Listsofnameditems(games,countries,etc.)

54

54

ForumorWikientry

53

ValidURLs

Namedindividuals(non-newssamplesonly)

50

46

Promotionalcontent(products,subscriptions,etc.)

45

Highentropy(UUIDs,base64data)

35

Contactinfo(address,email,phone,twitter,etc.)

32

Code

31

Configurationfiles

30

Religioustexts

25

Pseudonyms

15

DonaldTrumptweetsandquotes

12

Webforms(menuitems,instructions,et