K-BERT:知识图谱增强语言表示模型综述.pptx

Review:PaperReading

K-BERT:EnablingLanguageRepresentationWithKnowledgeGraph范老师2020/07/12

ContentIntroductionRelatedWorkMethodologyExperimentsConclusion

Introduction大背景：Duetothedomain-discrepancybetweenpre-trainingandfine-tuning,thesemodelsdonotperformwellonknowledge-driventasks.即，BERT这种预训练模型对于领域相关的推理比较。方案：? Thispaperproposesaknowledge-enabledLRmodel,namelyK-BERT,whichiscompatiblewithBERTandcanincorporatedomainknowledgewithoutHESandKNissues;? WiththedelicateinjectionofKG,K-BERTsignificantlyoutperformsBERTnotonlyondomai