Natural Language Processing WPI自然语言处理WPI.pptVIP

Natural Language Processing (NLP) Prof. Carolina Ruiz Computer Science WPI References The essence of Artificial Intelligence By A. Cawsey Prentice Hall Europe 1998 Artificial Intelligence: Theory and Practice By T. Dean, J. Allen, and Y. Aloimonos. The Benjamin/Cummings Publishing Company, 1995 Artificial Intelligence By P. Winston Addison Wesley, 1992 Artificial Intelligence: A Modern Approach By Russell and Norvig Prentice Hall, 2003 Communication Typical communication episodeS (speaker) wants to convey P (proposition) to H (hearer) using W (words in a formal or natural language) 1. Speaker Intention: S wants H to believe P Generation: S chooses words W Synthesis: S utters words W 2. Hearer Perception: H perceives words W” (ideally W” = W) Analysis: H infers possible meanings P1,P2,…,Pn for W” Disambiguation: H infers that S intended to convey Pi (ideally Pi=P) Incorporation: H decides to believe or disbelieve Pi Natural Language Processing (NLP) Natural Language Understanding Taking some spoken/typed sentence and working out what it means Natural Language Generation Taking some formal representation of what you want to say and working out a way to express it in a natural (human) language (e.g., English) Applications of Nat. Lang. Processing Machine Translation Database Access Information Retrieval Selecting from a set of documents the ones that are relevant to a query Text Categorization Sorting text into fixed topic categories Extracting data from text Converting unstructured text into structure data Spoken language control systems Spelling and grammar checkers Natural language understanding Raw speech signal Speech recognition Sequence of words spoken Syntactic analysis using knowledge of the grammar Structure of the sentence Semantic analysis using info. about meaning of words Partial representation of meaning of sentence Pragmatic analysis using info. about context Final representation of meaning of sentence Natural Language Understanding Input/Output da