自然用户界面的 李开复.pptVIP

Talk Outline The NUI revolution The vision. The ingredients and technologies. 5 challenges to getting NUI started 10 steps to overcome challenges Conclusion User Interface Evolution User Interface EvolutionGraphical User Interface User Interface Evolution NUI – “Do What I Mean” UI Users naturally articulate what they mean, on any device, to any application or web service, and have their intention interpreted and executed accurately. Why NUI? Expressive. Natural. Scalable. Natural User Interface Motivated by human-human interaction Natural User Interface (NUI) NUI: Hear What You Say Hear What You Say Human language : “Invented” for interaction “[Language is] a biological adaptation to communicate information… One of nature’s engineering marvels”  – Steven Pinker “Vision evolved from the need to survive; speech evolved from the need to communicate”  – Michael Dertouzos. Speech is central… … but also typing, handwriting, gestures… Best form depends on: Habit / skills (typing to PCs) Form factor (speaking to phones) Situation (writing at meetings) Eventually, multimodal NUI: Know What You Mean Syntax (rules of the human’s language) Nouns, verbs, etc. and how they combine “Book about a trip to Chicago” vs. “Book a trip to Chicago” Normalize linguistic variations . Semantics Meaning of the words Book means reserve a ticket; requires from-city, to-city, etc. Context (additional hints) Domain knowledge : No train from Hawaii to Chicago Statistics : Book as a noun Book as a verb “Book Chicago” Personal Preferences : Where you live, your calendar, how you pay… Model of time, urgency,?presence Dialog (resolving ambiguity determine intent) “Buy a book or book travel?” “What date would you like to travel?” NUI: Do What You Want Do What You Want (by brokering combining) No system can know everything. Broker intent to experts: Take user intent and determine “Who are the possible experts for this intent?” Each expert (web service) registers what it?knows En