手持移动计算中的多通道交互-软件学报.PDFVIP

1000-9825/2005/16(01)0029 ©2005 Journal of Software Vol.16, No.1 ∗ + , , , ( , 100871) Multi-Modal Interaction in Handheld Mobile Computing + WANG Yue , YUE Wei-Ning, WANG Heng, DONG Shi-Hai (Department of Computer Science and Technology, Peking University, Beijing 100871, China) + Corresponding author: Phn: +86-10 E-mail: wangyue@, Received 2003-07-07; Accepted 2004-07-27 Wang Y, Yue WN, Wang H, Dong SH. Multi-Modal interaction in handheld mobile computing. Journal of Software, 2005,16(1):29−36. /1000-9825/16/29.htm Abstract : Handheld mobile computing has increasingly become a mainstream computing paradigm, in which human-computer interaction is an essential issue. Multi-Modal user interface and multi-modal interaction can effectively improve the interaction efficiency in mobile computing. This paper presents a multi-modal interaction model and discusses the application of multi-modal interaction in handheld devices. Then the tour guide system is described. An experimental evaluation shows that the multi-modal interaction, based on pen and speech, can greatly improve its interaction. Key words: mobile computing; multi-modal user interface; multi-modal interaction; speech; tour guide : ,. ., TGH(tour guide on hand),., . : ;;;; : TP302 : A 20 90 ,PDA , . ,, .,. ∗Supported by the National Natural Science Foundation of China under Grant No (); the National High-Tech Research and Development Plan of China under Grant No.2001AA114170 ((863)) : (1979 ), ,,,,;(1980 ),,, ,;(1960 ), ,,,,;(1939 ), ,, ,,,. 30 Journal of Software 2005,16(1) WIMP () . GUI