Computer Science · Artificial Intelligence
FLEXIBLE SPEECH AND PEN INTERACTION WITH HANDHELD DEVICES
Sorin Dusan, Sriram Ramachandran, Corresponding Sorin Dusan
See on the mapAbstract
An emerging research direction in the field of pervasive computing is to voice-enable applications on handheld computers. Map-based applications can benefit the most from multimodal interfaces based on speech and pen input and graphics and speech output. However, implementing automatic speech recognition and speech synthesis on handheld computers is constrained by the relatively low computation power and the memory limitations of these devices. This paper describes new results of our previous research on multimodal interaction using speech and pen inputs on handheld computers. Preliminary results show that combining speech input and pen gestures on handheld computers offers increased flexibility and improves naturalness and user satisfaction.