Pfeiffer, Thies: Understanding multimodal deixis with gaze and gesture in conversational interfaces. 2010
Inhalt
- List of Figures
- List of Tables
- List of Acronyms
- Acknowledgement
- Introduction
- Interdisciplinary Background
- Gaze and Manual Gesture in Communication
- Reference and Deixis
- Manual Pointing
- Gaze Pointing
- Coupling of Gesture and Gaze
- Summary
- Related Work in Human-Computer Interaction
- Multimodal Interaction with Gesture and Gaze
- Detecting Pointing in Gaze and Manual Gestures
- Interpreting Pointing
- Integrating Multimodal Deixis
- Summary
- Manual Pointing
- Deixis in Construction Dialogues
- Study Objectives
- Study Design
- Domain of Possible Referents
- Data Acquisition
- The Interactive Augmented Data Explorer (IADE)
- Annotation
- Simulative Analysis and Visualization with IADE
- Results
- Visualizing Gesture Space in 3D
- Visualizing Reference Volumes for Manual Pointing
- Summary
- Gaze Pointing
- Study 1: Direction-based Pointing
- Study 1: Hardware Set-Up
- Study 1: Visual Ping
- Study 1: Results
- Study 1: Discussion
- Study 2: Location-based Pointing
- Study 2: Hypotheses
- Study 2: Scenario
- Study 2: Results
- Study 2: Discussion
- Visualizing the Point of Regard in 3D
- Summary
- Modeling the Extension of Gaze and Manual Pointing
- Study on Manual Pointing Reconsidered
- Modeling the Direction of Manual Pointing
- Modeling the Spatial Extension of Manual Pointing
- Modeling Gaze Pointing
- Integrating Pointing Models with a Conversational Interface
- Summary
- Applications and Conclusion
- Bibliography
- Appendix
- DRIVE: Deictic Reference in Virtual Environments