Inhalt

•  
  Introduction to tasks and processes in experiment control and multimodal analysis
•  
   An example research process
•  
  Facilitating the research process
•  
   Recording
•  
   Tagging
•  
   Data preparation and conversion
•  
   Analysis
•  
   Intermediate summary
•  
   A closed-loop approach to facilitate experiments
•  
   Recording
•  
   Controlling
•  
   Disturbing
•  
   Enhancing/Supporting
•  
   Intermediate summary
•  
   Research questions
•  
   Outline
•  
  Theoretical background
•  
   Communication, interaction and conversation
•  
   Selected phenomena in interaction
•  
   Selected nonverbal behavioural cues
•  
   Analysis of interaction
•  
   Augmented Reality (AR)
•  
   Sonification
•  
   Abbreviations
•  
   The AR-enabled Interception Interface (ARbInI)
•  
  Hardware
•  
   Video components
•  
   Audio components
•  
   Touch components
•  
   Motion and gesture tracking
•  
   Software
•  
   Video data processing
•  
   Audio data processing
•  
   Tactile and motion sensor data processing
•  
   Features and Methods of ARbInI
•  
  Controlling experiments
•  
   Component selection
•  
   AR-based interaction scenarios
•  
   Controlling the trial process
•  
   Disturbing interaction
•  
   Recording interaction
•  
   Tagging interaction
•  
   Enhancing interaction
•  
   Mediated attention
•  
   Conversion: synchronizing and transforming for visualization
•  
   Analysing multimodal corpora
•  
  Scenarios
•  
   Interaction objects
•  
   Characteristics & Interaction behaviour of the objects
•  
   Criteria for scenarios or tasks
•  
   Scenarios and tasks
•  
   Object games
•  
   Collaborative and multimodal 3-dimensional data exploration
•  
   Gaze game
•  
   Interactive-exhibition design scenario
•  
   Visual search
•  
   Animal guessing
•  
   Smalltalk
•  
   Prompting by computer
•  
   Summary
•  
   Studies presented in this work
•  
  Side-effects on the interaction
•  
   Issues of head-mounted AR and their effects on the wearer
•  
  Influence of HMDs on eye and head movements
•  
   Expectations
•  
   Method
•  
   Results
•  
   Discussion
•  
  Influence of HMDs on head movements, speech and task accomplishment
•  
   Hypotheses
•  
   Method
•  
   Results and discussion
•  
   Summary
•  
   Summary and Discussion
•  
  Computer-aided investigation of interaction
•  
   Automatic tracking of objects in the field of view
•  
   Outlook
•  
  Automatic annotation of speech times
•  
   Analysis of the speech data of this work
•  
   Discussion
•  
   Outlook
•  
  Automatic tagging of head gestures
•  
   Training and classification
•  
   Offline evaluation
•  
   Automatic/Online classification
•  
   Analysis of relevant axes for detailed analysis of gestures
•  
   Head gesture corpus
•  
   Analysis of the corpus data
•  
   Outlook
•  
   Timing of speech and head gesture data
•  
   Method
•  
   Outlook
•  
   Summary
•  
  Actively influencing interaction with ARbInI
•  
   Guiding attention
•  
   Method
•  
   Scenario: the ``gaze game''
•  
   Procedure for the study and sample
•  
   Results
•  
   Discussion
•  
  Disturbing interaction
•  
   Review of literature
•  
   Method
•  
   Initial observations
•  
   Discussion
•  
   Conclusion
•  
  Appendix
•  
  Interactive exhibition design study
•  
   Questionnaire AR group
•  
   Questionnaire non-AR group
•  
   Mapping of markers to interactive exhibits
•  
   Enhancing/Supporting: A multimodal display for the focus of attention
•  
   Todos
•  
   Bibliography