Banf, Michael: Auditory image understanding for the visually impaired based on a modular computer vision sonification modelAkustisches Bildverständnis für Sehbehinderte basierend auf einem modularen Computer Visions Sonifikations Modell. 2013
Inhalt
- Zusammenfassung
- Abstract
- Contents
- Introduction
- I Sonification & Auditory Perception
- Introduction to Sonification
- Definitions
- Research in Auditory Displays
- Sonification Techniques
- Fields of Application
- Auditory Displays for the Visually Impaired
- Auditory Perception
- Sound Computation
- II A Modular Computer Vision Sonification Model
- III Auditory Object Recognition
- Background & Objectives
- Low-Level Feature Image Analysis
- Color Information & Image Pre-Processing
- Simulated Surround Suppression Based on Orientation Maps
- Textural Roughness
- Shape Extraction of Basic Objects using Graph Cuts
- Color and Low-Level Feature Sonification
- Audible Color Space
- Complementary Instruments Inspired by Hering's Theory of Opponent Colors
- Sonification of the HSL Color Space
- Interpolation of Audible Colors Based on Thin Plate Splines
- An Audible HSL-Opponent Color Space
- Auditory Edge Detection - the Sonification of Orientation Maps
- Audible Roughness - the Sonification of Local Entropy
- MIDI Based Sonification
- User Studies
- IV Auditory Image Understanding
- Motivation
- Multi-Level Image Analysis
- Auditory Scene Labeling
- Image Pre-Processing
- Detection of Man Made Structures in Natural Scenes
- Modeling Spatial Dependencies in Natural Images
- Feature Set
- Parameter Learning
- Inference
- Results & Discussion
- Low-Level Feature Extraction Controlled by High-Level Classification
- Object Recognition & Verification
- Sonification for Auditory Scene Understanding
- An Audible Color Space Representation Inspired by Visual Color Perception
- A Physical Perspective on Color Temperature
- Chromesthesia
- Color Symbolism
- Timbre Synthesis - the Creation of Colored Sounds
- Computation of the Audible Color Space
- Amplitude Envelope
- Classified-Region Dependent Feature Sonification
- Audible Object Detections Based on Auditory Icons
- On & Off Screen Indication Based on Earcons
- User Studies & Discussion
- Experiments
- Experiment I - Object Recognition by Color Only
- Experiment II - Basic Scene Elements
- Experiment III - Understanding Scenes Audibly
- Experiment IV - Understanding Scenes Audibly
- Experiment V - Categorization of Man Made Structures
- Discussion
- System Design of the Explorative Image Sonifyer Software
- V Conclusion
- VI Appendix
- Mathematical & Algorithmic Concepts
- Edge Preserving Filtering
- Fractal Geometry & Fractal Dimension
- Gabor Wavelet Transform
- Gaussian Image Pyramids
- Algorithms in Graph Theory
- Dijkstra's Single-Source Shortest-Paths Algorithm
- Prim's Minimum-Spanning-Tree Algorithm
- Graph Cuts and the Min-Cut / Max-Flow Problem
- The Irrklang Audio Engine
- Learning Theory & Support Vector Classifiers
- Solid of Rotation
- The Synthesis Toolkit
- Thin Plate Splines
- Visual Perception
- Bibliography
- Bibliography