Inhalt

•  
   Zusammenfassung
•  
   Abstract
•  
   Contents
•  
   Introduction
•  
   Motivation
•  
   Overview of Employed and Developed Technology
•  
   The Explorative Image Sonifyer Software
•  
   I Sonification & Auditory Perception
•  
  Introduction to Sonification
•  
   Definitions
•  
   Aesthetics
•  
   Research in Auditory Displays
•  
  Sonification Techniques
•  
   Audification
•  
   Auditory Icons
•  
   Earcons
•  
   Parameter Mapping Sonification
•  
   Model-Based Sonification
•  
   Fields of Application
•  
   Auditory Displays for the Visually Impaired
•  
   Sonification of Images
•  
   The Brain as (the) Essential Component of the Sonification System
•  
   Contributions of this Thesis
•  
  Auditory Perception
•  
  The Ear & the Auditory Cortex
•  
   On the Transduction of Sound from Mechanical Energy into Bio-electrical Signals and Beyond
•  
   Pitch
•  
   Loudness
•  
   Auditory Masking
•  
   Temporal and Spectral Variation
•  
   Sound Localization
•  
  Sound Computation
•  
  Sound Synthesis
•  
   Additive Synthesis
•  
   Subtractive Synthesis
•  
   FM Synthesis
•  
   Non-Linear Synthesis
•  
   Granular Synthesis
•  
   Physical Modeling
•  
  Noise
•  
   White Noise
•  
   Pink Noise
•  
   Brownian Noise
•  
   Representation of Analog Sound Signals in Digital Computers
•  
   II A Modular Computer Vision Sonification Model
•  
   Introduction
•  
   The Visual to Acoustical Processing Pipeline
•  
  Modules
•  
   Sensorics
•  
   Computation
•  
  Exploration
•  
   A Bas-Relief Inspired Exploration Paradigm
•  
   An Evaluation of Interface Technologies
•  
   Sonification
•  
   A Queue of Sonification Descriptors
•  
   III Auditory Object Recognition
•  
   Background & Objectives
•  
  Low-Level Feature Image Analysis
•  
  Color Information & Image Pre-Processing
•  
   Edge Preserving Filtering
•  
   Edge Detection
•  
   Simulated Surround Suppression Based on Orientation Maps
•  
   Computation of Orientation Maps
•  
   A Topological Representation of Orientation Patches
•  
   Textural Roughness
•  
   Gradient Based Entropy as a Local Roughness Measure
•  
   Shape Extraction of Basic Objects using Graph Cuts
•  
  Color and Low-Level Feature Sonification
•  
   Audible Color Space
•  
   Complementary Instruments Inspired by Hering's Theory of Opponent Colors
•  
  Sonification of the HSL Color Space
•  
   Gray-scale and Lightness
•  
   A Color Sound Synthesis Equation
•  
   Interpolation of Audible Colors Based on Thin Plate Splines
•  
   An Audible HSL-Opponent Color Space
•  
   Auditory Edge Detection - the Sonification of Orientation Maps
•  
   Audible Roughness - the Sonification of Local Entropy
•  
   MIDI Based Sonification
•  
   User Studies
•  
  Experiments
•  
   Experiment I - Object Recognition by Color only
•  
   Experiment II - Object Recognition by Color and Orientation Maps (Simplified)
•  
   Experiment III - Object Recognition by Color and Orientation Maps (Complex)
•  
   Experiment IV - Object Recognition within a Set of Objects
•  
   Results
•  
   Discussion
•  
   IV Auditory Image Understanding
•  
   Motivation
•  
   Multi-Level Image Analysis
•  
   Auditory Scene Labeling
•  
   Image Pre-Processing
•  
   Detection of Man Made Structures in Natural Scenes
•  
   Modeling Spatial Dependencies in Natural Images
•  
   Non-Linear Support Vector Machines
•  
   Dual Support Vector Fields
•  
  Feature Set
•  
   Smoothed Histograms of Gradient Orientations
•  
   Junctions & Line Patterns
•  
   Corner Point Patterns
•  
   Parameter Learning
•  
   Inference
•  
   Results & Discussion
•  
   Visual Uncertainty
•  
  Low-Level Feature Extraction Controlled by High-Level Classification
•  
   Natural Regions
•  
   Man Made Structures
•  
   Object Recognition & Verification
•  
   Object Categorization Using a Bag of Visual Words Model
•  
   Object Detection with Discriminatively Trained Part Based Models
•  
   A Learning-based Approach to Verification / Falsification of Object Recognitions
•  
   Feature Set
•  
   Principal Component Based Feature Set Transform
•  
   Results & Discussion
•  
   Extracting Objects
•  
  Sonification for Auditory Scene Understanding
•  
   An Audible Color Space Representation Inspired by Visual Color Perception
•  
   A Physical Perspective on Color Temperature
•  
   Chromesthesia
•  
   Color Symbolism
•  
   Timbre Synthesis - the Creation of Colored Sounds
•  
   Timbre Synthesis based on Complementary Sound Characteristics
•  
   Luminance Sonification
•  
   Computation of the Audible Color Space
•  
   A Timbre-Based Color Sound Synthesis Equation
•  
   Computation of Sound Parameter Volumetrics
•  
   Amplitude Envelope
•  
  Classified-Region Dependent Feature Sonification
•  
   Natural Regions Represented by Brown Noise
•  
  Man Made Structures Acoustically Encoded in Rhythms
•  
   Buildings & Line Patterns
•  
   Highest Gradient
•  
   Audible Object Detections Based on Auditory Icons
•  
   On & Off Screen Indication Based on Earcons
•  
   User Studies & Discussion
•  
  Experiments
•  
   Experiment I - Object Recognition by Color Only
•  
   Experiment II - Basic Scene Elements
•  
   Experiment III - Understanding Scenes Audibly
•  
   Experiment IV - Understanding Scenes Audibly
•  
   Experiment V - Categorization of Man Made Structures
•  
   Discussion
•  
  System Design of the Explorative Image Sonifyer Software
•  
   Usability
•  
   System Architecture
•  
   Text-to-Speech Output
•  
   Non-blocking Realtime Audio Programming
•  
   Portability
•  
   V Conclusion
•  
   Incorporating the System at the ``Internat des Rheinischen Blindenfürsorgeverein 1886 Düren''
•  
   VI Appendix
•  
   Mathematical & Algorithmic Concepts
•  
  Edge Preserving Filtering
•  
   Anisotropic Diffusion
•  
   Bilateral Filtering
•  
   On the Distortion of Colors
•  
   Fractal Geometry & Fractal Dimension
•  
   Gabor Wavelet Transform
•  
   Gaussian Image Pyramids
•  
  Algorithms in Graph Theory
•  
   Dijkstra's Single-Source Shortest-Paths Algorithm
•  
   Prim's Minimum-Spanning-Tree Algorithm
•  
  Graph Cuts and the Min-Cut / Max-Flow Problem
•  
   The Min-Cut / Max-Flow Problem
•  
   The Irrklang Audio Engine
•  
   Learning Theory & Support Vector Classifiers
•  
   Structural Risk Minimization
•  
   Support Vector Machines
•  
   Hard and Soft Margin Solutions
•  
   Non Linear Support Vector Machines
•  
   Probability Estimates
•  
   Parameter Estimation
•  
   Solid of Rotation
•  
   The Synthesis Toolkit
•  
   Thin Plate Splines
•  
   3D Interpolation
•  
   Visual Perception
•  
  The Human Visual System
•  
   Color Vision
•  
   The Retina
•  
   The Visual Pathway & The Visual Cortex
•  
   Luminance and Brightness
•  
   Simple & Complex Cells
•  
   Grating Cells
•  
   Surround Suppression
•  
   Color Spaces
•  
   RGB
•  
   HSL
•  
   Irregularities in the HSL Color Space
•  
   CIELab
•  
   Bibliography
•  
   Bibliography