Beyond Visual Computing: Interactive Auditory Display
- Day - Time: 14 June 2013, h.11:00
- Place: Area della Ricerca CNR di Pisa - Room: A-32
Speakers
- Ming C. Lin (Department of Computer Science, University of North Carolina at Chapel Hill)
Referent
Abstract
Extending the frontier of visual computing, an interactive auditory display utilizes sound to communicate information to a user and offers an alternative means of visualization. By harnessing the sense of hearing, sound or audio rendering can further enhance a userâ??s experience in a multimodal virtual world. In addition to immersive environments, audio feedback can provide a natural and intuitive human-computer interface for many desktop applications such as computer games, online virtual worlds, visualization, simulation, and training.
In this talk, I will give an overview of our recent work on sound synthesis and sound propagation. These include generating realistic physically-based sounds from rigid body dynamic simulation and liquid sounds based on bubble resonance coupled with fluid simulators. I will also describe new and fast algorithms for sound propagation based on improved numerical techniques and fast geometric sound propagation based on extension of ray-tracing techniques. These algorithms improve the state of the art in sound rendering by at least one to two orders of magnitude and I will demonstrate their performance on interactive sound synthesis and propagation in complex, dynamic environments by utilizing the parallelism of many-core processors and GPUs commonly available on desktop systems.