[Back]

D. Grelaud, N. Bonneel, M. Wimmer, M. Asselot, G. Drettakis:
"Efficient and Practical Audio-Visual Rendering for Games using Crossmodal Perception";
Talk: ACM Siggraph Symposium on Interactive 3D Graphics, Boston, Massachusetts; 2009-02-27 - 2009-03-01; in: "Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games 2009", (2009), ISBN: 978-1-60558-429-4; 177 - 182.

Interactive applications such as computer games, are inherently audio visual, requiring high-quality rendering of complex 3D audio soundscapes and graphics environments. A frequent source of audio events is impact sounds, typically generated with physics engines. In this paper, we first present an optimization allowing efficient usage of impact sounds in a unified audio rendering pipeline, also including prerecorded sounds. We also exploit a recent result on audio-visual crossmodal perception to introduce a new level-of-detail selection algorithm, which jointly chooses the quality level of audio and graphics rendering. We have integrated these two techniques as a comprehensive crossmodal audio-visual rendering pipeline in a home-grown game engine, thus demonstrating the potential utility of our approach.

http://publik.tuwien.ac.at/files/PubDat_180429.pdf

Project Head Michael Wimmer:
EU Crossmodal