Beiträge & Bücher

Art der Publikation: Beitrag in Sammelwerk

SoundsRide: Affordance-Synchronized Music Mixing for In-Car Audio Augmented Reality (Best Paper Award)

Autor(en):
Kari, Mohamed; Grosse-Puppendahl, Tobias; Jagaciak, Alexander; Bethge, David; Schütte, Reinhard; Holz, Christian
Titel des Sammelbands:
The 34th Annual ACM Symposium on User Interface Software and Technology
Seiten:
118-133
Verlag:
Association for Computing Machinery
Ort(e):
New York, NY, USA
Veröffentlichung:
2021
ISBN:
9781450386357
Schlagworte:
auditory augmented reality, sound affordances, context-adaptive music
Digital Object Identifier (DOI):
doi:10.1145/3472749.3474739
Zitation:
Download BibTeX

Kurzfassung

Music is a central instrument in video gaming to attune a player’s attention to the current atmosphere and increase their immersion in the game. We transfer the idea of scene-adaptive music to car drives and propose SoundsRide, an in-car audio augmented reality system that mixes music in real-time synchronized with sound affordances along the ride. After exploring the design space of affordance-synchronized music, we design SoundsRide to temporally and spatially align high-contrast events on the route, e.g., highway entrances or tunnel exits, with high-contrast events in music, e.g., song transitions or beat drops, for any recorded and annotated GPS trajectory by a three-step procedure. In real-time, SoundsRide 1) estimates temporal distances to events on the route, 2) fuses these novel estimates with previous estimates in a cost-aware music-mixing plan, and 3) if necessary, re-computes an updated mix to be propagated to the audio output. To minimize user-noticeable updates to the mix, SoundsRide fuses new distance information with a filtering procedure that chooses the best updating strategy given the last music-mixing plan, the novel distance estimations, and the system parameterization. We technically evaluate SoundsRide and conduct a user evaluation with 8 participants to gain insights into how users perceive SoundsRide in terms of mixing, affordances, and synchronicity. We find that SoundsRide can create captivating music experiences and positively as well as negatively influence subjectively perceived driving safety, depending on the mix and user.