What You Hear is Where You Are is What I Hear: Optimising Immersive Experiences for Interindividual Differences

Hans-Peter Gasselseder

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

Abstract

Aiming at providing data points for a framework of adaptive audio implementations, this paper draws on previous results obtained from an ongoing series of experiments in ludomusicology. From discussing findings on enhanced user interaction in video games through the use of adaptive music, further insights are offered into optimising immersive experience by means of adjusted temporal-structural and expressive attributes according to interindividual differences in the cognitive-emotional processing of music. In addition to outlining those implications for the design of a user-aware audio engine, the presented study takes into account situational percepts and context effects as opposed to treating situation as a mere external stimulus.

Not only the cognitive-emotional processing of music, but also situation awareness and tendency for immersive experience, has been shown to vary along different manifestations of personality traits. Accordingly, self-report measures of spatial presence and emotional response showcased correlations with trait empathising-systemising and trait absorption. Differential effects on those dimensions appeared depending on the use of situation-adaptive implementations of low and high arousing music stimuli in an action-adventure 3D video game. These findings suggest interindividual differences in the sub-attentional processing of music found in genre video games and are discussed with regards to the potential of psychologically informed sound design to affect a users’ mental model of situational context and experience of agency.
Original languageEnglish
Title of host publicationEVA London 2016 : Electronic Visualisation and the Arts.
EditorsJonathan Bowen, Graham Diprose, Nick Lambert
Number of pages9
Place of PublicationLondon
PublisherBCS Learning & Development Ltd
Publication date12 Jul 2016
Pages61-69
ISBN (Print)9781780173443
Publication statusPublished - 12 Jul 2016
EventEVA London 2016: Electronic Visualisation and the Arts - BCS, 1st Floor, 5 Southampton Street, London WC2E 7HA, London, United Kingdom
Duration: 11 Jul 201613 Jul 2016
http://www.eva-london.org

Conference

ConferenceEVA London 2016
LocationBCS, 1st Floor, 5 Southampton Street, London WC2E 7HA
Country/TerritoryUnited Kingdom
CityLondon
Period11/07/201613/07/2016
Internet address
SeriesElectronic Workshops in Computing
ISSN1477-9358
SeriesElectronic Workshops in Computing
ISSN1477-9358

Keywords

  • User-Aware Audio
  • Music
  • Personality
  • Situation
  • Immersive Experience
  • Empathising
  • Involvement

Fingerprint

Dive into the research topics of 'What You Hear is Where You Are is What I Hear: Optimising Immersive Experiences for Interindividual Differences'. Together they form a unique fingerprint.
  • EVA London 2016

    Hans-Peter Gasselseder (Speaker)

    12 Jul 201613 Jul 2016

    Activity: Talks and presentationsConference presentations

Cite this