Narrative Cognition in Mixed Reality Systems: Towards an Empirical Framework

Luis Emilio Bruni*, Hossein Dini, Aline Simonetti

*Corresponding author for this work

Research output: Contribution to book/anthology/report/conference proceedingBook chapterResearchpeer-review

Abstract

In this paper, we propose an interdisciplinary theoretical and empirical framework to investigate the particular faculties related to human “narrative cognition”, in general, and in relation to MRT in particular. In order to contextualize our approach, we shortly review the cognitive turn in narratology, as well as state of the art in different domains that have undertaken psychophysiological studies that either characterize aspects that are relevant to narrative cognition, or which investigate mixed reality experiences. The idea is to bring together knowledge and insights from narratology, different branches of semiotics and cognitive sciences, with empirical strategies that bridge the gap between first-person phenomenological approaches and psychophysiological and behavioural methods. We propose a rationale in order to combine tools and techniques from MRT/VR/AR, interactive digital narratives and storytelling, with a suite of integrated psychophysiological methods (such as EEG, HR, GSR and eye tracking) and phenomenological-subjective approaches.
Original languageEnglish
Title of host publicationVirtual, Augmented and Mixed Reality
EditorsJ.Y.C. Chen , G. Fragomeni
Volume12770
PublisherSpringer
Publication date2021
ISBN (Print)978-3-030-77598-8
ISBN (Electronic)978-3-030-77599-5
Publication statusPublished - 2021
Event
23rd International Conference on Human-Computer Interaction
- Virtual Event
Duration: 24 Jul 202129 Jul 2021

Conference

Conference
23rd International Conference on Human-Computer Interaction
LocationVirtual Event
Period24/07/202129/07/2021
SeriesLecture Notes in Computer Science (LNCS)
ISSN0302-9743

Keywords

  • Narrative cognition
  • Mixed reality technologies
  • Psychophysiology
  • VR
  • Electroencephalogram (EEG)
  • Phenomenology
  • Interactive narratives

Fingerprint

Dive into the research topics of 'Narrative Cognition in Mixed Reality Systems: Towards an Empirical Framework'. Together they form a unique fingerprint.

Cite this