Narrative Cognition in Mixed Reality Systems: Towards an Empirical Framework

Luis Emilio Bruni*, Hossein Dini, Aline Simonetti

*Corresponding author for this work

Research output: Contribution to book/anthology/report/conference proceedingBook chapterResearchpeer-review

2 Citations (Scopus)


In this paper, we propose an interdisciplinary theoretical and empirical framework to investigate the particular faculties related to human “narrative cognition”, in general, and in relation to MRT in particular. In order to contextualize our approach, we shortly review the cognitive turn in narratology, as well as state of the art in different domains that have undertaken psychophysiological studies that either characterize aspects that are relevant to narrative cognition, or which investigate mixed reality experiences. The idea is to bring together knowledge and insights from narratology, different branches of semiotics and cognitive sciences, with empirical strategies that bridge the gap between first-person phenomenological approaches and psychophysiological and behavioural methods. We propose a rationale in order to combine tools and techniques from MRT/VR/AR, interactive digital narratives and storytelling, with a suite of integrated psychophysiological methods (such as EEG, HR, GSR and eye tracking) and phenomenological-subjective approaches.
Original languageEnglish
Title of host publicationVirtual, Augmented and Mixed Reality : 13th International Conference, VAMR 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021, Proceedings
EditorsJ.Y.C. Chen , G. Fragomeni
Number of pages15
Publication date2021
ISBN (Print)978-3-030-77598-8
ISBN (Electronic)978-3-030-77599-5
Publication statusPublished - 2021
23rd International Conference on Human-Computer Interaction
- Virtual Event
Duration: 24 Jul 202129 Jul 2021


23rd International Conference on Human-Computer Interaction
LocationVirtual Event
SeriesLecture Notes in Computer Science (LNCS)


  • Narrative cognition
  • Mixed reality technologies
  • Psychophysiology
  • VR
  • Electroencephalogram (EEG)
  • Phenomenology
  • Interactive narratives


Dive into the research topics of 'Narrative Cognition in Mixed Reality Systems: Towards an Empirical Framework'. Together they form a unique fingerprint.

Cite this