Inhabiting Spatial Video and Audio Data

Towards a Scenographic Turn in the Analysis of Social Interaction

Research output: Contribution to journalJournal articleResearchpeer-review

Abstract

Consumer versions of the passive 360° and stereoscopic omni-directional camera have recently come to market, generating new possibilities for qualitative video data collection. This paper discusses some of the methodological issues raised by collecting, manipulating and analysing complex video data recorded with 360° cameras and ambisonic microphones. It also reports on the development of a simple, yet powerful prototype to support focused engagement with such 360° recordings of a scene. The paper proposes that we ‘inhabit’ video through a tangible interface in virtual reality (VR) in order to explore complex spatial video and audio recordings of a single scene in which social interaction took place. The prototype is a software package called AVA360VR (‘Annotate, Visualise, Analyse 360° video in VR’). The paper is illustrated through a number of video clips, including a composite video of raw and semi-processed multi-cam recordings, a 360° video with spatial audio, a video comprising a sequence of static 360° screenshots of the AVA360VR interface, and a video comprising several screen capture clips of actual use of the tool. The paper discusses the prototype’s development and its analytical possibilities when inhabiting spatial video and audio footage as a complementary mode of re-presenting, engaging with, sharing and collaborating on interactional video data.
Original languageEnglish
JournalSocial Interaction. Video-Based Studies of Human Sociality
Volume2
Issue number1
DOIs
Publication statusPublished - 5 Nov 2018

Fingerprint

Virtual reality
Cameras
Audio recordings
Video recording
Cams
Microphones
Software packages
Composite materials

Keywords

  • Video Analysis
  • Big Video
  • Scenography
  • Digital Humanities
  • Virtual Reality
  • Immersive Environments

Cite this

@article{601bebaaea6e4cb99d346b8fa3594ac7,
title = "Inhabiting Spatial Video and Audio Data: Towards a Scenographic Turn in the Analysis of Social Interaction",
abstract = "Consumer versions of the passive 360° and stereoscopic omni-directional camera have recently come to market, generating new possibilities for qualitative video data collection. This paper discusses some of the methodological issues raised by collecting, manipulating and analysing complex video data recorded with 360° cameras and ambisonic microphones. It also reports on the development of a simple, yet powerful prototype to support focused engagement with such 360° recordings of a scene. The paper proposes that we ‘inhabit’ video through a tangible interface in virtual reality (VR) in order to explore complex spatial video and audio recordings of a single scene in which social interaction took place. The prototype is a software package called AVA360VR (‘Annotate, Visualise, Analyse 360° video in VR’). The paper is illustrated through a number of video clips, including a composite video of raw and semi-processed multi-cam recordings, a 360° video with spatial audio, a video comprising a sequence of static 360° screenshots of the AVA360VR interface, and a video comprising several screen capture clips of actual use of the tool. The paper discusses the prototype’s development and its analytical possibilities when inhabiting spatial video and audio footage as a complementary mode of re-presenting, engaging with, sharing and collaborating on interactional video data.",
keywords = "Video Analysis, Big Video, Scenography, Digital Humanities, Virtual Reality, Immersive Environments",
author = "Mcilvenny, {Paul Bruce}",
year = "2018",
month = "11",
day = "5",
doi = "10.7146/si.v2i1.110409",
language = "English",
volume = "2",
journal = "Social Interaction. Video-Based Studies of Human Sociality",
issn = "2446-3620",
publisher = "Royal Danish Library",
number = "1",

}

Inhabiting Spatial Video and Audio Data : Towards a Scenographic Turn in the Analysis of Social Interaction. / Mcilvenny, Paul Bruce.

In: Social Interaction. Video-Based Studies of Human Sociality, Vol. 2, No. 1, 05.11.2018.

Research output: Contribution to journalJournal articleResearchpeer-review

TY - JOUR

T1 - Inhabiting Spatial Video and Audio Data

T2 - Towards a Scenographic Turn in the Analysis of Social Interaction

AU - Mcilvenny, Paul Bruce

PY - 2018/11/5

Y1 - 2018/11/5

N2 - Consumer versions of the passive 360° and stereoscopic omni-directional camera have recently come to market, generating new possibilities for qualitative video data collection. This paper discusses some of the methodological issues raised by collecting, manipulating and analysing complex video data recorded with 360° cameras and ambisonic microphones. It also reports on the development of a simple, yet powerful prototype to support focused engagement with such 360° recordings of a scene. The paper proposes that we ‘inhabit’ video through a tangible interface in virtual reality (VR) in order to explore complex spatial video and audio recordings of a single scene in which social interaction took place. The prototype is a software package called AVA360VR (‘Annotate, Visualise, Analyse 360° video in VR’). The paper is illustrated through a number of video clips, including a composite video of raw and semi-processed multi-cam recordings, a 360° video with spatial audio, a video comprising a sequence of static 360° screenshots of the AVA360VR interface, and a video comprising several screen capture clips of actual use of the tool. The paper discusses the prototype’s development and its analytical possibilities when inhabiting spatial video and audio footage as a complementary mode of re-presenting, engaging with, sharing and collaborating on interactional video data.

AB - Consumer versions of the passive 360° and stereoscopic omni-directional camera have recently come to market, generating new possibilities for qualitative video data collection. This paper discusses some of the methodological issues raised by collecting, manipulating and analysing complex video data recorded with 360° cameras and ambisonic microphones. It also reports on the development of a simple, yet powerful prototype to support focused engagement with such 360° recordings of a scene. The paper proposes that we ‘inhabit’ video through a tangible interface in virtual reality (VR) in order to explore complex spatial video and audio recordings of a single scene in which social interaction took place. The prototype is a software package called AVA360VR (‘Annotate, Visualise, Analyse 360° video in VR’). The paper is illustrated through a number of video clips, including a composite video of raw and semi-processed multi-cam recordings, a 360° video with spatial audio, a video comprising a sequence of static 360° screenshots of the AVA360VR interface, and a video comprising several screen capture clips of actual use of the tool. The paper discusses the prototype’s development and its analytical possibilities when inhabiting spatial video and audio footage as a complementary mode of re-presenting, engaging with, sharing and collaborating on interactional video data.

KW - Video Analysis

KW - Big Video

KW - Scenography

KW - Digital Humanities

KW - Virtual Reality

KW - Immersive Environments

U2 - 10.7146/si.v2i1.110409

DO - 10.7146/si.v2i1.110409

M3 - Journal article

VL - 2

JO - Social Interaction. Video-Based Studies of Human Sociality

JF - Social Interaction. Video-Based Studies of Human Sociality

SN - 2446-3620

IS - 1

ER -