Inhabiting Spatial Video and Audio Data: Towards a Scenographic Turn in the Analysis of Social Interaction

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

Resumé

Consumer versions of the passive 360° and stereoscopic omni-directional camera have recently come to market, generating new possibilities for qualitative video data collection. This paper discusses some of the methodological issues raised by collecting, manipulating and analysing complex video data recorded with 360° cameras and ambisonic microphones. It also reports on the development of a simple, yet powerful prototype to support focused engagement with such 360° recordings of a scene. The paper proposes that we ‘inhabit’ video through a tangible interface in virtual reality (VR) in order to explore complex spatial video and audio recordings of a single scene in which social interaction took place. The prototype is a software package called AVA360VR (‘Annotate, Visualise, Analyse 360° video in VR’). The paper is illustrated through a number of video clips, including a composite video of raw and semi-processed multi-cam recordings, a 360° video with spatial audio, a video comprising a sequence of static 360° screenshots of the AVA360VR interface, and a video comprising several screen capture clips of actual use of the tool. The paper discusses the prototype’s development and its analytical possibilities when inhabiting spatial video and audio footage as a complementary mode of re-presenting, engaging with, sharing and collaborating on interactional video data.
OriginalsprogEngelsk
TidsskriftSocial Interaction. Video-Based Studies of Human Sociality
Vol/bind2
Udgave nummer1
DOI
StatusUdgivet - 5 nov. 2018

Fingerprint

Virtual reality
Cameras
Audio recordings
Video recording
Cams
Microphones
Software packages
Composite materials

Citer dette

@article{601bebaaea6e4cb99d346b8fa3594ac7,
title = "Inhabiting Spatial Video and Audio Data: Towards a Scenographic Turn in the Analysis of Social Interaction",
abstract = "Consumer versions of the passive 360° and stereoscopic omni-directional camera have recently come to market, generating new possibilities for qualitative video data collection. This paper discusses some of the methodological issues raised by collecting, manipulating and analysing complex video data recorded with 360° cameras and ambisonic microphones. It also reports on the development of a simple, yet powerful prototype to support focused engagement with such 360° recordings of a scene. The paper proposes that we ‘inhabit’ video through a tangible interface in virtual reality (VR) in order to explore complex spatial video and audio recordings of a single scene in which social interaction took place. The prototype is a software package called AVA360VR (‘Annotate, Visualise, Analyse 360° video in VR’). The paper is illustrated through a number of video clips, including a composite video of raw and semi-processed multi-cam recordings, a 360° video with spatial audio, a video comprising a sequence of static 360° screenshots of the AVA360VR interface, and a video comprising several screen capture clips of actual use of the tool. The paper discusses the prototype’s development and its analytical possibilities when inhabiting spatial video and audio footage as a complementary mode of re-presenting, engaging with, sharing and collaborating on interactional video data.",
keywords = "Video Analysis, Big Video, Scenography, Digital Humanities, Virtual Reality, Immersive Environments",
author = "Mcilvenny, {Paul Bruce}",
year = "2018",
month = "11",
day = "5",
doi = "10.7146/si.v2i1.110409",
language = "English",
volume = "2",
journal = "Social Interaction. Video-Based Studies of Human Sociality",
issn = "2446-3620",
publisher = "Royal Danish Library",
number = "1",

}

TY - JOUR

T1 - Inhabiting Spatial Video and Audio Data

T2 - Towards a Scenographic Turn in the Analysis of Social Interaction

AU - Mcilvenny, Paul Bruce

PY - 2018/11/5

Y1 - 2018/11/5

N2 - Consumer versions of the passive 360° and stereoscopic omni-directional camera have recently come to market, generating new possibilities for qualitative video data collection. This paper discusses some of the methodological issues raised by collecting, manipulating and analysing complex video data recorded with 360° cameras and ambisonic microphones. It also reports on the development of a simple, yet powerful prototype to support focused engagement with such 360° recordings of a scene. The paper proposes that we ‘inhabit’ video through a tangible interface in virtual reality (VR) in order to explore complex spatial video and audio recordings of a single scene in which social interaction took place. The prototype is a software package called AVA360VR (‘Annotate, Visualise, Analyse 360° video in VR’). The paper is illustrated through a number of video clips, including a composite video of raw and semi-processed multi-cam recordings, a 360° video with spatial audio, a video comprising a sequence of static 360° screenshots of the AVA360VR interface, and a video comprising several screen capture clips of actual use of the tool. The paper discusses the prototype’s development and its analytical possibilities when inhabiting spatial video and audio footage as a complementary mode of re-presenting, engaging with, sharing and collaborating on interactional video data.

AB - Consumer versions of the passive 360° and stereoscopic omni-directional camera have recently come to market, generating new possibilities for qualitative video data collection. This paper discusses some of the methodological issues raised by collecting, manipulating and analysing complex video data recorded with 360° cameras and ambisonic microphones. It also reports on the development of a simple, yet powerful prototype to support focused engagement with such 360° recordings of a scene. The paper proposes that we ‘inhabit’ video through a tangible interface in virtual reality (VR) in order to explore complex spatial video and audio recordings of a single scene in which social interaction took place. The prototype is a software package called AVA360VR (‘Annotate, Visualise, Analyse 360° video in VR’). The paper is illustrated through a number of video clips, including a composite video of raw and semi-processed multi-cam recordings, a 360° video with spatial audio, a video comprising a sequence of static 360° screenshots of the AVA360VR interface, and a video comprising several screen capture clips of actual use of the tool. The paper discusses the prototype’s development and its analytical possibilities when inhabiting spatial video and audio footage as a complementary mode of re-presenting, engaging with, sharing and collaborating on interactional video data.

KW - Video Analysis

KW - Big Video

KW - Scenography

KW - Digital Humanities

KW - Virtual Reality

KW - Immersive Environments

U2 - 10.7146/si.v2i1.110409

DO - 10.7146/si.v2i1.110409

M3 - Journal article

VL - 2

JO - Social Interaction. Video-Based Studies of Human Sociality

JF - Social Interaction. Video-Based Studies of Human Sociality

SN - 2446-3620

IS - 1

ER -