Motion Capture in the Metaverse - embodied co-present hybrid theater

We present the ‘Metastage’ - a hybrid stage composed of a physical performance space, mediated and augmented through Metaverse-enabling technologies such as motion capture, virtual reality, and virtual production. We adopt a broad definition of ‘The Metaverse’ as an emerging concept, encompassing not only 100% virtual worlds, but also virtual, augmented and mixed reality. As such, we examine the Metaverse as various interconnected digital platforms (Ritterbusch & Teichmann 2023) enabling new forms of human connections and real-time performative potentials across multiple devices and platforms (Proulx et al 2022; Park & Kim, 2022).
The Metastage is a conceptual platform designed for hybrid theatrical performances, which involve actors wearing motion-capture suits, performing in front of live audiences who experience the performance through both physical and virtual reality elements, while also being live streamed to virtual reality audiences at other locations.The audience is able to participate in the performance through game-like interactions at crucial points, affecting various parts of the performance. Thus, the Metastage constitutes a mix of live non-digital performance, augmented virtual reality motion-capture performances, and distributed virtual reality to remote audiences - affected by the audience's interactions throughout. The case for the Meta-stage is the experimental theater platform, White Hole Theater, and the three danish digital hybrid performances: ‘Valdemars Story’, ‘The Battle #1’, and ‘The Battle #2’. We present how the Metastage has been utilized in the three cultural heritage-inspired theater performances in 2021-2023, where historical dramatic events from Denmark in 1146 are mixed into modern day life through the hybrid performance (White Hole Theater 2023).