Gestural Control Of Wavefield synthesis

Francesco Grani, Diego Di Carlo, Jorge Madrid Portillo, Matteo Girardi, Razvan Paisa, Jan Stian Banas, Iakovos Vogiatzoglou, Daniel Overholt, Stefania Serafin

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

189 Downloads (Pure)

Resumé


We present a report covering our preliminary research on the control of spatial sound sources in wavefield synthesis through gesture based interfaces.
After a short general introduction on spatial sound and few basic concepts on wavefield synthesis, we presents a graphical application called spAAce which let users to con- trol real-time movements of sound sources by drawing tra- jectories on a screen. The first prototype of this application has been developed bound to WFSCollider, an open-source software based on Supercollider which let users control wavefield synthesis. The spAAce application has been im- plemented using Processing, a programming language for sketches and prototypes within the context of visual arts, and communicates with WFSCollider through the Open Sound Control protocol. This application aims to create a new way of interaction for live performance of spatial composition and live electronics.
In a subsequent section we present an auditory game in which players can walk freely inside a virtual acoustic en- vironment (a room in a commercial ship) while being ex- posed to the presence of several “enemies”, which the player needs to localise and eliminate by using a Nintendo Wi- iMote game controller to “throw” sounding objects towards them. Aim of this project was to create a gestural interface for a game based on auditory cues only, and to investigate how convolution reverberation can affects people’s percep- tion of distance in a wavefield synthesis setup environment.
OriginalsprogEngelsk
TitelSound And Music Computing Conference Proceedings 2016
ForlagZentrum für Mikrotonale Musik und Multimediale Komposition (ZM4)
Publikationsdatoaug. 2016
Sider185-192
ISBN (Trykt)978-3-00-053700-4
StatusUdgivet - aug. 2016
Begivenhed13th Sound and Music Computing Conference (SMC 2016) - Hamburg, Tyskland
Varighed: 31 aug. 20163 sep. 2016

Konference

Konference13th Sound and Music Computing Conference (SMC 2016)
LandTyskland
ByHamburg
Periode31/08/201603/09/2016

Fingerprint

Acoustic waves
Reverberation
Real time control
Convolution
Computer programming languages
Ships
Electronic equipment
Acoustics
Trajectories
Network protocols
Controllers
Processing
Chemical analysis
Open source software

Citer dette

Grani, F., Di Carlo, D., Portillo, J. M., Girardi, M., Paisa, R., Banas, J. S., ... Serafin, S. (2016). Gestural Control Of Wavefield synthesis. I Sound And Music Computing Conference Proceedings 2016 (s. 185-192). Zentrum für Mikrotonale Musik und Multimediale Komposition (ZM4).
Grani, Francesco ; Di Carlo, Diego ; Portillo, Jorge Madrid ; Girardi, Matteo ; Paisa, Razvan ; Banas, Jan Stian ; Vogiatzoglou, Iakovos ; Overholt, Daniel ; Serafin, Stefania. / Gestural Control Of Wavefield synthesis. Sound And Music Computing Conference Proceedings 2016. Zentrum für Mikrotonale Musik und Multimediale Komposition (ZM4), 2016. s. 185-192
@inproceedings{99c2d1cd06cb4944aec31c268ba1b9fe,
title = "Gestural Control Of Wavefield synthesis",
abstract = "We present a report covering our preliminary research on the control of spatial sound sources in wavefield synthesis through gesture based interfaces.After a short general introduction on spatial sound and few basic concepts on wavefield synthesis, we presents a graphical application called spAAce which let users to con- trol real-time movements of sound sources by drawing tra- jectories on a screen. The first prototype of this application has been developed bound to WFSCollider, an open-source software based on Supercollider which let users control wavefield synthesis. The spAAce application has been im- plemented using Processing, a programming language for sketches and prototypes within the context of visual arts, and communicates with WFSCollider through the Open Sound Control protocol. This application aims to create a new way of interaction for live performance of spatial composition and live electronics.In a subsequent section we present an auditory game in which players can walk freely inside a virtual acoustic en- vironment (a room in a commercial ship) while being ex- posed to the presence of several “enemies”, which the player needs to localise and eliminate by using a Nintendo Wi- iMote game controller to “throw” sounding objects towards them. Aim of this project was to create a gestural interface for a game based on auditory cues only, and to investigate how convolution reverberation can affects people’s percep- tion of distance in a wavefield synthesis setup environment.",
author = "Francesco Grani and {Di Carlo}, Diego and Portillo, {Jorge Madrid} and Matteo Girardi and Razvan Paisa and Banas, {Jan Stian} and Iakovos Vogiatzoglou and Daniel Overholt and Stefania Serafin",
year = "2016",
month = "8",
language = "English",
isbn = "978-3-00-053700-4",
pages = "185--192",
booktitle = "Sound And Music Computing Conference Proceedings 2016",
publisher = "Zentrum f{\"u}r Mikrotonale Musik und Multimediale Komposition (ZM4)",

}

Grani, F, Di Carlo, D, Portillo, JM, Girardi, M, Paisa, R, Banas, JS, Vogiatzoglou, I, Overholt, D & Serafin, S 2016, Gestural Control Of Wavefield synthesis. i Sound And Music Computing Conference Proceedings 2016. Zentrum für Mikrotonale Musik und Multimediale Komposition (ZM4), s. 185-192, 13th Sound and Music Computing Conference (SMC 2016), Hamburg, Tyskland, 31/08/2016.

Gestural Control Of Wavefield synthesis. / Grani, Francesco; Di Carlo, Diego; Portillo, Jorge Madrid; Girardi, Matteo; Paisa, Razvan; Banas, Jan Stian; Vogiatzoglou, Iakovos; Overholt, Daniel; Serafin, Stefania.

Sound And Music Computing Conference Proceedings 2016. Zentrum für Mikrotonale Musik und Multimediale Komposition (ZM4), 2016. s. 185-192.

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

TY - GEN

T1 - Gestural Control Of Wavefield synthesis

AU - Grani, Francesco

AU - Di Carlo, Diego

AU - Portillo, Jorge Madrid

AU - Girardi, Matteo

AU - Paisa, Razvan

AU - Banas, Jan Stian

AU - Vogiatzoglou, Iakovos

AU - Overholt, Daniel

AU - Serafin, Stefania

PY - 2016/8

Y1 - 2016/8

N2 - We present a report covering our preliminary research on the control of spatial sound sources in wavefield synthesis through gesture based interfaces.After a short general introduction on spatial sound and few basic concepts on wavefield synthesis, we presents a graphical application called spAAce which let users to con- trol real-time movements of sound sources by drawing tra- jectories on a screen. The first prototype of this application has been developed bound to WFSCollider, an open-source software based on Supercollider which let users control wavefield synthesis. The spAAce application has been im- plemented using Processing, a programming language for sketches and prototypes within the context of visual arts, and communicates with WFSCollider through the Open Sound Control protocol. This application aims to create a new way of interaction for live performance of spatial composition and live electronics.In a subsequent section we present an auditory game in which players can walk freely inside a virtual acoustic en- vironment (a room in a commercial ship) while being ex- posed to the presence of several “enemies”, which the player needs to localise and eliminate by using a Nintendo Wi- iMote game controller to “throw” sounding objects towards them. Aim of this project was to create a gestural interface for a game based on auditory cues only, and to investigate how convolution reverberation can affects people’s percep- tion of distance in a wavefield synthesis setup environment.

AB - We present a report covering our preliminary research on the control of spatial sound sources in wavefield synthesis through gesture based interfaces.After a short general introduction on spatial sound and few basic concepts on wavefield synthesis, we presents a graphical application called spAAce which let users to con- trol real-time movements of sound sources by drawing tra- jectories on a screen. The first prototype of this application has been developed bound to WFSCollider, an open-source software based on Supercollider which let users control wavefield synthesis. The spAAce application has been im- plemented using Processing, a programming language for sketches and prototypes within the context of visual arts, and communicates with WFSCollider through the Open Sound Control protocol. This application aims to create a new way of interaction for live performance of spatial composition and live electronics.In a subsequent section we present an auditory game in which players can walk freely inside a virtual acoustic en- vironment (a room in a commercial ship) while being ex- posed to the presence of several “enemies”, which the player needs to localise and eliminate by using a Nintendo Wi- iMote game controller to “throw” sounding objects towards them. Aim of this project was to create a gestural interface for a game based on auditory cues only, and to investigate how convolution reverberation can affects people’s percep- tion of distance in a wavefield synthesis setup environment.

M3 - Article in proceeding

SN - 978-3-00-053700-4

SP - 185

EP - 192

BT - Sound And Music Computing Conference Proceedings 2016

PB - Zentrum für Mikrotonale Musik und Multimediale Komposition (ZM4)

ER -

Grani F, Di Carlo D, Portillo JM, Girardi M, Paisa R, Banas JS et al. Gestural Control Of Wavefield synthesis. I Sound And Music Computing Conference Proceedings 2016. Zentrum für Mikrotonale Musik und Multimediale Komposition (ZM4). 2016. s. 185-192