TY - JOUR
T1 - Sound Synthesis and Evaluation of Interactive Footsteps and Environmental Sounds Rendering for Virtual Reality Applications
AU - Nordahl, Rolf
AU - Turchet, Luca
AU - Serafin, Stefania
PY - 2011
Y1 - 2011
N2 - We propose a system that affords real-time sound synthesis of footsteps on different materials. The system is based on microphones, which detect real footstep sounds from subjects, from which the ground reaction force (GRF) is estimated. Such GRF is used to control a sound synthesis engine based on physical models. Two experiments were conducted. In the first experiment, the ability of subjects to recognize the surface they were exposed to was assessed. In the second experiment, the sound synthesis engine was enhanced with environmental sounds. Results show that, in some conditions, adding a soundscape significantly improves the recognition of the simulated environment.
AB - We propose a system that affords real-time sound synthesis of footsteps on different materials. The system is based on microphones, which detect real footstep sounds from subjects, from which the ground reaction force (GRF) is estimated. Such GRF is used to control a sound synthesis engine based on physical models. Two experiments were conducted. In the first experiment, the ability of subjects to recognize the surface they were exposed to was assessed. In the second experiment, the sound synthesis engine was enhanced with environmental sounds. Results show that, in some conditions, adding a soundscape significantly improves the recognition of the simulated environment.
KW - sound and music computing
KW - walking
KW - soundscape
KW - sound synthesis
U2 - 10.1109/TVCG.2011.30
DO - 10.1109/TVCG.2011.30
M3 - Journal article
SN - 1077-2626
VL - 17
SP - 1234
EP - 1244
JO - I E E E Transactions on Visualization and Computer Graphics
JF - I E E E Transactions on Visualization and Computer Graphics
IS - 9
ER -