A Lightweight Framework for Melodic Information Encoding and Realtime Reproduction for Interactive Sonification Applications

The use of music in interactive sonification applications is a promising alternative to the simple and often aesthetically unappealing sonic textures used in a considerable proportion of designs. Using synthesized music can be advantageous over pre-recorded music, as the system may exert complete control over individual sonic elements to yield sonically diverse and engaging interactions. The real-time generation of interesting, user-tailored music in an auditory display is a complex process but may be significantly streamlined. The proposed demo showcases a twofold system for rapid and lightweight encoding of polyphonic musical information as well as real-time reproduction of this
data format in the user’s choice of sonic textures. The system was originally designed for use in a gait sonification system in neurorehabilitation, but may be adapted for multiple data types.