Picturing Sound: an overview of its efficacy

This paper presents three case studies selected from a sample of teenage children (n = 11) having severe disabilities. Personalised audiovisual environments are created with a targeted goal to encourage interaction, creativity and artistic expression from the teenagers. The feedback stimulus is directly linked to the child’s gesticulations for a sense of associated control to be available for recognition. Non-intrusive sourcing of
gesture is through camera data mapped to computer vision algorithms. Intervention strategies from staff and helpers within such user-centred environments are questioned. Results point to the positive benefits for these children such as increased eye-to-hand coordination, concentration duration, and improved communication.
These findings corroborate with other research in being indicative of the potentials in utilising such interactive multi-sensory environments in special schools and institutes as a supplemental tool for traditional methods.