Abstract
This research explores sensor-based interactive systems to determine requirements for an untraditional tool to support therapeutic intervention and learning.
Rather than concentrating on a specific physical disability, focus is on a means to stimulate a participant’s existing ability to articulate creatively and playfully. Through motivating interactions via empowering unfettered gesture control of responsive digital multimedia in recreational activities, e.g. video gaming, music making, painting, and robotics; a ‘whole-person benefit’ - including impairment - is targeted.
A bespoke infrared sensor-based system was the vehicle for the investigations. Examined variables include (a) participants across wide age ranges and spectrum of ability including profound multiple disabilities (PMD), cerebral palsy (CP), acquired brain injury (ABI), and typically developing (TD); (b) different test locations; and (c) contrasting sensor-based apparatus.
End-user access, inclusion, and participation in the ‘recreation-as- training/learning’ activities were augmented through using divergent mediums adapted to the participant’s profile. Gain in concentration, eye-to-hand contact and other self/social skills were amongst the reported PMD and CP benefits. Potentials within ABI were also positively evaluated, especially balance, body dynamics, and independence training. Despite the brevity of the study, the use of video games in various hospital contexts was also positive.
Results, and the research overall, signify the promise from using unencumbered gesture control of multimedia in this context. Benefits from regular use are hypothesized ranging from specific healthcare intervention, across various training/learning situations, to generic life quality. External expert evaluations substantiate these claims.
Despite the positive evaluations, limitations were identified in all the tested apparatus. This supported the determining of the requirements towards an optimal system solution. Thus, irrespective of the resultant patented product, it is concluded that a need still exists for an improved turnkey solution.
SoundScapes thus evolved from being product-centred into an open research platform upon which further ongoing multi/inter-disciplinary explorations are conducted.
Department: Faculty of Arts, Design and Media , Sunderland, UK
Advisor(s): Phil Ellis (now deceased)
Rather than concentrating on a specific physical disability, focus is on a means to stimulate a participant’s existing ability to articulate creatively and playfully. Through motivating interactions via empowering unfettered gesture control of responsive digital multimedia in recreational activities, e.g. video gaming, music making, painting, and robotics; a ‘whole-person benefit’ - including impairment - is targeted.
A bespoke infrared sensor-based system was the vehicle for the investigations. Examined variables include (a) participants across wide age ranges and spectrum of ability including profound multiple disabilities (PMD), cerebral palsy (CP), acquired brain injury (ABI), and typically developing (TD); (b) different test locations; and (c) contrasting sensor-based apparatus.
End-user access, inclusion, and participation in the ‘recreation-as- training/learning’ activities were augmented through using divergent mediums adapted to the participant’s profile. Gain in concentration, eye-to-hand contact and other self/social skills were amongst the reported PMD and CP benefits. Potentials within ABI were also positively evaluated, especially balance, body dynamics, and independence training. Despite the brevity of the study, the use of video games in various hospital contexts was also positive.
Results, and the research overall, signify the promise from using unencumbered gesture control of multimedia in this context. Benefits from regular use are hypothesized ranging from specific healthcare intervention, across various training/learning situations, to generic life quality. External expert evaluations substantiate these claims.
Despite the positive evaluations, limitations were identified in all the tested apparatus. This supported the determining of the requirements towards an optimal system solution. Thus, irrespective of the resultant patented product, it is concluded that a need still exists for an improved turnkey solution.
SoundScapes thus evolved from being product-centred into an open research platform upon which further ongoing multi/inter-disciplinary explorations are conducted.
Department: Faculty of Arts, Design and Media , Sunderland, UK
Advisor(s): Phil Ellis (now deceased)
| Original language | English |
|---|---|
| Publication date | 24 Sept 2021 |
| Place of Publication | Online |
| Publisher | Leonardo Electronic Almanac |
| Edition | LABS ID: 4247 |
| Volume | LABS ID: 4247 |
| Number of pages | 1 |
| Publication status | Published - 24 Sept 2021 |
Bibliographical note
The Leonardo Abstracts Service is an evolving, comprehensive database of thesis abstracts (PhD, Master's and MFA) on topics at the intersections between art, science and technology. This English-language database was established at Pomona College (Claremont, CA), under the direction of editor-in-chief Sheila Pinkel. Each year, in addition to being published in the database, a selection of abstracts chosen by a peer review panel for their special relevance are published in a digest on our website.The nine highest-ranking abstracts of 2021 will be published in Leonardo journal (see upcoming Vol. 55, No. 5, October 2022). We are pleased to present below the top-ranked thesis abstracts of 2021, and we congratulate the authors of the theses.
Highest-Rated Abstracts
Memo Akten, "Deep Visual Instruments: Realtime Continuous, Meaningful Human Control over Deep Neural Networks for Creative Expression"
Hassan Choubassi, "The Masses: From the implosion of fantasies to the explosion of the political"
Batool Desouky, "Programmoire: refiguring the archetype of the witch for a political agency in the technocapitalist present"
Julie Freeman, "Defining Data as an Art Material"
Rene Garcia Cepeda, "Curation and display of interactive new media art: making a manual"
Andrew Knight-Hill, "Interpreting Electroacoustic Audio-visual Music"
Lisa Korpos, "The Community Bee Clinic"
Rosemary Lee, "Machine Learning and Notions of the Image"
Lozana Mehandzhiyska, "Model–Database–Interface: A study of the redesign of the ArtBase, and the role of user agency in born-digital archives"
We also wish to acknowledge the following authors of notable abstracts: Marcilon Almeida de Melo, Alejandro Araque Mendoza, Najam-Ul Assar, Phil Barton, Anthony Brooks, Jo Burzynska, Haoran Chang, Alex Chechile, Chiao-chi Chou, Sean Clark, Daniela Elneff, Cameron Fraser, Megan Hines, Derek Holzer, Laura Hopes, You-Yang Hu, Jacqueline Knight, Charu Maithani, Alex McLean, Sam Meech, Clarissa Ribeiro, Michael Straeubig, Matej Vakula, Christine Veras, Graham Wakefield, Ashley Wong and Sheung You.
Keywords
- intersections between art, science and technology
- Empowered Creative Expression
- Personalised Interactive Installations
- Supplementing Traditional (Re)habilitation Intervention
- Sensors; Societal Impact of Art + Science + Technology
- Sensors; Societal Impact of Art + Science + Technology; Human WellBeing and Life Quality