Abstract
In this paper we adopt the theory of force dynamics in human cognition as a fundamental design principle for the development of mid-air musical interfaces. We argue that this principle can provide more intuitive user experiences when the interface does not provide direct haptic feedback, such as interfaces made with various ges-ture-tracking technologies. Grounded in five concepts from the theoretical literature on force dynamics in musical cognition, the paper presents a set of principles for interaction design focused on five force schemas: Path restraint, Containment restraint, Counter-force, Attraction, and Compulsion. We design and describe an initial set of examples that implement these principles using a Leap Motion sensor for gesture tracking and SuperCollider for interactive audio design. Finally, the paper presents a pilot experiment that provides initial insight into how users experience their interaction with the interface, including ratings of the interface’s intuitiveness and ability to provide musical inspiration.
Original language | English |
---|---|
Title of host publication | Proceedings of the International Conference on New Interfaces for Musical Expression 2020 |
Number of pages | 6 |
Place of Publication | Birmingham City University |
Publication date | 2020 |
Pages | 361-366 |
DOIs | |
Publication status | Published - 2020 |
Event | 20th International Conference on New Interfaces for Musical Expression, NIME 2020 - Birmingham, United Kingdom Duration: 21 Jul 2020 → 25 Jul 2020 |
Conference
Conference | 20th International Conference on New Interfaces for Musical Expression, NIME 2020 |
---|---|
Country/Territory | United Kingdom |
City | Birmingham |
Period | 21/07/2020 → 25/07/2020 |
Series | Proceedings of the International Conference on New Interfaces for Musical Expression |
---|---|
ISSN | 2220-4792 |
Bibliographical note
Publisher Copyright:© 2020, Steering Committee of the International Conference on New Interfaces for Musical Expression. All rights reserved.
Keywords
- Force dynamics
- Gesture-based instruments
- Image schemas
- Leap Motion
- Multimodality
- SuperCollider