Abstract
In this paper we adopt the theory of force dynamics in human cognition as a fundamental design principle for the development of mid-air musical interfaces. We argue that this principle can provide more intuitive user experiences when the interface does not provide direct haptic feedback – such as interfaces made with various gesture-tracking technologies. Grounded in five concepts from the theoretical literature on force dynamics in musical cognition, the paper presents a set of principles for interaction design focused on five force schemas: Path restraint, Containment restraint, Counter-force, Attraction, and Compulsion. We describe an initial set of examples that implement these principles using a Leap Motion sensor for gesture tracking and SuperCollider for interactive audio design. Finally, the paper presents a pilot experiment that provides initial ratings of intuitiveness in the user experience.
Original language | English |
---|---|
Title of host publication | Proceedings of the International Conference on New Interfaces for Musical Expression |
Number of pages | 6 |
Place of Publication | Birmingham City University |
Publication date | 2020 |
Pages | 361-366 |
Publication status | Published - 2020 |
Event | International Conference on New Interfaces for Musical Expression - Royal Birmingham Conservatoire, Birmingham City University, Birmingham, United Kingdom Duration: 21 Jul 2020 → 25 Jul 2020 Conference number: 2020 https://nime2020.bcu.ac.uk/ |
Conference
Conference | International Conference on New Interfaces for Musical Expression |
---|---|
Number | 2020 |
Location | Royal Birmingham Conservatoire, Birmingham City University |
Country/Territory | United Kingdom |
City | Birmingham |
Period | 21/07/2020 → 25/07/2020 |
Internet address |
Series | NIME Proceedings |
---|---|
ISSN | 2220-4806 |