Force dynamics as a design framework for mid-air musical interfaces

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

2 Citations (Scopus)
77 Downloads (Pure)

Abstract

In this paper we adopt the theory of force dynamics in human cognition as a fundamental design principle for the development of mid-air musical interfaces. We argue that this principle can provide more intuitive user experiences when the interface does not provide direct haptic feedback, such as interfaces made with various ges-ture-tracking technologies. Grounded in five concepts from the theoretical literature on force dynamics in musical cognition, the paper presents a set of principles for interaction design focused on five force schemas: Path restraint, Containment restraint, Counter-force, Attraction, and Compulsion. We design and describe an initial set of examples that implement these principles using a Leap Motion sensor for gesture tracking and SuperCollider for interactive audio design. Finally, the paper presents a pilot experiment that provides initial insight into how users experience their interaction with the interface, including ratings of the interface’s intuitiveness and ability to provide musical inspiration.

Original languageEnglish
Title of host publicationProceedings of the International Conference on New Interfaces for Musical Expression 2020
Number of pages6
Place of PublicationBirmingham City University
Publication date2020
Pages361-366
DOIs
Publication statusPublished - 2020
Event20th International Conference on New Interfaces for Musical Expression, NIME 2020 - Birmingham, United Kingdom
Duration: 21 Jul 202025 Jul 2020

Conference

Conference20th International Conference on New Interfaces for Musical Expression, NIME 2020
Country/TerritoryUnited Kingdom
CityBirmingham
Period21/07/202025/07/2020
SeriesProceedings of the International Conference on New Interfaces for Musical Expression
ISSN2220-4792

Bibliographical note

Publisher Copyright:
© 2020, Steering Committee of the International Conference on New Interfaces for Musical Expression. All rights reserved.

Keywords

  • Force dynamics
  • Gesture-based instruments
  • Image schemas
  • Leap Motion
  • Multimodality
  • SuperCollider

Fingerprint

Dive into the research topics of 'Force dynamics as a design framework for mid-air musical interfaces'. Together they form a unique fingerprint.

Cite this