Approach
Music and sound computing
Touch interfaces
Data
Questionnaire
Quantitative analysis
Qualitative analysis
Period
2020
A Survey
on the Use of 2D Touch Interfaces for Musical Expression
Expressive 2D multi-touch interfaces have in recent years moved from research prototypes to industrial products, from repurposed generic computer input devices to controllers specially designed for musical expression. A host of practitioners use this type of devices in many different ways, with different gestures and sound synthesis or transformation methods. In order to get an overview of existing and desired usages, we launched an online survey that collected 37 answers from practitioners in and outside of academic and design communities. In the survey we inquired about the participants’ devices, their strengths and weaknesses, the layout of control dimensions, the used gestures and mappings, the synthesis software or hardware, and the use of audio descriptors and machine learning. The results can inform the design of future interfaces, gesture analysis and mapping, and give directions for the need and use of machine learning for user adaptation.
The figure below shows examples of commercial devices used by the participants. From top left to bottom right: Kaoss Pad, Continuum, Touché, Soundplane, Lightpad Block, Morph, Linnstrument and Joué.
Publication
Diemo Schwarz, Wanyu Liu, and Frédéric Bevilacqua. "A Survey on the Use of 2D Touch Interfaces for Musical Expression." 2020. In New Interfaces for Musical Expression (NIME).