Still, Moving: Designing for Kinesthetic Awareness

May 7, 2017 #Sonification #Design #Kinesthetic Awareness

Still, moving is an interactive sound installation focusing of designing for kinesthetic awareness. Using field recordings as rich source materials, the system generates a continuously evolving sound environment, in response to participants’ micro-movements and muscular activity. The interaction design leverages an adaptive mapping strategy, refining sensitivity depending on the level of activity. This dynamic adjustment provides users with a sonic ‘zoom’ into their kinesthetic experience. Still, moving has been exhibited as a public installation, and has been presented at the ACM CHI'17 conference in Denver, CO, USA.

Abstract

We consider kinesthetic awareness, the perception of our own body position and movement in space, as a critical value for embodied design within third wave HCI. We designed an interactive sound installation that supports kinesthetic awareness of a participant’s micro-movements. The installation’s interaction design uses continuous auditory feedback and leverages an adaptive mapping strategy, refining its sensitivity to increase sonic resolution at lower levels of movement activity. The installation uses field recordings as rich source materials to generate a sound environment that attunes to a participant’s micro-movements. Through a qualitative study using a second-person interview technique, we gained nuanced insights into the participants’ subjective experiences of the installation. These reveal consistent temporal patterns, as participants build on a gradual process of integration to increase the complexity and capacity of their kinesthetic awareness during interaction.

Overview of the Mapping Strategy

Video

Featured image