Gesture And Embodied Metaphor In Spatial Music Performance Systems Design.
This paper describes the theoretical underpinnings, design, and development of a hyper--instrumental performance system driven by gestural data obtained from an electric guitar. The system combines a multichannel audio feed from the guitar (which is parsed for its pitch, spectral content and note inter--onset time data to provide abstractions of sounded performance gestures) with motion tracking of the performer's larger--scale bodily movements using a Microsoft Xbox Kinect sensor. These gestural materials are used to provide the basis for the structures of relational mappings, informed by the embodied image schema structures of Lakoff and Johnson. These theoretical perspectives are refined via larger-scale ecological-embodied structural relationships in electroacoustic music outlined in Smalley's theory of spectromorphology, alongside the incorporation of an additional active-agential…