01X: A Dynamic 3D Performance Space for Control of Virtual Musical Instruments

This work explores an intuitive, real-time music generation system and interface. We present a system that uses the real-time skeletal tracking provided by a Microsoft Kinect to generate complex musical compositions containing up to four tracks, with instruments represented in distinct physical spaces. The performer’s position and movements are translated into cues that are relayed to Ableton Live for music generation. Finally, we experiment with an interface overlayed in physical space to provide real-time feedback to the user.

This system is part of the 01x Project.

Collaborators

Andrew Hollenbach, Computer Science, Rochester Institute of Technology

Matthew Cox, Eastman School of Music

Publications

Cox, M., A. Hollenbach, and J. Geigel (2016). A Dynamic 3D Performance Space for Control of Virtual Musical Instruments (Demo). In: Proceedings of the 2016 ACM on Interactive Surfaces and Spaces. ISS ’16. Niagara Falls, Ontario, Canada: ACM, pp.477–480.

Hollenbach, A., M. Cox, and J. Geigel (2016). A Dynamic 3D Performance Space for Control of Virtual Musical Instruments. In: Proceedings of the 2016 ACM on Interactive Surfaces and Spaces. ISS ’16. Niagara Falls, Ontario, Canada: ACM, pp.279–285.

Presentations

Nov 6-9, 2016 -- ACM on Interactive Surfaces and Spaces, Niagara Falls, Canada

May 3, 2014 -- Sound ExChange: Interactive Music & Visual Art, ImagineRIT, Rochester Institute of Technology.

Links

Web page for the Kinect Instrument as part of the 01x Project.