The Quantified Artist: Biometric Augmented Reality
Biometric, motion, and audio sensing can digitally augment live music to enhance the audience experience and deliver more entertainment value while generating new interest in and preserving the positive cultural impact of the performing arts. This session introduces the "Gigitizer" concept bringing an array of multimedia capture, analysis, and visualization to provide a quantified "digital backstage" view of live classical wind and string instrumental chamber music rigged up with emerging hardware such as the Hexoskin wearable vest for artist biometrics and Kinect 2 motion sensor for physical movement along with real-time pitch and rhythm tracking. "Small Data" science, interaction design, and creative technology topics will be explored in depth while opening up the hood on raw sensor processing, networking, and data visualization techniques in the context of an immersive augmented reality concert experience.
Exec Technology Dir
Executive Technology Director at frog leading its design technology practice and award-winning and critically-acclaimed classical clarinetist.