p.i.d gestures (2009)
human-robot joint jazz improvisation
The world's first human-robot rendition of Duke Jordan's "Jordu", for human piano and robot marimba. Also, the stage debut of Shimon, Georgia Tech's new robotic marimba player. Using a novel gesture-based improvisation and motor control system, the robot listens to the human play and tries to match its beat, sync, and themes. It uses choreographic gestures to generate both motion and sound.