Diego Mendoza-Halliday: iCub Robot Plays the Piano

Flash and JavaScript are required for this feature.

Download the video from Internet Archive.

Description: Diego Mendoza-Halliday programs the humanoid iCub robot to transform the sound of musical notes into motor commands to the iCub’s agile fingers, enabling it to play the “Happy Birthday” song on a mock piano keyboard.

Speaker: Diego Mendoza-Halliday

[THEME MUSIC]

DIEGO MENDOZA HALLIDAY: The purpose of this project was to have the iCub robot play a tune in the piano, replicating something that it heard. So what I will be doing is, I will be playing a melody in the piano here. And the iCub is supposed to hear the melody and through an auditory system extract information about the sound regarding the melody's notes and the timing of the notes. And then produce motor commands, that in his keyboard, will replicate the tune that I play. So here we go.

[PLAYS SEQUENCE OF NOTES]

[ROBOT PLAYS SAME SEQUENCE OF NOTES]

Hey, hey! Happy birthday.