We are very excited to find out that The BBC Philharmonic Maestro has been nominated for a Webby and a Design Week award.
Conducting around our recording equipment
The interface uses a Microsoft Kinect to track the positions of the user's left and right arms with skeletal tracking. Microsoft have released an SDK which allows anyone to work with their skeletal tracking algorithms which is available here. The positions of the left and right arms are then converted into a beats per minute tempo (based on their lateral movement) and a left hand and right hand volume (based in the height of each hand).
Depth image and control data from the Kinect
An application was then built to control the audio and video playback. The application recieved the control data (tempo and volumes) from the Kinect and played back the recording of the orchestra's performance, altering the tempo and volume while keeping the audio and video in sync and maintaining the correct pitch.
The BBC Philharmonic Maestro was created with the help of MagneticNorth and it has been presented at two international conferences (here and here) and has been featured at two international arts festivals (here and here), not to mention the Webby and Design Week award nominations.
Getting the chance to conduct the BBC Philharmonic
We're up against some pretty touch competition for the Webby, but if you like the idea of the Maestro you are able to vote for it here.
Search by Tag:
- Tagged with BlogBlog
