Today I'm trying to take it to the next level. Here's my version of such an interface that focuses on videos. It lets you place (predefined) videos in 3D space on top of the RGB image captured by the Kinect. A simple gesture lets you time-shift the video and another closes the video.
Written in c# using Kinect, OpenNI and WPF4 (this is the very first version and there's a lot to improve...)
These are the input gestures that are currently working
- Defining a video space with 4 fingers (2 on each hand) starts a new video inside that space
- Opening the right hand while pointing at a video with one finger of the left hand closes the video
- Opening the left hand puts the video into time-shift mode. Moving the right finger on the x-axis forwards or rewinds the video
The source code for the video manipulation is not online yet. The hand and finger detection can be downloaded from CodePlex: http://candescentnui.codeplex.com