Depth Sensing 2

I got the depth tracking working somewhat well, you can see it in this video here.

One thing that tripped me up along the way was the mirroring of the images. When the kinect takes a video of you, it’s mirrored from your perspective. On the viewer window the image is flipped so that when you move your hand left, the hand on the screen moves left. When you try and use the flipped coordinates on the non-flipped image, it gives you the wrong value. Anyway I got that all sorted out and now it gets the depth at the right point.

Paint Program

I decided to make a paint program because that could use both the tracking element of the glove as well as the finger sensors. Moving your hand around would move the paintbrush around, and how many fingers you have extended would determine the brush size.

I haven’t had a chance to test it with the motion control yet, but here is a video using just the keyboard: https://youtu.be/eLRO5dDECAw