Summary

In this chapter, we introduced the skeleton mapping technique in Kinect, and discussed how to get the positions of all the 20 joints in a human skeleton. Some of the positions are important for our successive developments; for example, the hand positions will be used to determine if a fruit is cut or not. Some more joint data will be used in the next chapter for emulating a multi-touch environment.

The new face tracking feature of the Microsoft Kinect SDK is also shown here with two easy-to-understand examples. The face tracking API can be used to calculate the position of a human head, as well as the mesh data composited from AUs and SUs. These two examples have nothing to do with the Fruit Ninja game in processing, but may be very useful for other kinds of AR-based applications and games.