Tuesday, August 27, 2013

Tracking arbitrary 10-finger motion, robustness, latency improvements (v0.9.29)

This version marks the biggest improvement in both functionality and robustness since we released our single-camera DevKit in April. Today, we're announcing experimental support for arbitrary 10-finger hand-tracking. Here's a 30 second video illustrating what we mean by "arbitrary":

You can learn more about arbitrary 10-finger tracking mode in the installation notes included in the download.

There have also been a number of robustness improvements since v0.9.27. In particular, the hands are much better behaved when touching and when the hand occludes the arm. Furthermore, we are better at detecting when the left and right hands are swapped and will swap them back.

We've also made some significant gains in reducing latency. This started in v0.9.26, when we cut 50ms off of most example applications on the Mac, and continues in this version, where HandViewer is 20ms faster. Take a look at the responsiveness in this new recording of HandViewer, Heart Demo and Cricket Defender.

Lastly, we've added some convenience features. It's easier than ever to get started using the Heart Demo and Cricket Defender, which have a built-in 1-second hand calibration step now. We're also providing access to the raw depth data in the API.

This is all to say that you should really download our latest version here.

For existing users of our software, you'll need to re-sample your databases for this version. This probably means running "handcalibration.bat sample" from the GesturalUserInterface directory. Running "camerasetup.bat" to recalibrate the camera(s) should also do the trick.