Finger Writing and Control with Leap Motion

  1.  Leap Motion can detect the hand, thumb, and index finger.

  2. Use the index finger to move the cursor around and the thumb for clicking

  3. In the writing mode, thumb up (with red overlay shown) to start writing and thumb down to end. Green overlay indicates recognition in progress, and the result is shown at the top left corner of the screen (also enlarged in the PIP).

  4. The recognition kernel in this video has a vocabulary of 1k words, but doesn’t include rejection yet.

  5. The recognizer can also be applied to gesture recognition.