System for Controlling a Computer Using Hand Images

This 2016 patent describes a system that uses a camera under a transparent surface to track a user's hand and display corresponding cursors on a screen, allowing hand gestures to control a computer interface.

What it covers

This patent details a system that lets you control a computer with your hand. It uses a transparent surface, like a special pad, with a camera underneath. When you place your hand near or on this surface, the camera captures an image of your hand. A processor then identifies specific parts of your hand, like your fingertips or knuckles, and figures out their exact position relative to the surface. These positions are then translated into cursor movements on your computer screen, allowing you to interact with windows and other interface elements. For example, if you move your index finger, a cursor representing that finger moves on the screen in sync with your hand's movement.

What it doesn't cover

• —Systems that do not use a transparent input surface to capture the hand image.
• —Methods that do not identify specific anatomical features of the hand.
• —Systems where the hand image is not captured through the input element.
• —Interfaces that do not display cursors corresponding to identified hand features.
• —Systems that do not provide visual feedback on a display.

The clever bit

The innovation lies in using a transparent input surface with an underlying camera to capture detailed hand images, then mapping specific anatomical features of the hand to cursor positions on a separate display, creating a direct visual link between hand and cursor.

Why it matters

This patent explores an early approach to gesture-based computer interaction, predating widespread adoption of touchscreens and advanced motion sensing. It represents a conceptual step towards more intuitive human-computer interfaces where physical hand movements directly translate to on-screen actions.

Real-world examples

• 1.Early gesture control systems
• 2.Specialized input devices for design or control