Detecting Touches Using Thermal Cameras for Computer Input

This patent describes how a thermal camera can detect when two objects, like a finger and a table, touch by sensing a specific temperature pattern, then uses that touch as a way to control a computer.

What it covers

This system uses a thermographic camera, a display, and processors to detect touches. It receives a thermal image of a first object (like a user's hand) and a second object (like a surface). A touch is detected when a specific "group of pixels" in the thermal image shows a temperature within a "predetermined temperature range" where the objects meet, and this group of pixels also satisfies a "predetermined size" (Claim 1). The system then determines the exact "position associated with the touch" relative to the display, often using a calibration between the camera and display (Claim 1, Claim 2). This position is then used to "provide user input," for example, to manipulate "virtual information" displayed to the user (Claim 1, Claim 7). For instance, if a user touches a projected virtual button on a wall, the thermal camera detects the heat signature of the finger, identifies its location, and registers it as a button press.

What it doesn't cover

• —Does not cover touch detection methods that do not rely on thermal imaging, such as those using visible light or capacitance.
• —Does not cover systems that detect an object without a distinct temperature signature from the surface it touches.
• —Does not cover detecting a touch if the thermal signature does not form a 'group of pixels' of a 'predetermined size'.
• —Does not cover general object detection without the specific intent of providing user input.
• —Does not cover touch detection solely based on changes in visible light or electrical properties.

The clever bit

The novelty lies in using the distinct thermal signature of a touch, specifically a group of pixels within a temperature range and size, to accurately detect and localize user input on various surfaces, rather than relying on physical screen properties.

Why it matters

This technology could enable new ways to interact with computers, especially in augmented reality or environments where traditional touchscreens are impractical. It allows for touch input on almost any surface by projecting interfaces, expanding beyond physical screens. This opens possibilities for more seamless integration of digital information with the physical world.

Real-world examples

• 1.Augmented reality interfaces
• 2.Projected virtual keyboards
• 3.Interactive displays on non-conductive materials
• 4.Control panels in extreme temperature environments
• 5.Smart home devices with invisible interfaces