# Detecting Touches Using Thermal Cameras for Computer Input

> This patent describes how a thermal camera can detect when two objects, like a finger and a table, touch by sensing a specific temperature pattern, then uses that touch as a way to control a computer.

- **Patent:** US 11797132
- **Original title:** Method and device for detecting a touch between a first object and a second object
- **Owner:** Apple
- **Granted:** 2023
- **Status:** Active
- **Times cited:** 0
- **Field:** consumer_electronics, software, telecommunications, ai_ml, augmented_reality

## What it does

This system uses a thermographic camera, a display, and processors to detect touches. It receives a thermal image of a first object (like a user's hand) and a second object (like a surface). A touch is detected when a specific "group of pixels" in the thermal image shows a temperature within a "predetermined temperature range" where the objects meet, and this group of pixels also satisfies a "predetermined size" (Claim 1). The system then determines the exact "position associated with the touch" relative to the display, often using a calibration between the camera and display (Claim 1, Claim 2). This position is then used to "provide user input," for example, to manipulate "virtual information" displayed to the user (Claim 1, Claim 7). For instance, if a user touches a projected virtual button on a wall, the thermal camera detects the heat signature of the finger, identifies its location, and registers it as a button press.

## What it does NOT cover

- Does not cover touch detection methods that do not rely on thermal imaging, such as those using visible light or capacitance.
- Does not cover systems that detect an object without a distinct temperature signature from the surface it touches.
- Does not cover detecting a touch if the thermal signature does not form a 'group of pixels' of a 'predetermined size'.
- Does not cover general object detection without the specific intent of providing user input.
- Does not cover touch detection solely based on changes in visible light or electrical properties.

## The clever bit

The novelty lies in using the distinct thermal signature of a touch, specifically a group of pixels within a temperature range and size, to accurately detect and localize user input on various surfaces, rather than relying on physical screen properties.

## Real-world examples

1. Augmented reality interfaces
2. Projected virtual keyboards
3. Interactive displays on non-conductive materials
4. Control panels in extreme temperature environments
5. Smart home devices with invisible interfaces

## Why it matters

This technology could enable new ways to interact with computers, especially in augmented reality or environments where traditional touchscreens are impractical. It allows for touch input on almost any surface by projecting interfaces, expanding beyond physical screens. This opens possibilities for more seamless integration of digital information with the physical world.

## Frequently asked questions

### What does Detecting Touches Using Thermal Cameras for Computer Input cover?

This patent describes how a thermal camera can detect when two objects, like a finger and a table, touch by sensing a specific temperature pattern, then uses that touch as a way to control a computer.

### Who owns patent US 11797132?

Apple owns this patent, granted in 2023.

### When does this patent expire?

This patent is expected to expire on December 23, 2040, when the invention enters the public domain.

### What problem does this patent solve?

This technology could enable new ways to interact with computers, especially in augmented reality or environments where traditional touchscreens are impractical. It allows for touch input on almost any surface by projecting interfaces, expanding beyond physical screens. This opens possibilities for more seamless integration of digital information with the physical world.

### What does this patent NOT cover?

Does not cover touch detection methods that do not rely on thermal imaging, such as those using visible light or capacitance.

**Full plain-English explainer:** https://patentbrief.org/patent/us/11797132/method-and-device-for-detecting-a-touch-between-a-first-object-and-a-second-obje-11797132

**Original patent:** https://patents.google.com/patent/US11797132

---

_Source: PatentBrief — https://patentbrief.org. Patent facts are from public records; the plain-English explanation is PatentBrief's._


## Related patents

Semantically similar inventions in the PatentBrief corpus:

- [How Devices Detect Touch Using Heat Signatures](https://patentbrief.org/patent/us/20210117042/method-and-device-for-detecting-a-touch-between-a-first-object-and-a-second-obje) — This patent describes a system that uses a thermal camera to detect when two objects, like a finger and a screen, touch by looking for a specific temperature change at their contact point.
- [How Computers Understand Hand Movements in the Air](https://patentbrief.org/patent/us/12737050/user-interfaces-for-gesture-detection) — This patent describes a computer system that recognizes hand movements in the air, called air gestures, to control different operations without needing to touch a screen or device.
- [Using Different Light Colors to Detect Touches on Screens](https://patentbrief.org/patent/us/20110234542/methods-and-systems-utilizing-multiple-wavelengths-for-position-detection) — This 2011 patent describes a system that uses two different colors of light to accurately detect where an object, like a finger, touches a screen or surface.
- [System for Controlling a Computer Using Hand Images](https://patentbrief.org/patent/us/9317130/visual-feedback-by-identifying-anatomical-features-of-a-hand) — This 2016 patent describes a system that uses a camera under a transparent surface to track a user's hand and display corresponding cursors on a screen, allowing hand gestures to control a computer interface.
- [How Optical Sensors Find Multiple Touches on a Screen](https://patentbrief.org/patent/us/20110205189/stereo-optical-sensors-for-resolving-multi-touch-in-a-touch-detection-system) — This patent describes a system that uses at least two pairs of light sensors and clever math to accurately figure out where multiple fingers are touching a screen, even when shadows overlap.
