How Phones Sense Your Finger Hovering Without Touching the Screen

This patent describes a system for electronic devices, like phones, to detect a finger hovering just above the screen, display a specific interactive element below it, and then let you control that element with gestures without ever making contact.

What it covers

This patent describes an "I/O platform" (like a phone's screen and sensors) that can detect when a finger is very close to, but not actually touching, its surface (Claim 1). It figures out the finger's position above the screen. Based on what app is running, the system then picks a specific "graphical user interface element" (like a button or a scroll bar) to show on the screen, directly underneath where the finger is hovering. Importantly, the system chooses this element based on the app's context, not the exact spot (x,y coordinates) where the finger first appeared (Claim 1). Once the element appears, the system can then detect gestures, like a circular motion, performed by the finger hovering above that displayed element. For example, if you hover your finger, a "virtual scroll wheel" might appear, and you could rotate your finger above it to scroll (Claim 5). This detection can happen using light, electrical capacitance, or sound waves (Claim 7).

What it doesn't cover

• —It does not cover interactions where your finger directly touches the screen to provide input.
• —It does not cover selecting a graphical element based on the precise X and Y coordinates of your finger's initial hover position over the application.
• —It does not cover proximity detection systems that do not also determine the position of the hovering object.
• —It does not cover gestures performed before a specific graphical user interface element is displayed below the hovering finger.

The clever bit

The truly clever part is detecting a non-contacting finger, then dynamically deciding *which* interactive element to show based on the active application, displaying that element *under* the hovering finger, and then allowing a gesture to control it, all without physical touch. This allows for contextual interaction before a user even makes contact.

Why it matters

This patent was filed by Apple in 2005, before the original iPhone was released. It describes fundamental technology for how early smartphones could sense objects without direct touch, which was crucial for features like turning off the screen when you hold the phone to your ear during a call. It also laid groundwork for more advanced hover interactions, exploring how users could interact with a device's interface in a new way.

Real-world examples

• 1.Original iPhone proximity sensor turning off the screen during calls
• 2.Many modern smartphone lock screens that react to a hand waving over them (though often for simple wake-up, not complex gestures)
• 3.Some smart displays or smart speakers that detect a hand approaching to reveal controls