How Touchscreens Predict Where Your Finger Will Land Before You Touch

Apple's patent describes a touch controller that tracks an object's path through the air to predict where it will land on a screen before it actually makes physical contact.

What it covers

This technology uses proximity sensors to detect a finger or stylus while it is still approaching the screen, rather than waiting for physical contact. By calculating the trajectory of the object at a first distance, the processor generates a predicted touch location. As the object gets closer to a second distance, the system refines this prediction to determine the final identified touch location. This allows the device to pre-calculate which button or interface element the user intends to select, potentially speeding up responsiveness or improving accuracy in complex user interfaces.

What it doesn't cover

• —Does not cover touch detection that only triggers upon physical contact with the screen surface.
• —Does not cover systems that rely solely on the centroid of the object at the moment of contact without considering the approach trajectory.
• —Does not cover touchscreens that lack proximity-sensing capabilities to track objects before they land.

The clever bit

The system treats the 'approach' phase as data rather than noise, using the trajectory through space to disambiguate the final touch point before the physical event occurs.

Why it matters

This patent addresses the latency gap between human movement and digital response. By shifting from reactive sensing to predictive sensing, devices can feel more fluid and responsive. It is a key component in the ongoing effort to make touch interfaces feel like a natural extension of the user's hand.

Real-world examples

• 1.Apple Pencil hover features on iPad Pro
• 2.High-end smartphone touch controllers with proximity sensing
• 3.Advanced stylus input systems for digital art tablets