Google's System for Auto-Searching Text on Your Device

Google's 2015 patent describes a system that automatically finds and displays relevant information online based on text it detects on your device, even without you asking it to.

What it covers

This patent details a method where a device, like your phone, can automatically select a piece of text it receives or captures. It then uses that text to create a search query, choosing the best place (index) to look for answers. The device sends this query to other devices, gets back relevant information, and shows it to you. For example, if you capture text from a printed document using your phone's camera, the system can automatically identify the document and search for related content online, displaying it without you needing to manually copy, paste, or type anything into a search bar. Claim 1 outlines this core process of receiving text, selecting a portion without user interaction, forming a query, selecting an index, transmitting the query, and displaying results.

What it doesn't cover

• —Methods that require a user to actively select the text portion for searching.
• —Systems that do not automatically select an index to search from multiple options.
• —Processes where the device does not transmit the query to a second computing device.
• —Functionality that does not display information relevant to the query.
• —Searching only static, pre-defined content sources without dynamic or user-generated content.

The clever bit

The real innovation here is the automatic selection of text and the intelligent choice of search indexes without explicit user commands. This moves beyond simple copy-paste search to a system that anticipates user needs based on the information presented on the device.

Why it matters

This patent is a foundational piece for many smart features we use daily, particularly those involving contextual information discovery. It laid the groundwork for how devices can proactively offer relevant content, influencing the development of features like Google Lens and other context-aware search functionalities within Google's ecosystem.

Real-world examples

• 1.Google Lens
• 2.Google Search app's contextual features
• 3.Features that automatically provide links or information based on screen content