# How Google Automatically Groups Photos and Contextual Data into Moments > A method for automatically grouping photos from front and rear cameras with related data like audio, weather, and location to create a rich, interactive digital memory. - **Patent:** US 10318574 - **Original title:** Generating moments - **Owner:** Google LLC - **Granted:** 2019 - **Status:** Active - **Times cited:** 12 - **Field:** consumer_electronics, software, ai_ml ## What it does This patent describes a system that creates a 'moment' by bundling visual content with environmental data. Specifically, it captures images from two different camera lenses simultaneously—such as a front and rear camera—and pairs them with non-visual data like ambient audio, location, and even temperature readings derived from objects in the photos. Once this bundle is created, the system dynamically builds a user interface that adjusts its layout based on the types of content included. For example, if a moment contains both a photo and an audio file, the interface automatically launches both a photo viewer and an audio player to display them together. ## What it does NOT cover - Does not cover simple photo grouping based only on timestamps or location metadata. - Does not cover manual photo albums created by a user without automated sensor-based data collection. - Does not cover the hardware design of the camera lenses themselves, only the software method of processing their output. - Does not cover systems that lack the specific requirement of simultaneous capture from dual lenses on opposite sides of a device. ## The clever bit The system treats environmental data—like temperature or audio—as a first-class citizen alongside the image, using the image content itself to trigger the retrieval of this metadata, rather than just relying on standard EXIF tags. ## Real-world examples 1. Google Photos 'Memories' feature 2. Dual-camera 'Bothie' or 'Director's View' modes on modern smartphones 3. Automated digital scrapbooking apps ## Why it matters As smartphone storage grows, users struggle to organize thousands of disconnected files. This patent provides a framework for 'smart' organization, turning raw data into a narrative. It reflects the industry-wide shift toward AI-driven photo management seen in products like Google Photos, where the goal is to reduce user effort in curating digital memories. ## Frequently asked questions ### What does How Google Automatically Groups Photos and Contextual Data into Moments cover? A method for automatically grouping photos from front and rear cameras with related data like audio, weather, and location to create a rich, interactive digital memory. ### Who owns patent US 10318574? Google LLC owns this patent, granted in 2019. ### When does this patent expire? This patent is expected to expire on June 11, 2039, when the invention enters the public domain. ### What is patent US 10318574 cited by? This patent has been cited by 12 later patents that build on its ideas. ### What problem does this patent solve? As smartphone storage grows, users struggle to organize thousands of disconnected files. This patent provides a framework for 'smart' organization, turning raw data into a narrative. It reflects the industry-wide shift toward AI-driven photo management seen in products like Google Photos, where the goal is to reduce user effort in curating digital memories. ### What does this patent NOT cover? Does not cover simple photo grouping based only on timestamps or location metadata. **Full plain-English explainer:** https://patentbrief.org/patent/us/10318574/arkit **Original patent:** https://patents.google.com/patent/US10318574 --- _Source: PatentBrief — https://patentbrief.org. Patent facts are from public records; the plain-English explanation is PatentBrief's._ ## Related patents Semantically similar inventions in the PatentBrief corpus: - [How Computers Automatically Organize and Search Photos Using Contextual Data](https://patentbrief.org/patent/us/8862582/amazon-redshift) — A system for indexing images by attaching descriptive data to objects within them and adjusting search rankings based on how often a user searches for those specific items. - [Google's System for Auto-Searching Text on Your Device](https://patentbrief.org/patent/us/8990235/bing-image-search) — Google's 2015 patent describes a system that automatically finds and displays relevant information online based on text it detects on your device, even without you asking it to. - [How Social Networks Automatically Create Groups Based on Time and Place](https://patentbrief.org/patent/us/8843528/facebook-groups) — Google's patent describes a system that automatically groups social media users together based on where they are or when they are posting, allowing for instant, context-aware content sharing. - [How to Search Through Long Videos Using a Compressed Visual Timeline](https://patentbrief.org/patent/us/10311112/github-acquisition-integration) — A method for searching large collections of video or image data by condensing them into a single, scrollable visual strip that triggers automated searches as you move a slider. - [How Voice Commands Help Computers Find Objects in Pictures and Videos](https://patentbrief.org/patent/us/9098533/amazon-kinesis) — A method for using voice commands to tell a computer which object in a photo or video you want to search for, allowing it to automatically isolate that object and perform a visual search.