How Google Automatically Groups Photos and Contextual Data into Moments
A method for automatically grouping photos from front and rear cameras with related data like audio, weather, and location to create a rich, interactive digital memory.
Original patent title: “Generating moments”
A method for automatically grouping photos from front and rear cameras with related data like audio, weather, and location to create a rich, interactive digital memory. Granted to Google LLC in 2019 with 23 claims and 12 forward citations.
Key facts
Coverage
What does this patent actually cover?
This patent describes a system that creates a 'moment' by bundling visual content with environmental data. Specifically, it captures images from two different camera lenses simultaneously—such as a front and rear camera—and pairs them with non-visual data like ambient audio, location, and even temperature readings derived from objects in the photos. Once this bundle is created, the system dynamically builds a user interface that adjusts its layout based on the types of content included. For example, if a moment contains both a photo and an audio file, the interface automatically launches both a photo viewer and an audio player to display them together.
The gap
What does this patent NOT cover?
- Does not cover simple photo grouping based only on timestamps or location metadata.
- Does not cover manual photo albums created by a user without automated sensor-based data collection.
- Does not cover the hardware design of the camera lenses themselves, only the software method of processing their output.
- Does not cover systems that lack the specific requirement of simultaneous capture from dual lenses on opposite sides of a device.
These exclusions are unique to PatentBrief — derived from the actual claim language, not patent-office boilerplate.
What made this novel
The system treats environmental data—like temperature or audio—as a first-class citizen alongside the image, using the image content itself to trigger the retrieval of this metadata, rather than just relying on standard EXIF tags.
Schematic visualization of the patent's claim structure. Hand-drawn diagrams in progress for each landmark patent.
Where you've seen this
Real-world examples
Google Photos 'Memories' feature
Dual-camera 'Bothie' or 'Director's View' modes on modern smartphones
Automated digital scrapbooking apps
Why it matters
The bigger picture
As smartphone storage grows, users struggle to organize thousands of disconnected files. This patent provides a framework for 'smart' organization, turning raw data into a narrative. It reflects the industry-wide shift toward AI-driven photo management seen in products like Google Photos, where the goal is to reduce user effort in curating digital memories.
Filed
March 16, 2015
Granted
June 11, 2019
Market context
Who's building on this
Companies in this space
Google is the primary entity building on this technology within its Google Photos ecosystem. Other major mobile OS developers, including Apple and Samsung, utilize similar automated grouping logic for their respective 'Photos' applications, though their specific implementations of dual-lens data fusion may differ.
Market impact
This patent supports the transition of photo galleries from static storage folders into intelligent, context-aware storytelling platforms. It has helped standardize the expectation that mobile devices should automatically curate and present media based on environmental context rather than just chronological order.
Claim 1 — Plain English
What this patent covers
This patent describes a system that creates a 'moment' by bundling visual content with environmental data. Specifically, it captures images from two different camera lenses simultaneously—such as a front and rear camera—and pairs them with non-visual data like ambient audio, location, and even temperature readings derived from objects in the photos. Once this bundle is created, the system dynamically builds a user interface that adjusts its layout based on the types of content included. For example, if a moment contains both a photo and an audio file, the interface automatically launches both a photo viewer and an audio player to display them together.
The clever bit
The system treats environmental data—like temperature or audio—as a first-class citizen alongside the image, using the image content itself to trigger the retrieval of this metadata, rather than just relying on standard EXIF tags.
What it does not cover
- Does not cover simple photo grouping based only on timestamps or location metadata.
- Does not cover manual photo albums created by a user without automated sensor-based data collection.
- Does not cover the hardware design of the camera lenses themselves, only the software method of processing their output.
- Does not cover systems that lack the specific requirement of simultaneous capture from dual lenses on opposite sides of a device.
Patent timeline
Application submitted to the patent office
Application published, typically 18 months after filing
Patent officially issued
PatentBrief Score
Impact Score
Strong
Citation count
22/40
Moderately cited
Claim breadth
15/20
Broad claimsclaimsThe numbered statements at the end of a patent that legally define what the inventor owns.Read more →
Recency
10/20
Granted 5–10 years ago
Assignee scale
20/20
Major company or institution
PatentBrief Impact Score — based on citation count, claim breadth, recency, and assignee scale. Not a legal assessment.
Heuristic Value Estimate
What this patent might be worth
$100K – $319K
Midpoint $200K · 8.7 yr remaining · industry ×1.6
Heuristic only — blends forward/backward citation counts, claim scope, time remaining, litigation history, and CPC-derived industry baseline. Real valuations need a professional appraisal.
The original legal language
Original claims
23 claims as filed with the patent office.
Concepts involved
Citations
Patent lineage
Cite this patent
Bonechi, M., & Lauritzen, C. (2019). How Google Automatically Groups Photos and Contextual Data into Moments (U.S. Patent No. 10,318,574). U.S. Patent and Trademark Office. https://patentbrief.org/patent/us/10318574/arkit
Auto-generated from the patent record. Double-check author order and the issue date against the official USPTO document before submitting.
Embed
Add this patent to your site
Drop this plain-English patent card into any blog post or article — free, no signup. It always links back to the full breakdown here.
<div data-patentlens-widget data-patent-number="US10318574"></div> <script src="https://patentbrief.org/embed.js" async></script>
Stay in the loop
Get a weekly digest of new patents.
One email per week. No spam. Unsubscribe anytime.
Keep exploring
Related patents you should know
US 4683195 · 1987
How to Make Billions of Copies of a DNA Segment
This patent describes the Polymerase Chain Reaction (PCR), a method to rapidly create many copies of a specific piece of DNA or RNA, enabling its detection and analysis.
Cetus Corp
US 8697359 · 2014
How to Edit Genes in Human Cells Using an Engineered CRISPR System
This patent describes an engineered CRISPR-Cas9 system for precisely cutting DNA in eukaryotic cells to change how genes work, opening the door for gene editing in complex organisms.
Massachusetts Institute of Technology
US 7657849 · 2010
How the iPhone's Slide-to-Unlock Gesture Works
Apple's 2010 patent describes unlocking a device by dragging a specific graphical image across the touchscreen along a predefined path, a gesture that became iconic with the original iPhone.
Apple Inc
US 4733665 · 1988
How Doctors Implant a Permanent Stent Using a Balloon
This patent describes the method for placing a permanent, expandable wire mesh tube inside a blood vessel or other body tube using a balloon-tipped catheter to widen it and keep it open.
Expandable Grafts Partnership
US 4965188 · 1990
How to Make Many Copies of a DNA Piece with Heat
This patent describes the Polymerase Chain Reaction (PCR) method, a technique to make millions of copies of a specific DNA segment using a heat-resistant enzyme and repeated temperature changes.
Cetus Corp
US 4235871 · 1980
How to Encapsulate Active Materials in Lipid Bubbles Efficiently
This patent describes a method for trapping biologically active substances inside tiny, multi-layered fat bubbles called liposomes, using a specific water-in-oil emulsion and gel-forming process to improve how much material gets captured.
Individual
More to explore
More in Consumer Electronics
US 7657849 · 2010 · Apple Inc
How the iPhone's Slide-to-Unlock Gesture Works
US 7479949 · 2009 · Apple Inc
How Touchscreens Understand Your Finger Swipes and Scrolls
US 4528643 · 1985 · FPDC Inc
How Stores Make Custom Products On-Demand with Remote Approval
US 7469381 · 2008 · Apple Inc
How Touchscreens Show and Snap Back When You Scroll Past an Edge
New to patents?
Common Questions
Frequently Asked Questions
What does How Google Automatically Groups Photos and Contextual Data into Moments cover?
A method for automatically grouping photos from front and rear cameras with related data like audio, weather, and location to create a rich, interactive digital memory.
Who owns patent US 10318574?
Google LLC owns this patent, granted in 2019.
When does this patent expire?
This patent is expected to expire on June 11, 2039, when the invention enters the public domain.
What is patent US 10318574 cited by?
This patent has been cited by 12 later patents that build on its ideas.
What problem does this patent solve?
As smartphone storage grows, users struggle to organize thousands of disconnected files. This patent provides a framework for 'smart' organization, turning raw data into a narrative. It reflects the industry-wide shift toward AI-driven photo management seen in products like Google Photos, where the goal is to reduce user effort in curating digital memories.
What does this patent NOT cover?
Does not cover simple photo grouping based only on timestamps or location metadata.
Same assignee
More from Google LLC
Patent monitoring