How Multiple Graphics Cards Keep Their Memory Caches Updated
This patent describes methods for keeping the specialized memory caches of multiple graphics processing units (GPUs) consistent and up-to-date when they work together in a computer system.
Original patent title: “Systems and methods for updating memory side caches in a multi-GPU configuration”
This patent describes methods for keeping the specialized memory caches of multiple graphics processing units (GPUs) consistent and up-to-date when they work together in a computer system. Granted in 2026.
Coverage
What does this patent actually cover?
This patent details a system for managing memory in computers with multiple graphics processing units (GPUs), often called a 'multi-tile architecture.' Each GPU has its own main memory, a fast 'memory side cache,' and a 'memory management unit' (MMU). These GPUs communicate through a 'communication fabric.' The core mechanism is that one GPU's MMU (e.g., the first MMU) is not only responsible for its own memory and cache updates but also determines if the 'memory side cache' of another GPU (e.g., the second memory side cache) needs to be updated. For example, if a high-performance computer uses two GPUs to render a complex scene, and one GPU updates a texture, its MMU checks if the other GPU's cache holds an outdated version of that texture and, if so, instructs it to refresh.
The gap
What does this patent NOT cover?
- Does not cover systems with only a single graphics processing unit (GPU).
- Does not cover systems where a central processing unit (CPU) or other non-GPU component solely manages cross-GPU cache coherence.
- Does not cover multi-GPU systems that do not employ 'memory side caches' as described.
- Does not cover systems where each GPU's cache is updated entirely independently without coordination from another GPU's MMU.
- Does not cover multi-GPU setups that lack a 'communication fabric' for direct GPU-to-GPU data exchange.
These exclusions are unique to PatentBrief — derived from the actual claim language, not patent-office boilerplate.
Key facts
What made this novel
The clever part is having one GPU's Memory Management Unit (MMU) intelligently decide if another GPU's memory side cache needs updating. This allows for efficient data consistency across multiple graphics cards without constant, broad invalidations, improving overall system performance.
Schematic visualization of the patent's claim structure. Hand-drawn diagrams in progress for each landmark patent.
Where you've seen this
Real-world examples
AI training servers
Professional graphics workstations
High-performance computing clusters
Data centers with GPU accelerators
Why it matters
The bigger picture
This technology is important for high-performance computing, especially in fields like artificial intelligence training and professional graphics. When multiple GPUs work together on large datasets, ensuring all their memory caches are consistent and up-to-date is critical. This approach helps prevent data errors and performance bottlenecks, allowing complex tasks to run more efficiently and reliably across powerful computing systems.
Filed
November 21, 2023
Granted
September 15, 2026
Market context
Who's building on this
Companies in this space
Major GPU manufacturers like NVIDIA, AMD, and Intel are continuously developing multi-GPU and multi-tile architectures. NVIDIA's NVLink and AMD's Infinity Fabric are examples of communication fabrics that enable such systems. Cloud providers such as AWS, Google Cloud, and Microsoft Azure heavily rely on these advanced GPU configurations for their AI and high-performance computing services.
Market impact
This type of technology significantly enhances the scalability and efficiency of multi-GPU systems, which are essential for accelerating demanding applications like AI training, scientific simulations, and high-fidelity rendering. It enables more complex workloads to be distributed across multiple graphics cards, preventing data inconsistencies and improving overall system performance in critical computing sectors.
Claim 1 — Plain English
What this patent covers
This patent details a system for managing memory in computers with multiple graphics processing units (GPUs), often called a 'multi-tile architecture.' Each GPU has its own main memory, a fast 'memory side cache,' and a 'memory management unit' (MMU). These GPUs communicate through a 'communication fabric.' The core mechanism is that one GPU's MMU (e.g., the first MMU) is not only responsible for its own memory and cache updates but also determines if the 'memory side cache' of another GPU (e.g., the second memory side cache) needs to be updated. For example, if a high-performance computer uses two GPUs to render a complex scene, and one GPU updates a texture, its MMU checks if the other GPU's cache holds an outdated version of that texture and, if so, instructs it to refresh.
The clever bit
The clever part is having one GPU's Memory Management Unit (MMU) intelligently decide if another GPU's memory side cache needs updating. This allows for efficient data consistency across multiple graphics cards without constant, broad invalidations, improving overall system performance.
What it does not cover
- Does not cover systems with only a single graphics processing unit (GPU).
- Does not cover systems where a central processing unit (CPU) or other non-GPU component solely manages cross-GPU cache coherence.
- Does not cover multi-GPU systems that do not employ 'memory side caches' as described.
- Does not cover systems where each GPU's cache is updated entirely independently without coordination from another GPU's MMU.
- Does not cover multi-GPU setups that lack a 'communication fabric' for direct GPU-to-GPU data exchange.
Patent timeline
Application submitted to the patent office
Patent officially issued
PatentBrief Score
Impact Score
Early stage
Citation count
0/40
No citations yet
Claim breadth
0/20
Narrow claimsclaimsThe numbered statements at the end of a patent that legally define what the inventor owns.Read more →
Recency
20/20
Granted within 5 years
Assignee scale
0/20
Independent or smaller assigneeassigneeThe entity that owns the patent — usually the inventor's employer or a company.Read more →
PatentBrief Impact Score — based on citation count, claim breadth, recency, and assignee scale. Not a legal assessment.
Heuristic Value Estimate
What this patent might be worth
$19K – $61K
Midpoint $38K · 17.1 yr remaining · industry ×1.6
Heuristic only — blends forward/backward citation counts, claim scope, time remaining, litigation history, and CPC-derived industry baseline. Real valuations need a professional appraisal.
Claim text not yet imported for this patent
Concepts involved
Cite this patent
(2026). How Multiple Graphics Cards Keep Their Memory Caches Updated (U.S. Patent No. 12,737,317). U.S. Patent and Trademark Office. https://patentbrief.org/patent/us/12737317/systems-and-methods-for-updating-memory-side-caches-in-a-multi-gpu-configuration
Auto-generated from the patent record. Double-check author order and the issue date against the official USPTO document before submitting.
Embed
Add this patent to your site
Drop this plain-English patent card into any blog post or article — free, no signup. It always links back to the full breakdown here.
<div data-patentlens-widget data-patent-number="US12737317"></div> <script src="https://patentbrief.org/embed.js" async></script>
Stay in the loop
Get a weekly digest of new patents.
One email per week. No spam. Unsubscribe anytime.
Keep exploring
Related patents you should know
US 4683195 · 1987
How to Make Billions of Copies of a DNA Segment
This patent describes the Polymerase Chain Reaction (PCR), a method to rapidly create many copies of a specific piece of DNA or RNA, enabling its detection and analysis.
Cetus Corp
US 8697359 · 2014
How to Edit Genes in Human Cells Using an Engineered CRISPR System
This patent describes an engineered CRISPR-Cas9 system for precisely cutting DNA in eukaryotic cells to change how genes work, opening the door for gene editing in complex organisms.
Massachusetts Institute of Technology
US 7657849 · 2010
How the iPhone's Slide-to-Unlock Gesture Works
Apple's 2010 patent describes unlocking a device by dragging a specific graphical image across the touchscreen along a predefined path, a gesture that became iconic with the original iPhone.
Apple Inc
US 4733665 · 1988
How Doctors Implant a Permanent Stent Using a Balloon
This patent describes the method for placing a permanent, expandable wire mesh tube inside a blood vessel or other body tube using a balloon-tipped catheter to widen it and keep it open.
Expandable Grafts Partnership
US 4965188 · 1990
How to Make Many Copies of a DNA Piece with Heat
This patent describes the Polymerase Chain Reaction (PCR) method, a technique to make millions of copies of a specific DNA segment using a heat-resistant enzyme and repeated temperature changes.
Cetus Corp
US 4235871 · 1980
How to Encapsulate Active Materials in Lipid Bubbles Efficiently
This patent describes a method for trapping biologically active substances inside tiny, multi-layered fat bubbles called liposomes, using a specific water-in-oil emulsion and gel-forming process to improve how much material gets captured.
Individual
More to explore
More in Consumer Electronics
US 7657849 · 2010 · Apple Inc
How the iPhone's Slide-to-Unlock Gesture Works
US 7479949 · 2009 · Apple Inc
How Touchscreens Understand Your Finger Swipes and Scrolls
US 4528643 · 1985 · FPDC Inc
How Stores Make Custom Products On-Demand with Remote Approval
US 7469381 · 2008 · Apple Inc
How Touchscreens Show and Snap Back When You Scroll Past an Edge
New to patents?
Common Questions
Frequently Asked Questions
What does How Multiple Graphics Cards Keep Their Memory Caches Updated cover?
This patent describes methods for keeping the specialized memory caches of multiple graphics processing units (GPUs) consistent and up-to-date when they work together in a computer system.
When does this patent expire?
This patent is expected to expire on September 15, 2046, when the invention enters the public domain.
What problem does this patent solve?
This technology is important for high-performance computing, especially in fields like artificial intelligence training and professional graphics. When multiple GPUs work together on large datasets, ensuring all their memory caches are consistent and up-to-date is critical. This approach helps prevent data errors and performance bottlenecks, allowing complex tasks to run more efficiently and reliably across powerful computing systems.
What does this patent NOT cover?
Does not cover systems with only a single graphics processing unit (GPU).
Patent monitoring