# Making Computer Caches Faster with Dynamic Overfetching

> This patent describes a method for computer processors to speed up by intelligently fetching more data than immediately needed into a temporary storage area called a cache, especially when requested data isn't found.

- **Patent:** US 12737318
- **Original title:** Cache structure and utilization
- **Granted:** 2026
- **Status:** Active
- **Times cited:** 0
- **Field:** consumer_electronics, semiconductors, software, gaming, telecommunications

## What it does

This technology improves how computers handle data by making their temporary storage, known as a cache, more efficient. When a processor, including a graphics processor, asks for data that isn't immediately available in the cache (a 'cache miss'), the system doesn't just fetch the requested data from the main memory. Instead, it 'overfetches' additional data, pulling in extra 'cache lines' up to a 'current overfetch boundary.' This means the computer proactively loads data it thinks will be needed next, reducing future delays. For example, if a game needs a specific texture, the system might grab that texture plus nearby textures into the cache, anticipating the game will use them soon.

## What it does NOT cover

- Does not cover prefetching data without considering a dynamic overfetch boundary.
- Does not cover cache optimization techniques that do not involve overfetching data upon a cache miss.
- Does not cover systems that only fetch the exact requested data without additional cache lines.
- Does not cover static prefetching where the amount of extra data fetched is fixed and not dynamically adjusted.

## The clever bit

The novelty lies in 'dynamic overfetching' where the amount of extra data pulled into the cache isn't fixed but extends to a 'current overfetch boundary.' This allows the system to adapt how much data it prefetches based on real-time needs, making the prefetching more intelligent and efficient than simply grabbing a fixed amount of extra data.

## Real-world examples

1. Modern CPUs and GPUs in personal computers
2. Gaming consoles like PlayStation and Xbox
3. High-performance servers in data centers
4. Smartphones and tablets with advanced processors
5. Workstations used for video editing and 3D rendering

## Why it matters

Efficient caching is crucial for modern computing performance. By intelligently predicting and pre-loading data, this technology helps processors, especially graphics processors, run faster and more smoothly. This can lead to quicker application loading, more responsive user interfaces, and higher frame rates in video games. It addresses a fundamental bottleneck in computer architecture: the speed difference between fast processors and slower main memory.

## Frequently asked questions

### What does Making Computer Caches Faster with Dynamic Overfetching cover?

This patent describes a method for computer processors to speed up by intelligently fetching more data than immediately needed into a temporary storage area called a cache, especially when requested data isn't found.

### When does this patent expire?

This patent is expected to expire on September 15, 2046, when the invention enters the public domain.

### What problem does this patent solve?

Efficient caching is crucial for modern computing performance. By intelligently predicting and pre-loading data, this technology helps processors, especially graphics processors, run faster and more smoothly. This can lead to quicker application loading, more responsive user interfaces, and higher frame rates in video games. It addresses a fundamental bottleneck in computer architecture: the speed difference between fast processors and slower main memory.

### What does this patent NOT cover?

Does not cover prefetching data without considering a dynamic overfetch boundary.

**Full plain-English explainer:** https://patentbrief.org/patent/us/12737318/cache-structure-and-utilization

**Original patent:** https://patents.google.com/patent/US12737318

---

_Source: PatentBrief — https://patentbrief.org. Patent facts are from public records; the plain-English explanation is PatentBrief's._