# Creating Your Own Image in Virtual and Augmented Reality

> This patent describes how an artificial reality system can show a user their own image, called a self-representation, within a virtual world by using machine learning to identify and display parts of their live image.

- **Patent:** US 12737996
- **Original title:** Providing a secured self-representation by writing to a portion if a frame buffer after other applications have written to the frame buffer, where the other applications cannot access the secured-self representation or the images received by a secure application
- **Granted:** 2026
- **Status:** Active
- **Times cited:** 0
- **Field:** consumer_electronics, software, ai_ml, telecommunications, gaming

## What it does

Based on the abstract, this patent describes a system that creates a digital version of a user, called a self-representation, for artificial reality environments. It works by taking an image of the user and then using a special computer program, a machine learning model, to find the 'self portion' of that image. This model has been taught to recognize parts of images that show a user from their own perspective. Once identified, this self-representation is placed into the artificial reality world, adjusted to match the user's viewpoint. The system also tracks the user's movements and updates their digital self-representation to move along with them, making it more realistic. For example, if a user is in a virtual meeting, this system could display a live, moving image of their face as their avatar.

## What it does NOT cover

- Does not cover creating a self-representation purely from a 3D model generated without an initial image of the user.
- Does not cover self-representations that are not based on classifying a 'self portion' from an image using a machine learning model.
- Does not cover systems where the self-representation is static and does not adjust to the user's real-time movements.
- Does not cover displaying generic avatars or pre-made character models that do not originate from the user's live image.
- Does not cover methods of self-representation that do not involve positioning the representation relative to the user's perspective in the artificial reality environment.

## The clever bit

The clever part is using a machine learning model specifically trained to classify a 'self portion' from an image based on a 'self-perspective'. This allows the system to intelligently extract and display the relevant part of the user's image, rather than simply showing a raw video feed, and then dynamically adjust it within the artificial reality environment.

## Real-world examples

1. Meta Quest avatars with camera passthrough
2. Microsoft Mesh for collaborative virtual spaces
3. Apple Vision Pro persona generation
4. Zoom or Google Meet virtual backgrounds that integrate the user's image
5. Any future augmented or virtual reality system requiring realistic user avatars

## Why it matters

Accurate and dynamic self-representations are crucial for making artificial reality experiences feel real and immersive. This technology could enhance social interactions in virtual spaces, allowing users to see a more authentic version of themselves. It improves the sense of presence and connection in applications ranging from virtual meetings to collaborative design environments. The ability to dynamically update the representation with user movement makes interactions more natural.

## Frequently asked questions

### What does Creating Your Own Image in Virtual and Augmented Reality cover?

This patent describes how an artificial reality system can show a user their own image, called a self-representation, within a virtual world by using machine learning to identify and display parts of their live image.

### When does this patent expire?

This patent is expected to expire on September 15, 2046, when the invention enters the public domain.

### What problem does this patent solve?

Accurate and dynamic self-representations are crucial for making artificial reality experiences feel real and immersive. This technology could enhance social interactions in virtual spaces, allowing users to see a more authentic version of themselves. It improves the sense of presence and connection in applications ranging from virtual meetings to collaborative design environments. The ability to dynamically update the representation with user movement makes interactions more natural.

### What does this patent NOT cover?

Does not cover creating a self-representation purely from a 3D model generated without an initial image of the user.

**Full plain-English explainer:** https://patentbrief.org/patent/us/12737996/providing-a-secured-self-representation-by-writing-to-a-portion-if-a-frame

**Original patent:** https://patents.google.com/patent/US12737996

---

_Source: PatentBrief — https://patentbrief.org. Patent facts are from public records; the plain-English explanation is PatentBrief's._


## Related patents

Semantically similar inventions in the PatentBrief corpus:

- [How to Show Augmented Reality Effects Inside a Virtual Reality World](https://patentbrief.org/patent/us/10078917/augmented-reality-simulation) — This patent describes a method for creating a virtual reality experience where a user wearing a VR headset sees a simulated augmented reality view, complete with virtual objects appearing as if displayed by AR glasses within that virtual world.
- [How Video Apps Add Special Effects and Frame People](https://patentbrief.org/patent/us/12737049/video-application-graphical-effects) — This patent describes ways for video applications to show special visual effects, like filters or backgrounds, during live video calls or when recording, and how to automatically frame a person.
- [How Two People's Body Movements Are Tracked in Augmented Reality](https://patentbrief.org/patent/us/10444502/method-and-apparatus-for-multiple-user-self-relative-tracking-for-augmented-real) — This patent describes a system for two users to accurately track their body parts, like a limb, relative to their own head-mounted display using magnetic fields, then display these virtual limbs in a shared augmented reality.
- [How an Augmented Reality Headset Shows a Stable Virtual Monitor](https://patentbrief.org/patent/us/9726896/virtual-monitor-display-technique-for-augmented-reality-environments) — This patent describes an augmented reality headset that uses special liquid lenses and an occlusion matrix to display a stable virtual computer monitor, even as the user moves their head or body, while also preventing visual artifacts.
- [Managing Virtual Objects on Resizable Surfaces in 3D Digital Spaces](https://patentbrief.org/patent/us/12737093/methods-for-displaying-objects-relative-to-virtual-surfaces) — This patent describes how a computer system can display and automatically resize digital surfaces that hold virtual items within a three-dimensional digital environment, offering feedback when items are added or removed.
