Skip to content
PatentBrief
Get alertsTop ↑

How to Show Augmented Reality Effects Inside a Virtual Reality World

This patent describes a method for creating a virtual reality experience where a user wearing a VR headset sees a simulated augmented reality view, complete with virtual objects appearing as if displayed by AR glasses within that virtual world.

Granted 2018ActiveExpires 2036Owned by Lucasfilm Entertainment CoInvented by Nicholas Rasmussen, Michael Koperwas, John Gaeta

Original patent title: “Augmented reality simulation”

Plain-English explanation by SahiLast reviewed · October 3, 2026

This patent describes a method for creating a virtual reality experience where a user wearing a VR headset sees a simulated augmented reality view, complete with virtual objects appearing as if displayed by AR glasses within that virtual world. Granted to Lucasfilm Entertainment Co in 2018 with 23 claims and 66 forward citations, and it is expected to expire in 2036.

Coverage

What does this patent actually cover?

This patent outlines a computer-implemented method for combining virtual reality (VR) and simulated augmented reality (AR) experiences. First, it renders a "first view" of a three-dimensional (3-D) virtual scene, such as a virtual movie theater, from the user's perspective (claimclaimA numbered sentence at the end of a patent that legally defines what the inventor owns. The most important section.Read more → 1). This first view includes content, like a movie, shown on a "virtual display device" (claim 2). Next, it renders a "second view" from the same perspective, which includes "one or more content objects" and shows the virtual display device as if seen through a pair of augmented-reality glasses (claim 1). These two views are then combined to create a "composite view" that is displayed on a virtual-reality headset (claim 1). For example, a user in a VR headset could watch a virtual movie while simultaneously seeing virtual notifications or characters floating in their view, just as if they were wearing AR glasses within that virtual movie theater.

The gap

What does this patent NOT cover?

  • Does not cover displaying actual augmented reality directly onto the real world; it's a simulation *within* a virtual reality environment.
  • Does not cover displaying only a standard virtual reality scene without the simulated augmented reality elements.
  • Does not cover systems where the 'content objects' are not specifically rendered as if seen through a pair of AR glasses.
  • Does not cover displaying the combined view on a regular screen or monitor, only on a 'virtual-reality headset'.
  • Does not cover AR simulations that are not combined with a separate 'first view' of a virtual scene displaying primary content.

These exclusions are unique to PatentBrief — derived from the actual claim language, not patent-office boilerplate.

Key facts

Patent numberUS 10078917
StatusActive
FieldConsumer Electronics
AssigneeLucasfilm Entertainment Co
InventorsNicholas Rasmussen, Michael Koperwas, John Gaeta
Filed2016
Granted2018
Expires2036
Claims23
Times cited66
LitigationNone on record
Value · $374K–$1.2MSubstantial

What made this novel

The noveltynoveltyThe requirement that an invention be different from anything publicly known before its priority date.Read more → lies in the specific combination: simulating an augmented reality experience *within* a virtual reality environment, rather than just presenting a standard VR scene or a real-world AR overlay. It's about creating a 'nested reality' where one virtual display technology (AR glasses) is simulated inside another (VR headset).

The Patent Drawing

Representative patent drawing for Augmented reality simulation (US 10078917)
Representative figure · US 10078917All figures on Google Patents →
Augmented reality simulation(Primary claim)consumer electronicssoftwaregamingtelecommunicationsentertainment

Schematic visualization of the patent's claim structure. Hand-drawn diagrams in progress for each landmark patent.

Where you've seen this

Real-world examples

01

Virtual movie theaters with interactive pop-up information

02

VR training simulations with simulated heads-up displays

03

Metaverse platforms showing virtual notifications or guides

04

VR games with in-game AR-style elements or character overlays

Why it matters

The bigger picture

This patent from Lucasfilm, a company known for pioneering visual effects, addresses how to layer different types of immersive experiences. It is relevant for creating richer and more complex virtual environments in VR, allowing for 'AR-like' overlays within fully virtual worlds. This capability is important for advanced virtual training, interactive entertainment, and future metaverse applications where users might want to simulate various display technologies.

Filed

October 10, 2016

Granted

September 18, 2018

Market context

Who's building on this

Companies in this space

Companies like Meta (Reality Labs), Apple, Google, Microsoft, and various gaming studios are actively developing VR and AR experiences, including virtual environments that could incorporate simulated AR elements. Lucasfilm itself, as part of Disney, continues to explore immersive entertainment and advanced visual technologies.

Market impact

This patent contributes to the ongoing development of more complex and layered immersive experiences in virtual reality. It enables creators to design virtual worlds where users can interact with simulated AR interfaces, potentially leading to richer virtual environments for entertainment, education, and social interaction within metaverse platforms. It helps define how different virtual display technologies can coexist within a single VR experience.

Claim 1 — Plain English

What this patent covers

This patent outlines a computer-implemented method for combining virtual reality (VR) and simulated augmented reality (AR) experiences. First, it renders a "first view" of a three-dimensional (3-D) virtual scene, such as a virtual movie theater, from the user's perspective (claim 1). This first view includes content, like a movie, shown on a "virtual display device" (claim 2). Next, it renders a "second view" from the same perspective, which includes "one or more content objects" and shows the virtual display device as if seen through a pair of augmented-reality glasses (claim 1). These two views are then combined to create a "composite view" that is displayed on a virtual-reality headset (claim 1). For example, a user in a VR headset could watch a virtual movie while simultaneously seeing virtual notifications or characters floating in their view, just as if they were wearing AR glasses within that virtual movie theater.

The clever bit

The novelty lies in the specific combination: simulating an augmented reality experience *within* a virtual reality environment, rather than just presenting a standard VR scene or a real-world AR overlay. It's about creating a 'nested reality' where one virtual display technology (AR glasses) is simulated inside another (VR headset).

What it does not cover

  • Does not cover displaying actual augmented reality directly onto the real world; it's a simulation *within* a virtual reality environment.
  • Does not cover displaying only a standard virtual reality scene without the simulated augmented reality elements.
  • Does not cover systems where the 'content objects' are not specifically rendered as if seen through a pair of AR glasses.
  • Does not cover displaying the combined view on a regular screen or monitor, only on a 'virtual-reality headset'.
  • Does not cover AR simulations that are not combined with a separate 'first view' of a virtual scene displaying primary content.

Patent timeline

Filing

Application submitted to the patent office

Publication

Application published, typically 18 months after filing

Grant

Patent officially issued

Expiration

Patent enters public domain

PatentBrief Score

Impact Score

Strong

Citation count

36/40

Highly cited

Claim breadth

15/20

Broad claimsclaimsThe numbered statements at the end of a patent that legally define what the inventor owns.Read more →

Recency

10/20

Granted 5–10 years ago

Assignee scale

0/20

Independent or smaller assigneeassigneeThe entity that owns the patent — usually the inventor's employer or a company.Read more →

PatentBrief Impact Score — based on citation count, claim breadth, recency, and assignee scale. Not a legal assessment.

Heuristic Value Estimate

What this patent might be worth

Substantial

$374K – $1.2M

Midpoint $749K · 10.0 yr remaining · industry ×1.6

Adjust inputs →

Heuristic only — blends forward/backward citation counts, claim scope, time remaining, litigation history, and CPC-derived industry baseline. Real valuations need a professional appraisal.

Claim text not yet imported for this patent

The original legal language

Original claims

23 claims as filed with the patent office.

Concepts involved

ClaimPrior artNon-obviousnessNoveltySpecificationAssigneePatent term

Citations

Patent lineage

Cites earlier patents

14

earlier patents this invention cites as foundations

View prior art →

Cited by later patents

66

later patents that build on this invention

View patents →

Cite this patent

Rasmussen, N., Koperwas, M., & Gaeta, J. (2018). How to Show Augmented Reality Effects Inside a Virtual Reality World (U.S. Patent No. 10,078,917). U.S. Patent and Trademark Office. https://patentbrief.org/patent/us/10078917/augmented-reality-simulation

Auto-generated from the patent record. Double-check author order and the issue date against the official USPTO document before submitting.

Embed

Add this patent to your site

Drop this plain-English patent card into any blog post or article — free, no signup. It always links back to the full breakdown here.

<div data-patentlens-widget data-patent-number="US10078917"></div>
<script src="https://patentbrief.org/embed.js" async></script>

Stay in the loop

Get a weekly digest of new patents.

One email per week. No spam. Unsubscribe anytime.

Keep exploring

Related patents you should know

US 4683195 · 1987

How to Make Billions of Copies of a DNA Segment

This patent describes the Polymerase Chain Reaction (PCR), a method to rapidly create many copies of a specific piece of DNA or RNA, enabling its detection and analysis.

Cetus Corp

US 8697359 · 2014

How to Edit Genes in Human Cells Using an Engineered CRISPR System

This patent describes an engineered CRISPR-Cas9 system for precisely cutting DNA in eukaryotic cells to change how genes work, opening the door for gene editing in complex organisms.

Massachusetts Institute of Technology

US 7657849 · 2010

How the iPhone's Slide-to-Unlock Gesture Works

Apple's 2010 patent describes unlocking a device by dragging a specific graphical image across the touchscreen along a predefined path, a gesture that became iconic with the original iPhone.

Apple Inc

US 4733665 · 1988

How Doctors Implant a Permanent Stent Using a Balloon

This patent describes the method for placing a permanent, expandable wire mesh tube inside a blood vessel or other body tube using a balloon-tipped catheter to widen it and keep it open.

Expandable Grafts Partnership

US 4965188 · 1990

How to Make Many Copies of a DNA Piece with Heat

This patent describes the Polymerase Chain Reaction (PCR) method, a technique to make millions of copies of a specific DNA segment using a heat-resistant enzyme and repeated temperature changes.

Cetus Corp

US 4235871 · 1980

How to Encapsulate Active Materials in Lipid Bubbles Efficiently

This patent describes a method for trapping biologically active substances inside tiny, multi-layered fat bubbles called liposomes, using a specific water-in-oil emulsion and gel-forming process to improve how much material gets captured.

Individual

Semantically similar

You might also find these interesting

SEARCH ALL

More to explore

More in Consumer Electronics

Browse all Consumer Electronics

New to patents?

What is a patent?How to read a patentAnatomy of a claimHow strong is this patent?What the citations meanWhat it doesn't coverConsumer Electronics PatentsPatent glossary
Explore the landscape:consumer electronics patents →software patents →gaming patents →

Common Questions

Frequently Asked Questions

What does How to Show Augmented Reality Effects Inside a Virtual Reality World cover?

This patent describes a method for creating a virtual reality experience where a user wearing a VR headset sees a simulated augmented reality view, complete with virtual objects appearing as if displayed by AR glasses within that virtual world.

Who owns patent US 10078917?

Lucasfilm Entertainment Co owns this patent, granted in 2018.

When does this patent expire?

This patent is expected to expire on October 10, 2036, when the invention enters the public domain.

What is patent US 10078917 cited by?

This patent has been cited by 66 later patents that build on its ideas.

What problem does this patent solve?

This patent from Lucasfilm, a company known for pioneering visual effects, addresses how to layer different types of immersive experiences. It is relevant for creating richer and more complex virtual environments in VR, allowing for 'AR-like' overlays within fully virtual worlds. This capability is important for advanced virtual training, interactive entertainment, and future metaverse applications where users might want to simulate various display technologies.

What does this patent NOT cover?

Does not cover displaying actual augmented reality directly onto the real world; it's a simulation *within* a virtual reality environment.

Patent monitoring

Get notified when Lucasfilm Entertainment Co files a new patent

Get notified when this company files a new patent. Weekly digest · Confirm via email · Unsubscribe anytime.

Last reviewed: October 3, 2026 · PatentBrief is not a law firm and this is not legal advice.