How to Show Augmented Reality Effects Inside a Virtual Reality World
This patent describes a method for creating a virtual reality experience where a user wearing a VR headset sees a simulated augmented reality view, complete with virtual objects appearing as if displayed by AR glasses within that virtual world.
Original patent title: “Augmented reality simulation”
This patent describes a method for creating a virtual reality experience where a user wearing a VR headset sees a simulated augmented reality view, complete with virtual objects appearing as if displayed by AR glasses within that virtual world. Granted to Lucasfilm Entertainment Co in 2018 with 23 claims and 66 forward citations, and it is expected to expire in 2036.
Coverage
What does this patent actually cover?
This patent outlines a computer-implemented method for combining virtual reality (VR) and simulated augmented reality (AR) experiences. First, it renders a "first view" of a three-dimensional (3-D) virtual scene, such as a virtual movie theater, from the user's perspective (claimclaimA numbered sentence at the end of a patent that legally defines what the inventor owns. The most important section.Read more → 1). This first view includes content, like a movie, shown on a "virtual display device" (claim 2). Next, it renders a "second view" from the same perspective, which includes "one or more content objects" and shows the virtual display device as if seen through a pair of augmented-reality glasses (claim 1). These two views are then combined to create a "composite view" that is displayed on a virtual-reality headset (claim 1). For example, a user in a VR headset could watch a virtual movie while simultaneously seeing virtual notifications or characters floating in their view, just as if they were wearing AR glasses within that virtual movie theater.
The gap
What does this patent NOT cover?
- Does not cover displaying actual augmented reality directly onto the real world; it's a simulation *within* a virtual reality environment.
- Does not cover displaying only a standard virtual reality scene without the simulated augmented reality elements.
- Does not cover systems where the 'content objects' are not specifically rendered as if seen through a pair of AR glasses.
- Does not cover displaying the combined view on a regular screen or monitor, only on a 'virtual-reality headset'.
- Does not cover AR simulations that are not combined with a separate 'first view' of a virtual scene displaying primary content.
These exclusions are unique to PatentBrief — derived from the actual claim language, not patent-office boilerplate.
Key facts
What made this novel
The noveltynoveltyThe requirement that an invention be different from anything publicly known before its priority date.Read more → lies in the specific combination: simulating an augmented reality experience *within* a virtual reality environment, rather than just presenting a standard VR scene or a real-world AR overlay. It's about creating a 'nested reality' where one virtual display technology (AR glasses) is simulated inside another (VR headset).
The Patent Drawing

Schematic visualization of the patent's claim structure. Hand-drawn diagrams in progress for each landmark patent.
Where you've seen this
Real-world examples
Virtual movie theaters with interactive pop-up information
VR training simulations with simulated heads-up displays
Metaverse platforms showing virtual notifications or guides
VR games with in-game AR-style elements or character overlays
Why it matters
The bigger picture
This patent from Lucasfilm, a company known for pioneering visual effects, addresses how to layer different types of immersive experiences. It is relevant for creating richer and more complex virtual environments in VR, allowing for 'AR-like' overlays within fully virtual worlds. This capability is important for advanced virtual training, interactive entertainment, and future metaverse applications where users might want to simulate various display technologies.
Filed
October 10, 2016
Granted
September 18, 2018
Market context
Who's building on this
Companies in this space
Companies like Meta (Reality Labs), Apple, Google, Microsoft, and various gaming studios are actively developing VR and AR experiences, including virtual environments that could incorporate simulated AR elements. Lucasfilm itself, as part of Disney, continues to explore immersive entertainment and advanced visual technologies.
Market impact
This patent contributes to the ongoing development of more complex and layered immersive experiences in virtual reality. It enables creators to design virtual worlds where users can interact with simulated AR interfaces, potentially leading to richer virtual environments for entertainment, education, and social interaction within metaverse platforms. It helps define how different virtual display technologies can coexist within a single VR experience.
Claim 1 — Plain English
What this patent covers
This patent outlines a computer-implemented method for combining virtual reality (VR) and simulated augmented reality (AR) experiences. First, it renders a "first view" of a three-dimensional (3-D) virtual scene, such as a virtual movie theater, from the user's perspective (claim 1). This first view includes content, like a movie, shown on a "virtual display device" (claim 2). Next, it renders a "second view" from the same perspective, which includes "one or more content objects" and shows the virtual display device as if seen through a pair of augmented-reality glasses (claim 1). These two views are then combined to create a "composite view" that is displayed on a virtual-reality headset (claim 1). For example, a user in a VR headset could watch a virtual movie while simultaneously seeing virtual notifications or characters floating in their view, just as if they were wearing AR glasses within that virtual movie theater.
The clever bit
The novelty lies in the specific combination: simulating an augmented reality experience *within* a virtual reality environment, rather than just presenting a standard VR scene or a real-world AR overlay. It's about creating a 'nested reality' where one virtual display technology (AR glasses) is simulated inside another (VR headset).
What it does not cover
- Does not cover displaying actual augmented reality directly onto the real world; it's a simulation *within* a virtual reality environment.
- Does not cover displaying only a standard virtual reality scene without the simulated augmented reality elements.
- Does not cover systems where the 'content objects' are not specifically rendered as if seen through a pair of AR glasses.
- Does not cover displaying the combined view on a regular screen or monitor, only on a 'virtual-reality headset'.
- Does not cover AR simulations that are not combined with a separate 'first view' of a virtual scene displaying primary content.
Patent timeline
Application submitted to the patent office
Application published, typically 18 months after filing
Patent officially issued
Patent enters public domain
PatentBrief Score
Impact Score
Strong
Citation count
36/40
Highly cited
Claim breadth
15/20
Broad claimsclaimsThe numbered statements at the end of a patent that legally define what the inventor owns.Read more →
Recency
10/20
Granted 5–10 years ago
Assignee scale
0/20
Independent or smaller assigneeassigneeThe entity that owns the patent — usually the inventor's employer or a company.Read more →
PatentBrief Impact Score — based on citation count, claim breadth, recency, and assignee scale. Not a legal assessment.
Heuristic Value Estimate
What this patent might be worth
$374K – $1.2M
Midpoint $749K · 10.0 yr remaining · industry ×1.6
Heuristic only — blends forward/backward citation counts, claim scope, time remaining, litigation history, and CPC-derived industry baseline. Real valuations need a professional appraisal.
Claim text not yet imported for this patent
The original legal language
Original claims
23 claims as filed with the patent office.
Concepts involved
Citations
Patent lineage
Cite this patent
Rasmussen, N., Koperwas, M., & Gaeta, J. (2018). How to Show Augmented Reality Effects Inside a Virtual Reality World (U.S. Patent No. 10,078,917). U.S. Patent and Trademark Office. https://patentbrief.org/patent/us/10078917/augmented-reality-simulation
Auto-generated from the patent record. Double-check author order and the issue date against the official USPTO document before submitting.
Embed
Add this patent to your site
Drop this plain-English patent card into any blog post or article — free, no signup. It always links back to the full breakdown here.
<div data-patentlens-widget data-patent-number="US10078917"></div> <script src="https://patentbrief.org/embed.js" async></script>
Stay in the loop
Get a weekly digest of new patents.
One email per week. No spam. Unsubscribe anytime.
Keep exploring
Related patents you should know
US 4683195 · 1987
How to Make Billions of Copies of a DNA Segment
This patent describes the Polymerase Chain Reaction (PCR), a method to rapidly create many copies of a specific piece of DNA or RNA, enabling its detection and analysis.
Cetus Corp
US 8697359 · 2014
How to Edit Genes in Human Cells Using an Engineered CRISPR System
This patent describes an engineered CRISPR-Cas9 system for precisely cutting DNA in eukaryotic cells to change how genes work, opening the door for gene editing in complex organisms.
Massachusetts Institute of Technology
US 7657849 · 2010
How the iPhone's Slide-to-Unlock Gesture Works
Apple's 2010 patent describes unlocking a device by dragging a specific graphical image across the touchscreen along a predefined path, a gesture that became iconic with the original iPhone.
Apple Inc
US 4733665 · 1988
How Doctors Implant a Permanent Stent Using a Balloon
This patent describes the method for placing a permanent, expandable wire mesh tube inside a blood vessel or other body tube using a balloon-tipped catheter to widen it and keep it open.
Expandable Grafts Partnership
US 4965188 · 1990
How to Make Many Copies of a DNA Piece with Heat
This patent describes the Polymerase Chain Reaction (PCR) method, a technique to make millions of copies of a specific DNA segment using a heat-resistant enzyme and repeated temperature changes.
Cetus Corp
US 4235871 · 1980
How to Encapsulate Active Materials in Lipid Bubbles Efficiently
This patent describes a method for trapping biologically active substances inside tiny, multi-layered fat bubbles called liposomes, using a specific water-in-oil emulsion and gel-forming process to improve how much material gets captured.
Individual
Semantically similar
You might also find these interesting
US 9726896 · 2017
How an Augmented Reality Headset Shows a Stable Virtual Monitor
US 12386177 · 2025 · Disney Enterprises
How Disney's Compact AR Display Uses Special Mirrors
US 12737996 · 2026
Creating Your Own Image in Virtual and Augmented Reality
US 12737093 · 2026
Managing Virtual Objects on Resizable Surfaces in 3D Digital Spaces
More to explore
More in Consumer Electronics
US 7657849 · 2010 · Apple Inc
How the iPhone's Slide-to-Unlock Gesture Works
US 7479949 · 2009 · Apple Inc
How Touchscreens Understand Your Finger Swipes and Scrolls
US 4528643 · 1985 · FPDC Inc
How Stores Make Custom Products On-Demand with Remote Approval
US 7469381 · 2008 · Apple Inc
How Touchscreens Show and Snap Back When You Scroll Past an Edge
New to patents?
Common Questions
Frequently Asked Questions
What does How to Show Augmented Reality Effects Inside a Virtual Reality World cover?
This patent describes a method for creating a virtual reality experience where a user wearing a VR headset sees a simulated augmented reality view, complete with virtual objects appearing as if displayed by AR glasses within that virtual world.
Who owns patent US 10078917?
Lucasfilm Entertainment Co owns this patent, granted in 2018.
When does this patent expire?
This patent is expected to expire on October 10, 2036, when the invention enters the public domain.
What is patent US 10078917 cited by?
This patent has been cited by 66 later patents that build on its ideas.
What problem does this patent solve?
This patent from Lucasfilm, a company known for pioneering visual effects, addresses how to layer different types of immersive experiences. It is relevant for creating richer and more complex virtual environments in VR, allowing for 'AR-like' overlays within fully virtual worlds. This capability is important for advanced virtual training, interactive entertainment, and future metaverse applications where users might want to simulate various display technologies.
What does this patent NOT cover?
Does not cover displaying actual augmented reality directly onto the real world; it's a simulation *within* a virtual reality environment.
Patent monitoring




