How to Show Augmented Reality Effects Inside a Virtual Reality World

This patent describes a method for creating a virtual reality experience where a user wearing a VR headset sees a simulated augmented reality view, complete with virtual objects appearing as if displayed by AR glasses within that virtual world.

What it covers

This patent outlines a computer-implemented method for combining virtual reality (VR) and simulated augmented reality (AR) experiences. First, it renders a "first view" of a three-dimensional (3-D) virtual scene, such as a virtual movie theater, from the user's perspective (claim 1). This first view includes content, like a movie, shown on a "virtual display device" (claim 2). Next, it renders a "second view" from the same perspective, which includes "one or more content objects" and shows the virtual display device as if seen through a pair of augmented-reality glasses (claim 1). These two views are then combined to create a "composite view" that is displayed on a virtual-reality headset (claim 1). For example, a user in a VR headset could watch a virtual movie while simultaneously seeing virtual notifications or characters floating in their view, just as if they were wearing AR glasses within that virtual movie theater.

What it doesn't cover

• —Does not cover displaying actual augmented reality directly onto the real world; it's a simulation *within* a virtual reality environment.
• —Does not cover displaying only a standard virtual reality scene without the simulated augmented reality elements.
• —Does not cover systems where the 'content objects' are not specifically rendered as if seen through a pair of AR glasses.
• —Does not cover displaying the combined view on a regular screen or monitor, only on a 'virtual-reality headset'.
• —Does not cover AR simulations that are not combined with a separate 'first view' of a virtual scene displaying primary content.

The clever bit

The novelty lies in the specific combination: simulating an augmented reality experience *within* a virtual reality environment, rather than just presenting a standard VR scene or a real-world AR overlay. It's about creating a 'nested reality' where one virtual display technology (AR glasses) is simulated inside another (VR headset).

Why it matters

This patent from Lucasfilm, a company known for pioneering visual effects, addresses how to layer different types of immersive experiences. It is relevant for creating richer and more complex virtual environments in VR, allowing for 'AR-like' overlays within fully virtual worlds. This capability is important for advanced virtual training, interactive entertainment, and future metaverse applications where users might want to simulate various display technologies.

Real-world examples

• 1.Virtual movie theaters with interactive pop-up information
• 2.VR training simulations with simulated heads-up displays
• 3.Metaverse platforms showing virtual notifications or guides
• 4.VR games with in-game AR-style elements or character overlays