# Making Real-World Sounds Fit into Mixed Reality Experiences > This patent describes how a wearable device can take sounds from the real world, change them to match the acoustics of a virtual environment, and then play them back to a user, making mixed reality feel more realistic. - **Patent:** US 12738289 - **Original title:** Voice processing for mixed reality - **Granted:** 2026 - **Status:** Active - **Times cited:** 0 - **Field:** consumer_electronics, software, telecommunications, ai_ml ## What it does This patent focuses on processing audio for mixed reality. It describes a system where a wearable device receives an audio signal from a real-world sound source. The system then figures out the acoustic properties of the mixed reality environment, such as how sound would echo or be muffled in that virtual space. Based on these properties, it calculates a signal modification parameter. This parameter is then applied to the original real-world audio signal, creating a new, modified audio signal. Finally, this modified audio signal is presented to the user, making real-world sounds seem like they are naturally part of the mixed reality scene. For example, if you're wearing a mixed reality headset and talking to someone in a real room, but the virtual environment shows you in a large, empty hall, this system would add echo to the person's voice to match the virtual hall. ## What it does NOT cover - It does not cover audio processing for purely virtual reality environments where all sounds originate from the virtual world. - It does not cover augmented reality systems that simply overlay virtual objects without modifying real-world audio based on virtual acoustic properties. - It does not cover systems that modify real-world audio without first determining acoustic properties of a mixed reality environment. - It does not cover audio systems that do not use a wearable device to receive the input audio signal. - It does not cover modifying virtual sounds based on real-world acoustic properties; it specifically focuses on real-world sounds modified by mixed reality properties. ## The clever bit The novelty lies in dynamically altering real-world audio based on the *acoustic characteristics of a virtual environment*. Instead of just playing real sounds, it makes them sound as if they are actually interacting with the virtual space, which significantly enhances the feeling of presence and immersion in mixed reality. ## Real-world examples 1. Meta Quest Pro 2. Apple Vision Pro 3. Microsoft HoloLens 4. Magic Leap headsets 5. Augmented reality glasses with spatial audio features ## Why it matters Realistic audio is crucial for believable mixed reality experiences. If a virtual object sounds out of place in the real world, or a real sound doesn't match the virtual environment, it breaks the user's immersion. This technology helps blend the auditory experience between the physical and digital worlds, making interactions feel more natural. It's a foundational piece for creating compelling mixed reality applications that seamlessly integrate virtual elements with our physical surroundings. ## Frequently asked questions ### What does Making Real-World Sounds Fit into Mixed Reality Experiences cover? This patent describes how a wearable device can take sounds from the real world, change them to match the acoustics of a virtual environment, and then play them back to a user, making mixed reality feel more realistic. ### When does this patent expire? This patent is expected to expire on September 15, 2046, when the invention enters the public domain. ### What problem does this patent solve? Realistic audio is crucial for believable mixed reality experiences. If a virtual object sounds out of place in the real world, or a real sound doesn't match the virtual environment, it breaks the user's immersion. This technology helps blend the auditory experience between the physical and digital worlds, making interactions feel more natural. It's a foundational piece for creating compelling mixed reality applications that seamlessly integrate virtual elements with our physical surroundings. ### What does this patent NOT cover? It does not cover audio processing for purely virtual reality environments where all sounds originate from the virtual world. **Full plain-English explainer:** https://patentbrief.org/patent/us/12738289/voice-processing-for-mixed-reality **Original patent:** https://patents.google.com/patent/US12738289 --- _Source: PatentBrief — https://patentbrief.org. Patent facts are from public records; the plain-English explanation is PatentBrief's._ ## Related patents Semantically similar inventions in the PatentBrief corpus: - [How Wearable Tech Uses 3D Sound to Guide Visually Impaired People](https://patentbrief.org/patent/us/10362429/find-my-network) — A system that builds a 3D map of the world and uses spatial audio to act as a virtual guide, helping visually impaired users navigate around obstacles. - [Smart Speaker System Adapts Sound Based on Speaker Placement](https://patentbrief.org/patent/us/11743673/audio-processing-apparatus-and-method-therefor) — This patent describes an audio system that intelligently chooses how to play different parts of a sound through different speakers, adapting its method based on where each speaker is placed in a room. - [How to Mix Sound for Different Speaker Setups](https://patentbrief.org/patent/us/12335718/system-and-method-for-adaptive-audio-signal-generation-coding-and-rendering) — This patent describes a system for mixing and playing back audio, allowing sound engineers to precisely control where sounds appear in a room, even preventing sounds from playing through specific speakers. - [How Smart Speakers Adapt Sound to Your Room and Listening Spot](https://patentbrief.org/patent/us/11178503/system-for-rendering-and-playback-of-object-based-audio-in-various-listening-env) — This patent describes a system that automatically adjusts how spatial audio sounds in a room by sensing speaker locations, listener position, and room acoustics, then dynamically calibrating the sound output. - [How Wearable Devices Use Location and Biometrics to Know Who You Are](https://patentbrief.org/patent/us/20220189458/speech-based-user-recognition) — This patent describes how a computer system can figure out who is using a wearable device by combining its location data with biometric information like a face scan or voice recording.