How Video Apps Add Special Effects and Frame People

This patent describes ways for video applications to show special visual effects, like filters or backgrounds, during live video calls or when recording, and how to automatically frame a person.

What it covers

The patent outlines methods and user interfaces for displaying graphical effects within video applications. This includes applying visual effects during a "real-time communication session," which means live video calls, and sharing content with these effects. It also covers displaying these graphical effects across "multiple video applications" and a system for "framing a subject" within the camera's view. For instance, a video chat application could automatically zoom and pan to keep a speaker centered in the frame, or a user could add a virtual hat graphical effect to their head during a live broadcast.

What it doesn't cover

• —Does not cover applying effects to purely audio communication without any video component.
• —Does not cover graphical effects in applications that are not video-based, such as static image viewers or text editors.
• —Does not cover the underlying video compression or transmission technologies themselves, only the display of effects.
• —Does not cover physical camera hardware or lens systems that capture the video.
• —Does not cover effects that are only applied during post-production editing of a recorded video, rather than during display or real-time communication.

The clever bit

The novelty appears to be in the specific methods for integrating graphical effects seamlessly into real-time video sessions, enabling their use across multiple applications, and providing automated subject framing within the camera's field of view.

Why it matters

This technology is crucial for enhancing user engagement and creativity in modern video communication. Features like virtual backgrounds, face filters, and automatic framing have become standard in video conferencing and social media apps. They make video interactions more dynamic, personalized, and professional, driving broader adoption of video-centric platforms.

Real-world examples

• 1.Zoom virtual backgrounds and filters
• 2.Microsoft Teams custom backgrounds and 'Together mode'
• 3.Google Meet visual effects and auto-framing
• 4.Snapchat AR filters and lenses
• 5.Instagram video effects for Reels and Stories
• 6.TikTok visual effects and green screen features