# How Digital Media Streams Are Automatically Tagged and Organized > A method for embedding standardized labels directly into digital video or audio streams so that devices can automatically identify and extract specific segments of content. - **Patent:** US 9264471 - **Original title:** Method and apparatus for segmenting media content - **Owner:** Google Technology Holdings LLC - **Granted:** 2016 - **Status:** Active - **Times cited:** 4 - **Field:** telecommunications, consumer_electronics, software ## What it does This patent describes a way to divide a long, continuous stream of media—like a live broadcast or a long video file—into logical parts called macro segments. Before the viewer even sees the content, the system embeds a standardized tag directly into the video data, specifically within the picture user data or Supplemental Enhancement Information (SEI). This tag acts like a digital signpost, carrying a data set that describes what that specific segment contains. When a receiving device, like a set-top box or smart TV, encounters these tags, it uses them to automatically identify and extract the relevant segments for the user, such as separating a show from its commercials. ## What it does NOT cover - Does not cover methods that identify segments based on visual analysis or pixel-level image recognition. - Does not cover systems that rely on external metadata files or sidecar files that are separate from the media stream itself. - Does not cover post-processing methods that analyze the stream after it has already been presented to the user. - Does not cover non-standardized or proprietary tagging formats not contained within the specified picture user data or SEI fields. ## The clever bit The innovation lies in embedding the metadata directly into the picture user data of the stream itself, ensuring that the 'instructions' for the content are physically bound to the media and processed in real-time before the content is even displayed. ## Real-world examples 1. Dynamic ad insertion in live streaming broadcasts 2. Smart TV automatic chapter marking for recorded programs 3. Automated content filtering in set-top boxes ## Why it matters This technology is essential for modern digital television and streaming services that need to handle dynamic ad insertion or content skipping automatically. By embedding the metadata directly into the stream, it ensures that the instructions for how to handle a segment travel with the video, preventing synchronization errors that often occur when metadata is sent through a separate, slower channel. ## Frequently asked questions ### What does How Digital Media Streams Are Automatically Tagged and Organized cover? A method for embedding standardized labels directly into digital video or audio streams so that devices can automatically identify and extract specific segments of content. ### Who owns patent US 9264471? Google Technology Holdings LLC owns this patent, granted in 2016. ### When does this patent expire? This patent is expected to expire on February 16, 2036, when the invention enters the public domain. ### What is patent US 9264471 cited by? This patent has been cited by 4 later patents that build on its ideas. ### What problem does this patent solve? This technology is essential for modern digital television and streaming services that need to handle dynamic ad insertion or content skipping automatically. By embedding the metadata directly into the stream, it ensures that the instructions for how to handle a segment travel with the video, preventing synchronization errors that often occur when metadata is sent through a separate, slower channel. ### What does this patent NOT cover? Does not cover methods that identify segments based on visual analysis or pixel-level image recognition. **Full plain-English explainer:** https://patentbrief.org/patent/us/9264471/netflix-download-for-offline **Original patent:** https://patents.google.com/patent/US9264471 --- _Source: PatentBrief — https://patentbrief.org. Patent facts are from public records; the plain-English explanation is PatentBrief's._ ## Related patents Semantically similar inventions in the PatentBrief corpus: - [How Streaming Services Dynamically Insert Targeted Ads Into Videos](https://patentbrief.org/patent/us/9721254/uber-ride-hailing-platform) — A method for streaming services to stitch personalized advertisements into video content by dynamically generating playlists that match the user's profile and internet speed. - [How Devices Track Offline Ad Watching and Share Media Recommendations](https://patentbrief.org/patent/us/8769558/netflix-adaptive-streaming) — A system for tracking which ads a user watches in downloaded video files while offline and reporting that data back to publishers once the device reconnects to the internet. - [How to Browse TV Shows Using 3D Virtual Objects](https://patentbrief.org/patent/us/8176439/windows-8-live-tiles) — A method for organizing television content by mapping category labels onto 3D surfaces that transform into video players when selected. - [How Network Providers Subcontract Data Processing Tasks](https://patentbrief.org/patent/us/8606929/aws-lambda) — A method for internet service providers to bundle specific data processing tasks from many users and send them to a third party for efficient handling. - [How to Search Through Long Videos Using a Compressed Visual Timeline](https://patentbrief.org/patent/us/10311112/github-acquisition-integration) — A method for searching large collections of video or image data by condensing them into a single, scrollable visual strip that triggers automated searches as you move a slider.