How Smart Speakers Recognize Who Is Talking

This patent describes how a speech-controlled device identifies a specific user from their voice to deliver personalized content or deny requests based on recognition confidence.

What it covers

This patent describes a system where a device, like a smart speaker, captures spoken audio (Claim 1). A server then analyzes this audio to figure out who spoke it, matching the voice to a "user identifier" (Claim 1). Once the speaker is identified, the system processes their request and provides "first content" that is "customized based at least in part on the user identifier" (Claim 1). For example, if a child asks for music, the system might recognize their voice and play music from their specific playlist. The patent also covers scenarios where a "user recognition condition" must be met (Claim 2). If the system can't confidently identify the user for a sensitive request, it might "decline to execute the second request" (Claim 3) or provide generic content instead of customized content (Claim 4). It can even use face recognition alongside voice for stronger identification (Claim 10).

What it doesn't cover

• —Does not cover speech processing systems that do not attempt to identify the specific user speaking.
• —Does not cover systems that customize content without using the user's voice for identification.
• —Does not cover systems that identify users solely through non-biometric means, like a login or explicit command.
• —Does not cover systems that only use image data for user recognition without also processing audio data (Claim 10 requires both for enhanced recognition).
• —Does not cover systems that always provide customized content regardless of user recognition confidence.

The clever bit

The clever part is linking user identification directly to content customization and access control, especially by considering "user recognition conditions" (Claim 2) and potentially using "most stringent" confidence thresholds (Abstract). This allows the system to intelligently decide when to personalize content, when to provide generic content, or when to deny a request entirely based on how sure it is about who is speaking.

Why it matters

This technology is fundamental to modern voice assistants and smart home devices. It allows a single device to serve multiple family members with personalized experiences, like playing their specific music, accessing their calendars, or making purchases from their accounts. Without robust user recognition, voice assistants would be less useful and potentially insecure for sensitive tasks. Amazon, the assignee, heavily relies on such systems for its Alexa-enabled devices.

Real-world examples

• 1.Amazon Echo devices (Alexa Voice Profiles)
• 2.Google Nest speakers (Voice Match)
• 3.Apple HomePod (Recognize My Voice)
• 4.Smart TVs with voice control
• 5.In-car voice assistants