# How AI Predicts Who Will Speak Next in a Conversation > IBM's patent describes a system that uses neural networks to analyze speech patterns and intentions to predict which person will talk next in a conversation. - **Patent:** US 11645473 - **Original title:** End-of-turn detection in spoken dialogues - **Owner:** International Business Machines Corp - **Granted:** 2023 - **Status:** Active - **Times cited:** 0 - **Field:** ai_ml, telecommunications, consumer_electronics ## What it does This system uses a neural network to monitor a conversation between two people and figure out who is likely to speak next. It does this by simultaneously analyzing two things: the speaker's 'intention' (like whether they are asking a question or making a statement) and the 'turn type' (like whether they are trying to hold the floor or are about to switch speakers). By combining these predictions using a joint loss function, the system can determine if the first person will keep talking or if the second person will jump in. For example, if the system detects a rising pitch at the end of a sentence (an acoustic cue) and identifies the intention as a question, it can predict a turn switch to the other person. ## What it does NOT cover - Does not cover systems that only look at text transcripts without analyzing acoustic cues like pitch or speaking rate. - Does not cover simple rule-based systems that rely solely on silence duration to detect turn-taking. - Does not cover systems that predict the content of the next sentence, only the identity of the next speaker. ## The clever bit The innovation lies in training a single neural network to jointly optimize two different tasks—intention recognition and turn-type detection—rather than treating them as separate, sequential steps. ## Real-world examples 1. Smart home voice assistants 2. Automated customer service phone bots 3. Real-time speech-to-text transcription software ## Why it matters Managing natural conversation flow is a major hurdle for voice assistants like Siri or Alexa, which often interrupt users or stop listening too early. By accurately predicting turn-taking, this technology aims to make human-computer interactions feel more fluid and less robotic. It is part of a broader effort to move beyond simple keyword recognition into true conversational understanding. ## Frequently asked questions ### What does How AI Predicts Who Will Speak Next in a Conversation cover? IBM's patent describes a system that uses neural networks to analyze speech patterns and intentions to predict which person will talk next in a conversation. ### Who owns patent US 11645473? International Business Machines Corp owns this patent, granted in 2023. ### When does this patent expire? This patent is expected to expire on May 9, 2043, when the invention enters the public domain. ### What problem does this patent solve? Managing natural conversation flow is a major hurdle for voice assistants like Siri or Alexa, which often interrupt users or stop listening too early. By accurately predicting turn-taking, this technology aims to make human-computer interactions feel more fluid and less robotic. It is part of a broader effort to move beyond simple keyword recognition into true conversational understanding. ### What does this patent NOT cover? Does not cover systems that only look at text transcripts without analyzing acoustic cues like pitch or speaking rate. **Full plain-English explainer:** https://patentbrief.org/patent/us/11645473/palm-pathways-language-model **Original patent:** https://patents.google.com/patent/US11645473 --- _Source: PatentBrief — https://patentbrief.org. Patent facts are from public records; the plain-English explanation is PatentBrief's._ ## Related patents Semantically similar inventions in the PatentBrief corpus: - [How Smart Speakers Know You're Talking to Them After a Command](https://patentbrief.org/patent/us/11361763/detecting-system-directed-speech) — This patent describes how a smart speaker system can tell if follow-up speech is meant for it, even without a "wake word," by analyzing voice activity and partial speech recognition results using an AI model. - [How a Digital Assistant Launches Apps Using Your Voice](https://patentbrief.org/patent/us/9548050/continuity-handoff) — This patent describes how a digital assistant like Siri uses your spoken words and understanding of your conversation to figure out what you want and launch the right app. - [How Computers Use Memory Networks to Answer Questions](https://patentbrief.org/patent/us/10664744/watson-question-answering-system-deepqa) — A method for AI to search through large amounts of stored information by repeatedly 'hopping' through memory to find the most relevant facts for answering a question. - [How Software Detects What You Want Based on Your Social Media Posts](https://patentbrief.org/patent/us/8521818/facebook-share-button) — A system that reads your social media posts to figure out your intent, then automatically serves ads or updates your profile based on how likely you are to actually buy or do something. - [How Digital Assistants Control Apps and Ask for More Information](https://patentbrief.org/patent/us/11204787/github-copilot-code-generation-ai) — This patent describes how a digital assistant on a device can understand what a user wants from a natural language command, find the right app, get a step-by-step guide from another device, and then ask the user for more details on the screen to complete the task with that app.