# How a Computer System Checks and Improves AI Text > This patent describes a method where a separate computer system, using structured knowledge, checks and corrects the output from a large language model to make it more accurate and consistent. - **Patent:** US 11989527 - **Original title:** Computer implemented methods for the automated analysis or use of data, including use of a large language model - **Owner:** Unlikely Artificial Intelligence - **Granted:** 2024 - **Status:** Active - **Times cited:** 4 - **Field:** ai_ml, software, telecommunications, consumer_electronics ## What it does The patent describes a computer-implemented method to improve the output of a large language model (LLM). First, the LLM generates an initial response, called "first output" (Claim 1a). Then, a separate "processing system" steps in. This system uses a special, structured, machine-readable language where ideas are represented as "semantic nodes" and "semantic links" (Claim 1b). These nodes and links can represent specific meanings, reasoning steps, and even computation units. The processing system translates the LLM's initial output into this structured language and "verifies" it for accuracy and consistency using its internal knowledge (Claim 1c, 17). For example, it might check if facts are correct or if the logic makes sense. If issues are found, the processing system creates "second input data" which includes the verified or corrected information. This "second input data" is then sent back to the LLM, often as part of a new prompt, to guide the LLM to generate an "improved first output" (Claim 1d). This iterative process aims to make the LLM's final response more factually accurate, logically consistent, and less biased (Claims 5-8). ## What it does NOT cover - Does not cover LLMs that improve their own output without an external "processing system" using a structured, machine-readable language. - Does not cover systems where the external processing system does not represent semantic nodes, semantic links, reasoning steps, and computation units in its machine-readable language. - Does not cover methods where the LLM's first output is not translated into the machine-readable language for verification. - Does not cover systems that only verify LLM output without feeding verified or corrected information back to the LLM to generate an improved output. - Does not cover basic prompt engineering or fine-tuning an LLM if it doesn't involve the specific verification and feedback loop with a structured knowledge system. - Does not cover using an external system that merely filters or edits LLM output without representing it in semantic nodes and feeding it back to the LLM. ## The clever bit The clever bit is using a separate, symbolic reasoning system, which understands structured, machine-readable knowledge and logic, to verify and correct the statistical, pattern-based output of an LLM. This combines the LLM's generative power with a robust, verifiable knowledge base, creating a feedback loop that improves accuracy and consistency rather than just filtering output. ## Real-world examples 1. AI assistants that provide fact-checked answers 2. Automated legal research tools verifying case summaries 3. Medical diagnostic aids cross-referencing patient data with established knowledge 4. Financial analysis tools validating market reports 5. Content generation platforms ensuring factual accuracy in articles ## Why it matters Large language models sometimes "hallucinate" or generate factually incorrect or inconsistent information. This patent addresses a core problem in making LLMs reliable for critical applications. By introducing a structured, verifiable feedback loop, it aims to make LLM outputs trustworthy. This approach could be crucial for industries requiring high accuracy, such as scientific research, legal analysis, or financial reporting, where errors from AI could have significant consequences. It provides a mechanism to ground LLM responses in verifiable knowledge. ## Frequently asked questions ### What does How a Computer System Checks and Improves AI Text cover? This patent describes a method where a separate computer system, using structured knowledge, checks and corrects the output from a large language model to make it more accurate and consistent. ### Who owns patent US 11989527? Unlikely Artificial Intelligence owns this patent, granted in 2024. ### When does this patent expire? This patent is expected to expire on April 17, 2043, when the invention enters the public domain. ### What is patent US 11989527 cited by? This patent has been cited by 4 later patents that build on its ideas. ### What problem does this patent solve? Large language models sometimes "hallucinate" or generate factually incorrect or inconsistent information. This patent addresses a core problem in making LLMs reliable for critical applications. By introducing a structured, verifiable feedback loop, it aims to make LLM outputs trustworthy. This approach could be crucial for industries requiring high accuracy, such as scientific research, legal analysis, or financial reporting, where errors from AI could have significant consequences. It provides a mechanism to ground LLM responses in verifiable knowledge. ### What does this patent NOT cover? Does not cover LLMs that improve their own output without an external "processing system" using a structured, machine-readable language. **Full plain-English explainer:** https://patentbrief.org/patent/us/11989527/computer-implemented-methods-for-the-automated-analysis-or-use-of-data-including-11989527 **Original patent:** https://patents.google.com/patent/US11989527 --- _Source: PatentBrief — https://patentbrief.org. Patent facts are from public records; the plain-English explanation is PatentBrief's._ ## Related patents Semantically similar inventions in the PatentBrief corpus: - [How a Computer System Fact-Checks AI Language Models](https://patentbrief.org/patent/us/12073180/computer-implemented-methods-for-the-automated-analysis-or-use-of-data-including-12073180) — This patent describes a method for a separate computer system to fact-check and improve the output of a large language model by translating its text into a structured, machine-readable format. - [How a Computer System Improves Large Language Model Output with Structured Data](https://patentbrief.org/patent/us/12067362/computer-implemented-methods-for-the-automated-analysis-or-use-of-data-including-12067362) — This patent describes a method where a separate computer system analyzes and refines the initial output from a large language model (LLM) by translating it into a highly structured, machine-readable language to reduce bias and improve accuracy. - [Using Non-AI Systems to Improve AI Text Generation](https://patentbrief.org/patent/us/12353827/computer-implemented-methods-for-the-automated-analysis-or-use-of-data-including) — This patent describes a method where a traditional, rule-based computer system helps a Large Language Model (LLM) generate more accurate and reliable text by providing it with better context and fact-checking. - [How AI Checks Documents for Policy Rules and Compliance](https://patentbrief.org/patent/us/12299406/large-language-model-artificial-intelligence-text-evaluation-system) — This patent describes a system where an AI model helps evaluate parts of a document against specific rules or policies given in plain language, then identifies problems or suggests fixes to ensure compliance. - [How an AI System Answers Financial Questions Using Specialized Bots](https://patentbrief.org/patent/us/12307349/systems-and-methods-of-large-language-model-driven-orchestration-of-task-specifi) — This patent describes an AI system where a large language model (LLM) directs specialized machine learning agents to answer natural language questions about financial data, then refines the answers using an adversarial AI.