{
  "patent_number": "US 11989527",
  "country": "US",
  "title": "How a Computer System Checks and Improves AI Text",
  "original_title": "Computer implemented methods for the automated analysis or use of data, including use of a large language model",
  "summary": "This patent describes a method where a separate computer system, using structured knowledge, checks and corrects the output from a large language model to make it more accurate and consistent.",
  "what_it_does": "The patent describes a computer-implemented method to improve the output of a large language model (LLM). First, the LLM generates an initial response, called \"first output\" (Claim 1a). Then, a separate \"processing system\" steps in. This system uses a special, structured, machine-readable language where ideas are represented as \"semantic nodes\" and \"semantic links\" (Claim 1b). These nodes and links can represent specific meanings, reasoning steps, and even computation units. The processing system translates the LLM's initial output into this structured language and \"verifies\" it for accuracy and consistency using its internal knowledge (Claim 1c, 17). For example, it might check if facts are correct or if the logic makes sense. If issues are found, the processing system creates \"second input data\" which includes the verified or corrected information. This \"second input data\" is then sent back to the LLM, often as part of a new prompt, to guide the LLM to generate an \"improved first output\" (Claim 1d). This iterative process aims to make the LLM's final response more factually accurate, logically consistent, and less biased (Claims 5-8).",
  "what_it_does_not_cover": [
    "Does not cover LLMs that improve their own output without an external \"processing system\" using a structured, machine-readable language.",
    "Does not cover systems where the external processing system does not represent semantic nodes, semantic links, reasoning steps, and computation units in its machine-readable language.",
    "Does not cover methods where the LLM's first output is not translated into the machine-readable language for verification.",
    "Does not cover systems that only verify LLM output without feeding verified or corrected information back to the LLM to generate an improved output.",
    "Does not cover basic prompt engineering or fine-tuning an LLM if it doesn't involve the specific verification and feedback loop with a structured knowledge system.",
    "Does not cover using an external system that merely filters or edits LLM output without representing it in semantic nodes and feeding it back to the LLM."
  ],
  "filed": "2023-04-17",
  "granted": "2024-05-21",
  "expires": "2043-04-17",
  "status": "active",
  "holder": "Unlikely Artificial Intelligence",
  "holder_url": "https://patentbrief.org/company/unlikely-artificial-intelligence",
  "inventors": [
    {
      "name": "Robert Heywood",
      "url": "https://patentbrief.org/inventor/robert-heywood"
    },
    {
      "name": "Paul BENN",
      "url": "https://patentbrief.org/inventor/paul-benn"
    },
    {
      "name": "Duncan REYNOLDS",
      "url": "https://patentbrief.org/inventor/duncan-reynolds"
    },
    {
      "name": "Ziyi Zhu",
      "url": "https://patentbrief.org/inventor/ziyi-zhu"
    },
    {
      "name": "Seth WARREN",
      "url": "https://patentbrief.org/inventor/seth-warren"
    },
    {
      "name": "Ayush Shah",
      "url": "https://patentbrief.org/inventor/ayush-shah"
    },
    {
      "name": "William Tunstall-Pedoe",
      "url": "https://patentbrief.org/inventor/william-tunstall-pedoe"
    },
    {
      "name": "Luci KRNIC",
      "url": "https://patentbrief.org/inventor/luci-krnic"
    }
  ],
  "times_cited": 4,
  "tags": [
    "ai_ml",
    "software",
    "telecommunications",
    "consumer_electronics"
  ],
  "abstract": "Methods are provided, such as a method of interacting with a large language model (LLM), including the step of a processing system using a structured, machine-readable representation of data that conforms to a machine-readable language, such as a universal language, to provide new context data for the LLM, in order to improve the output, such as continuation text output, generated by the LLM in response to a prompt; and such as a method of interacting with a LLM, including the step of providing continuation data generated by the LLM to a processing system that uses a structured, machine-readable representation of data that conforms to a machine-readable language, such as a universal language, in which the processing system is configured to analyse the continuation output generated by the LLM in response to a prompt to enable an improved version of that continuation output to be provided to a user. Related computer systems are provided.",
  "url": "https://patentbrief.org/patent/us/11989527/computer-implemented-methods-for-the-automated-analysis-or-use-of-data-including-11989527",
  "markdown_url": "https://patentbrief.org/patent/us/11989527/computer-implemented-methods-for-the-automated-analysis-or-use-of-data-including-11989527/md",
  "google_patents_url": "https://patents.google.com/patent/US11989527",
  "relatedPatents": [
    {
      "patentNumber": "12073180",
      "countryCode": "US",
      "title": "How a Computer System Fact-Checks AI Language Models",
      "url": "https://patentbrief.org/patent/us/12073180/computer-implemented-methods-for-the-automated-analysis-or-use-of-data-including-12073180"
    },
    {
      "patentNumber": "12067362",
      "countryCode": "US",
      "title": "How a Computer System Improves Large Language Model Output with Structured Data",
      "url": "https://patentbrief.org/patent/us/12067362/computer-implemented-methods-for-the-automated-analysis-or-use-of-data-including-12067362"
    },
    {
      "patentNumber": "12353827",
      "countryCode": "US",
      "title": "Using Non-AI Systems to Improve AI Text Generation",
      "url": "https://patentbrief.org/patent/us/12353827/computer-implemented-methods-for-the-automated-analysis-or-use-of-data-including"
    },
    {
      "patentNumber": "12299406",
      "countryCode": "US",
      "title": "How AI Checks Documents for Policy Rules and Compliance",
      "url": "https://patentbrief.org/patent/us/12299406/large-language-model-artificial-intelligence-text-evaluation-system"
    },
    {
      "patentNumber": "12307349",
      "countryCode": "US",
      "title": "How an AI System Answers Financial Questions Using Specialized Bots",
      "url": "https://patentbrief.org/patent/us/12307349/systems-and-methods-of-large-language-model-driven-orchestration-of-task-specifi"
    }
  ]
}