# Improving AI Language Understanding with Aligned Knowledge Graphs

> This patent describes a method for making AI language models smarter by combining them with knowledge modules, which learn from two different, but related, knowledge graphs.

- **Patent:** US 11798529
- **Original title:** Generation of optimized knowledge-based language model through knowledge graph multi-alignment
- **Owner:** Microsoft Technology Licensing
- **Granted:** 2023
- **Status:** Active
- **Times cited:** 3
- **Field:** ai_ml, software, telecommunications, consumer_electronics

## What it does

This patent details a computer-implemented method to enhance how AI understands language by jointly training a language module with a knowledge module. First, it obtains two separate knowledge graphs, each containing entities (like people or places) and relations (how they connect), as described in Claim 1. It then aligns these two graphs, finding where entities and relations in one graph match those in the other. A language module, which creates numerical representations (embeddings) for words and concepts, and a knowledge module are accessed. The knowledge module is trained using these embeddings. Crucially, the language and knowledge modules are integrated so they can exchange information: the knowledge module gives 'knowledge information input' to the language module, and the language module provides 'context information input' to the knowledge module, as stated in Claim 1. This integrated system is then further trained using the aligned knowledge graphs to perform 'semantic analysis' for entities and relations, meaning it understands their meaning and relationships better. For example, Claim 4 describes using this system to translate speech from one language to another, leveraging the combined knowledge.

## What it does NOT cover

- Does not cover training a language model without explicitly integrating it with a separate, dedicated knowledge module.
- Does not cover systems that use only a single knowledge graph, as it specifies obtaining and aligning a 'first knowledge graph' with a 'second knowledge graph'.
- Does not cover language models where the knowledge module and language module do not actively exchange information in a two-way flow, providing input to each other.
- Does not cover language understanding systems that do not perform 'semantic analysis for the entities and entity relations' based on learned knowledge.
- Does not cover simple machine translation or speech transcription without the underlying joint training and knowledge graph alignment described.

## The clever bit

The novelty lies in the 'joint training' and 'integration' of the language and knowledge modules, where they continuously feed information to each other. This creates a powerful feedback loop, allowing the language module to benefit from structured knowledge and the knowledge module to benefit from contextual language understanding, all while leveraging insights from 'multi-aligned' knowledge graphs.

## Real-world examples

1. Advanced search engines that understand complex queries
2. Smart virtual assistants like Microsoft Copilot or Google Assistant
3. Enterprise AI systems for analyzing company-specific documents
4. Cross-lingual information retrieval systems
5. Automated content summarization tools

## Why it matters

Understanding language is a core challenge for AI. This patent offers a way to make AI systems much better at grasping meaning by giving them structured knowledge, not just statistical patterns from text. By combining language models with knowledge graphs, AI can move beyond just predicting the next word to truly understanding facts and relationships. This is vital for creating more accurate virtual assistants, search engines, and specialized AI tools that can reason about information.

## Frequently asked questions

### What does Improving AI Language Understanding with Aligned Knowledge Graphs cover?

This patent describes a method for making AI language models smarter by combining them with knowledge modules, which learn from two different, but related, knowledge graphs.

### Who owns patent US 11798529?

Microsoft Technology Licensing owns this patent, granted in 2023.

### When does this patent expire?

This patent is expected to expire on May 18, 2041, when the invention enters the public domain.

### What is patent US 11798529 cited by?

This patent has been cited by 3 later patents that build on its ideas.

### What problem does this patent solve?

Understanding language is a core challenge for AI. This patent offers a way to make AI systems much better at grasping meaning by giving them structured knowledge, not just statistical patterns from text. By combining language models with knowledge graphs, AI can move beyond just predicting the next word to truly understanding facts and relationships. This is vital for creating more accurate virtual assistants, search engines, and specialized AI tools that can reason about information.

### What does this patent NOT cover?

Does not cover training a language model without explicitly integrating it with a separate, dedicated knowledge module.

**Full plain-English explainer:** https://patentbrief.org/patent/us/11798529/generation-of-optimized-knowledge-based-language-model-through-knowledge-graph-m

**Original patent:** https://patents.google.com/patent/US11798529

---

_Source: PatentBrief — https://patentbrief.org. Patent facts are from public records; the plain-English explanation is PatentBrief's._


## Related patents

Semantically similar inventions in the PatentBrief corpus:

- [How AI Connects Different Databases Using Knowledge Graphs](https://patentbrief.org/patent/us/11507851/system-and-method-of-integrating-databases-based-on-knowledge-graph) — This patent describes a server-based method that uses artificial intelligence and two learning models to automatically find and integrate connections between data fields and data values across multiple databases that have different structures.
- [How to Combine Information from Multiple Knowledge Graphs](https://patentbrief.org/patent/us/20240144032/knowledge-graph-data-fusion) — This patent describes a method for merging information from two or more existing knowledge graphs into a single, unified knowledge graph, using special rules called "graph operators."
- [How a Computer System Checks and Improves AI Text](https://patentbrief.org/patent/us/11989527/computer-implemented-methods-for-the-automated-analysis-or-use-of-data-including-11989527) — This patent describes a method where a separate computer system, using structured knowledge, checks and corrects the output from a large language model to make it more accurate and consistent.
- [How a Computer System Fact-Checks AI Language Models](https://patentbrief.org/patent/us/12073180/computer-implemented-methods-for-the-automated-analysis-or-use-of-data-including-12073180) — This patent describes a method for a separate computer system to fact-check and improve the output of a large language model by translating its text into a structured, machine-readable format.
- [How a Computer System Improves Large Language Model Output with Structured Data](https://patentbrief.org/patent/us/12067362/computer-implemented-methods-for-the-automated-analysis-or-use-of-data-including-12067362) — This patent describes a method where a separate computer system analyzes and refines the initial output from a large language model (LLM) by translating it into a highly structured, machine-readable language to reduce bias and improve accuracy.
