# How to Automatically Expand Neural Networks by Adding New Nodes

> A method for growing artificial intelligence models by identifying underperforming parts of a network and adding new nodes based on the behavior of existing ones.

- **Patent:** US 10832138
- **Original title:** Method and apparatus for extending neural network
- **Owner:** Samsung Electronics Co Ltd
- **Granted:** 2020
- **Status:** Active
- **Times cited:** 3
- **Field:** ai_ml, consumer_electronics, semiconductors

## What it does

This patent describes a way to make neural networks smarter by letting them grow dynamically. Instead of building a fixed-size model, the system monitors how often nodes 'fire' (activation frequency) and how consistently they behave (activation entropy). When the network hits a performance plateau, the processor identifies a specific node that needs help and adds a new one to that layer. The new node inherits some of its connection weights from the original node, while the rest are set to initial values, allowing the network to adapt to new data without starting training from scratch.

## What it does NOT cover

- Does not cover static neural networks that do not add nodes during or after training.
- Does not cover methods of network expansion that rely on random weight initialization for all new nodes.
- Does not cover pruning or shrinking techniques that remove nodes without adding new ones.
- Does not cover hardware-specific implementations that do not use activation frequency or entropy as selection criteria.

## The clever bit

The system uses 'activation entropy'—a measure of how often a node flips between active and inactive states—as a key metric to decide where to expand, rather than just looking at raw performance metrics.

## Real-world examples

1. Adaptive deep learning models for mobile devices
2. Dynamic neural network architectures in edge computing
3. On-device AI model optimization

## Why it matters

Training large AI models is computationally expensive and time-consuming. By allowing a network to grow only where it is needed, this method offers a way to improve model accuracy while potentially saving resources compared to training massive, static models from the ground up. It represents a shift toward more efficient, adaptive machine learning architectures.

## Frequently asked questions

### What does How to Automatically Expand Neural Networks by Adding New Nodes cover?

A method for growing artificial intelligence models by identifying underperforming parts of a network and adding new nodes based on the behavior of existing ones.

### Who owns patent US 10832138?

Samsung Electronics Co Ltd owns this patent, granted in 2020.

### When does this patent expire?

This patent is expected to expire on November 10, 2040, when the invention enters the public domain.

### What is patent US 10832138 cited by?

This patent has been cited by 3 later patents that build on its ideas.

### What problem does this patent solve?

Training large AI models is computationally expensive and time-consuming. By allowing a network to grow only where it is needed, this method offers a way to improve model accuracy while potentially saving resources compared to training massive, static models from the ground up. It represents a shift toward more efficient, adaptive machine learning architectures.

### What does this patent NOT cover?

Does not cover static neural networks that do not add nodes during or after training.

**Full plain-English explainer:** https://patentbrief.org/patent/us/10832138/gpt-language-model-pre-training

**Original patent:** https://patents.google.com/patent/US10832138

---

_Source: PatentBrief — https://patentbrief.org. Patent facts are from public records; the plain-English explanation is PatentBrief's._