How Salesforce Speeds Up Data Processing Using Bulk Message Handling

A method for cloud systems to grab multiple tasks at once instead of one by one, using a locking mechanism to ensure data stays consistent during bulk processing.

What it covers

This patent describes a way for a computer system to handle large volumes of background tasks more efficiently. Instead of processing messages one at a time, the system uses a broker to push one task to a worker thread, which then pulls additional tasks from the queue to group them together. The system then attempts to 'lock' this entire group of tasks in a database simultaneously. If the lock is successful, the system processes all the messages in the group at once, which is much faster than individual processing. If the lock fails, the system puts the messages back in the queue to try again later.

What it doesn't cover

• —Does not cover processing messages that do not require a database lock for synchronization.
• —Does not cover systems that lack a message broker or queue-based architecture.
• —Does not cover individual, non-bulk message processing methods.
• —Does not cover methods that do not use a relational database to verify record existence before locking.

The clever bit

The innovation lies in the 'pull' request from the thread to the broker to aggregate messages dynamically, combined with an atomic database lock check that ensures the system only processes a batch if all records are available and unlocked.

Why it matters

In large-scale cloud services like Salesforce, processing millions of user requests individually creates a massive bottleneck. This patent provides a specific architectural pattern to increase throughput by reducing the number of database transactions required. It is a foundational technique for maintaining performance in multi-tenant environments where many customers share the same infrastructure.

Real-world examples

• 1.Salesforce background job processing
• 2.High-volume enterprise message queues
• 3.Cloud-based asynchronous task runners