US 2026/0299996 A1 · METHOD AND SYSTEM FOR STREAMING TRANSMISSION

Abstract

This disclosure provides a method and a system for streaming transmission. The method includes: receiving a request from a client and establishing a task based on the request; calling a language model when executing the task to continuously generate multiple data fragments and storing these data fragments in a stream pool; receiving a query corresponding to the task from the client and determining whether the task is completed; in response to the task being completed, establishing a one-time connection with the client to send all the stored data fragments; and in response to the task not yet being completed, establishing a stream connection with the client to send an existing stored data fragments to the client, continuously receiving a subsequent data fragment from the language model, and transmitting the subsequent data fragment to the client through the stream connection.

Claims20

Dependent claims

A stream transmission method for a computer system, the stream transmission method comprising:

receiving a request from a client, and establishing a task according to the request;
when executing the task, a plurality of data fragments being generated continuously by calling a language model, and the plurality of data fragments being stored in a stream pool;
receiving a query corresponding to the task from the client, and determining whether the task is completed;
in response to the task being completed, establishing a one-time connection with the client to send the plurality of data fragments to the client;
and
in response to the task not yet being completed, establishing a stream connection with the client to send an existing stored data fragments to the client, and a subsequent data fragment being continuously received from the language model, and the subsequent data fragment being sent to the client through the stream connection.

3 more elements

A stream transmission system, comprising:

a client;
and
a server, communicatively connected to the client and configured to receive a request from the client, and establish a task according to the request,
wherein when executing the task, a plurality of data fragments are continuously generated by calling a language model via the server, and the plurality of data fragments are stored in a stream pool,
the server is configured to receive a query corresponding to the task from the client, and determine whether the task is completed,
in response to the task being completed, the server is configured to establish a one-time connection with the client to send the plurality of data fragments to the client,
in response to the task not yet being completed, the server is configured to establish a stream connection with the client to send an existing stored data fragments to the client, a subsequent data fragment is continuously received from the language model, and the subsequent data fragment is sent to the client through the stream connection.

4 more elements

Dependencies are inferred from the claim text.

Method and system for streaming transmission

Life of this patent

Method and system for streaming transmission

Life of this patent

Abstract

Claims20