# US 12,594,502 B2 · Content stream processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,594,502 B2
- Document ID: US12594502B2
- Status: Granted
- Kind: B2
- Application number: 18/201,591
- Filed: 2023-05-24
- Published: 2023-09-21
- Granted: 2026-04-07
- Earliest claimed: 2022-02-08
- Assignees: Tencent Technology (Shenzhen) Company Limited
- Applicants: Tencent Technology (Shenzhen) Company Limited
- Inventors: Zhidong Zhang; Liang Wang
- Web page: https://patentgrep.com/patent/US12594502B2

## CPC

- A63F 13/71: using secure communication between game devices and game servers, e.g. by encrypting game data or authenticating players
- A63F 13/355: Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
- H04L 67/131: Protocols for games, networked simulations or virtual reality
- H04L 67/75: Indicating network or usage conditions on the user display
- H04N 21/43074: {of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV programme}
- H04N 21/8547: involving timestamps for synchronizing content
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In a method for content stream processing, a coded content stream of a content stream is received from a server. Second trigger timing information of the coded content stream is obtained. The second trigger timing information is determined based on first trigger timing information of the content stream and stream time change information. The stream time change information indicates a timing change between the coded content stream and the content stream. The first trigger timing information indicates a target event in the content stream. The coded content stream is decoded. The decoded content stream is played back. When the decoded content stream is played to the target event indicated by the second trigger timing information, specified processing corresponding to the target event is performed.

## Claims

### Claim 1

A method for content stream processing, the method comprising:
receiving a coded content stream of a content stream from a server;
obtaining second trigger timing information of the coded content stream, the second trigger timing information being determined based on a combination of first trigger timing information of the content stream and stream time change information, the stream time change information indicating a timing change between a first time stamp of target frame information in the coded content stream and a second time stamp of the target frame information in the content stream, the first trigger timing information indicating a target event in the content stream, and the second trigger timing information indicating the target event in the coded content stream;
decoding the coded content stream;
playing back the decoded content stream; and
performing, when the decoded content stream is played to the target event indicated by the second trigger timing information, specified processing corresponding to the target event.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the obtaining the second trigger timing information comprises:
receiving the stream time change information and the first trigger timing information from the server; and
adjusting an event timing indicated by the first trigger timing information based on the stream time change information to obtain an event timing indicated by the second trigger timing information.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the adjusting the event timing indicated by the first trigger timing information comprises:
obtaining a time variation between the second time stamp and the first time stamp; and
adjusting the event timing indicated by the first trigger timing information according to the time variation.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the obtaining the second trigger timing information comprises:
receiving the second trigger timing information from the server, the second trigger timing information being determined by the server.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the specified processing includes displaying secondary content.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the specified processing includes at least one of displaying virtual resource information, displaying a specified special effect, inter-cutting content information, or displaying information.

### Claim 7 (depends on 1)

A non-transitory computer-readable storage medium, storing instructions, which when executed by a processor cause the processor to perform the method according to claim 1.

### Claim 8

A method for content stream processing, the method comprising:
performing event marking on a content stream to obtain first trigger timing information of a target event in the content stream;
coding the content stream to obtain a coded content stream, the coded content stream including second trigger timing information of the target event in the coded content stream;
obtaining stream time change information that indicates a timing change between a first time stamp of target frame information in the coded content stream and a second time stamp of the target frame information in the content stream; and
transmitting the coded content stream based on the first trigger timing information and the stream time change information, the second trigger timing information of the target event in the coded content stream being determined based on a combination of the first trigger timing information and the stream time change information.

### Claim 9 (depends on 8)

The method according to claim 8, wherein the transmitting the coded content stream comprises:
transmitting the first trigger timing information, the stream time change information, and the coded content stream.

### Claim 10 (depends on 8)

The method according to claim 8, wherein the transmitting the coded content stream comprises:
adjusting an event timing indicated by the first trigger timing information based on the stream time change information to determine an event timing indicated by the second trigger timing information; and
transmitting the second trigger timing information and the coded content stream.

### Claim 11 (depends on 8)

The method according to claim 8, wherein the event marking is performed by a neural network model, the neural network model being configured to determine the first trigger timing information based on content of the content stream.

### Claim 12 (depends on 8)

The method according to claim 8, wherein the obtaining the stream time change information comprises:
determining the first time stamp as the second time stamp corresponding to the target frame information of the coded content stream based on a type of the coding of the content stream being determined as a first specified co ding type.

### Claim 13 (depends on 8)

The method according to claim 8, wherein the obtaining the stream time change information comprises:
determining the second time stamp corresponding to the target frame information of the coded content stream according to synchronization time information based on a type of the coding of the content stream being determined as a second specified coding type.

### Claim 14 (depends on 8)

The method according to claim 8, wherein the obtaining the stream time change information comprises:
determining the second time stamp corresponding to the target frame information of the coded content stream according to time unit conversion information based on a type of the coding of the content stream being determined as a third specified coding type.

### Claim 15 (depends on 8)

A non-transitory computer-readable storage medium, storing instructions, which when executed by a processor cause the processor to perform the method according to claim 8.

### Claim 16

An information processing apparatus, comprising:
processing circuitry configured to:
receive a coded content stream of a content stream from a server;
obtain second trigger timing information of the coded content stream, the second trigger timing information being determined based on a combination of first trigger timing information of the content stream and stream time change information, the stream time change information indicating a timing change between a first time stamp of target frame information in the coded content stream and a second time stamp of the target frame information in the content stream, the first trigger timing information indicating a target event in the content stream, and the second trigger timing information indicating the target event in the coded content stream;
decode the coded content stream;
play back the decoded content stream; and
perform, when the decoded content stream is played to the target event indicated by the second trigger timing information, specified processing corresponding to the target event.

### Claim 17 (depends on 16)

The information processing apparatus according to claim 16, wherein the processing circuitry is configured to:
receive the stream time change information and the first trigger timing information from the server; and
adjust an event timing indicated by the first trigger timing information based on the stream time change information to obtain an event timing indicated by the second trigger timing information.

### Claim 18 (depends on 17)

The information processing apparatus according to claim 17, wherein the processing circuitry is configured to:
obtain a time variation between the second time stamp and the first time stamp; and
adjust the event timing indicated by the first trigger timing information according to the time variation.

### Claim 19 (depends on 16)

The information processing apparatus according to claim 16, wherein the processing circuitry is configured to:
receive the second trigger timing information from the server, the second trigger timing information being determined by the server.
