# US 12,003,732 B2 · Scene aware video content encoding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,003,732 B2
- Document ID: US12003732B2
- Status: Granted
- Kind: B2
- Application number: 17/963,924
- Filed: 2022-10-11
- Published: 2023-06-22
- Granted: 2024-06-04
- Earliest claimed: 2020-03-30
- Assignees: Alibaba Group Holding Limited
- Applicants: Alibaba Group Holding Limited
- Inventors: Tae Meon Bae; Minghai Qin; Guanlin Wu; Yen-Kuang Chen; Qinggang Zhou; Shaolin Xie
- Web page: https://patentgrep.com/patent/US12003732B2

## CPC

- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- A63F 13/355: Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- H04N 19/102: characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N 19/103: Selection of coding mode or of prediction mode
- H04N 19/124: Quantisation
- H04N 19/164: Feedback from the receiver or from the transmission channel
- H04N 19/179: the unit being a scene or a shot
- H04N 21/2407: {Monitoring of transmitted content, e.g. distribution time, number of downloads (arrangements for monitoring programmes for broadcast or for distribution combined with broadcast H04H20/14)}
- H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- A63F 2300/534: for network load management, e.g. bandwidth optimization, latency reduction
- A63F 2300/538: for performing operations on behalf of the game client, e.g. rendering
- G06V 2201/10: Recognition assisted with metadata
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Scene aware video content encoding techniques can determine if video content is a given content type and is one of one or more given titles that include one or more given scenes. The one or more given scenes of the video content of the given type and given one of the titles can be encoded using corresponding scenes specific encoding parameter values, and the non-given scenes can be encoded using one or more general encoding parameter values. The one or more given titles can be selected based on a rate of streaming of various video content titles of the given type.

## Claims

### Claim 1

A computing system, comprising:
one or more processors;
one or more non-transitory computing device readable storage medium storing computing executable instructions that when executed by the one or more processors perform a method comprising:
determining video content is one of one or more predetermined content titles for a given type of video content;
determining the video content includes one or more predetermined scenes for the one or more predetermined content titles; and
selecting encoding parameters for encoding the one or more predetermined scenes of the one or more predetermined content titles of the given type of video content; and
a video encoder configured to encode the one or more predetermined scenes of the one or more predetermined content titles of the given type of video content to generate encoded video content, based on the video content and the selected encoding parameters.

### Claim 2 (depends on 1)

The computing system of claim 1, wherein the method further comprises determining the video content is the given type of video content.

### Claim 3 (depends on 1)

The computing system of claim 1, wherein the video encoder is further configured to compress data of the video content using the selected encoding parameters to generate the encoded video content.

### Claim 4 (depends on 2)

The computing system of claim 2, wherein:
determining the video content is the given type of video content includes analyzing the video content using one or more artificial intelligence models to determine the given type of video content,
selecting the encoding parameters for encoding the one or more predetermined scenes is based on scene specific encoding parameters for corresponding ones of the one or more predetermined scenes, and
the scene specific encoding parameters are at least one of a target bitrate, a largest coding unit (LCU) size, and group of picture (GOP) length.

### Claim 5 (depends on 2)

The computing system of claim 2, wherein determining the video content is the given type of video content includes determining a type of video content from metadata of the video content.

### Claim 6 (depends on 2)

The computing system of claim 2, wherein the method further comprises:
selecting the encoding parameters based on default encoding parameters when the video content is not the given type of video content.

### Claim 7 (depends on 1)

The computing system of claim 1, wherein determining the video content is the one of one or more predetermined content titles includes analyzing the video content using one or more artificial intelligence models to determine a content title of the video content.

### Claim 8 (depends on 1)

The computing system of claim 1, wherein determining the video content is the one of one or more predetermined content titles includes determining a content title of the video content from metadata of the video content.

### Claim 9 (depends on 2)

The computing system of claim 2, wherein the method further comprises:
selecting the encoding parameters based on general parameters for the given type of video content when the video content is not the one of one or more predetermined content titles.

### Claim 10 (depends on 1)

The computing system of claim 1, wherein determining the video content includes the one or more predetermined scenes includes analyzing the video content using one or more artificial intelligence models to determine the one or more predetermined scenes.

### Claim 11 (depends on 1)

The computing system of claim 1, wherein determining the video content includes the one or more predetermined scenes includes determining the one or more predetermined scenes from metadata of the video content.

### Claim 12 (depends on 2)

The computing system of claim 2, wherein the method further comprises:
selecting encoding parameters for encoding one or more non-predetermined scenes of the video content based on general encoding parameters when the video content is one of the one or more non-predetermined scenes.

### Claim 13 (depends on 12)

The computing system of claim 12, wherein selecting the encoding parameters for encoding the one or more predetermined scenes of the one or more predetermined content titles of the given type of video content comprises determining the selected encoding parameters from a mapping of the one or more predetermined scenes of the one or more predetermined content titles of the given type of video content to corresponding sets of one or more scene specific encoding parameter values.

### Claim 14 (depends on 13)

The computing system of claim 13, wherein the mapping includes identifiers of the one or more predetermined content titles, identifiers of the one or more predetermined scenes of the one or more predetermined content titles, and sets of scene specific encoding parameter values for corresponding scenes of corresponding content titles.

### Claim 15

A video encoding method, comprising:
determining video content is one of one or more given titles including one or more given scenes for one or more predetermined content titles; and
encoding the one or more given scenes of the video content and the one of the one or more given titles using corresponding one or more scene specific encoding parameter values.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
determining the video content is a given type of video content; and
determining the video content of the given type is the one of one or more given titles for the given type of video content.

### Claim 17 (depends on 16)

The method of claim 16, wherein determining the video content is the given type of video content includes determining a type of video content from metadata of the video content or from an analysis of the video content.

### Claim 18 (depends on 16)

The method of claim 16, wherein:
the corresponding one or more scene specific encoding parameter values for encoding the one or more given scenes of the video content comprises determining the corresponding one or more scene specific encoding parameter values from a mapping of the one or more given scenes of the one or more given titles of the given type of video content to corresponding sets of one or more scene specific encoding parameter values, and
the scene specific encoding parameters are at least one of a target bitrate, a largest coding unit (LCU) size, and group of picture (GOP) length.

### Claim 19 (depends on 18)

The method of claim 18, wherein the mapping includes identifiers of the one or more given titles, identifiers of the one or more given scenes of the one or more given titles, and sets of scene specific encoding parameter values for corresponding scenes of corresponding given titles.

### Claim 20 (depends on 16)

The method of claim 16, further comprising:
encoding the video content using one or more default encoding parameter values when the video content is not the given type of video content.
