# US 2021/0342969 A1 · Apparatus and method for multi-adapter encoding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342969 A1
- Document ID: US20210342969A1
- Status: Published application
- Kind: A1
- Application number: 17/376,713
- Filed: 2021-07-15
- Published: 2021-11-04
- Earliest claimed: 2019-12-27
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Changliang Wang; Penne Lee; Dmitry Ermilov
- Web page: https://patentgrep.com/patent/US20210342969A1

## CPC

- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06T 1/60: Memory management
- G06F 3/1431: {using a single graphics controller}
- G06F 9/30145: {Instruction analysis, e.g. decoding, instruction word fields}
- G06F 9/3885: {using a plurality of independent parallel functional units}
- G06F 15/80: comprising an array of processing units with common control, e.g. single instruction multiple data processors (G06F15/82 takes precedence {; for correlation function computation G06F17/15})
- G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00)
- G09G 5/005: {Adapting incoming signals to the display format of the display terminal}
- G09G 5/363: {Graphics controllers}
- H04N 19/149: by estimating the code amount by means of a model, e.g. mathematical model or statistical model
- H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence)
- H04N 19/439: {using cascaded computational arrangements for performing a single operation, e.g. filtering}
- H04N 19/61: in combination with predictive coding
- G09G 2340/0435: Change or adaptation of the frame rate of the video stream
- G09G 2360/02: Graphics controller able to handle multiple formats, e.g. input or output formats
- G09G 2360/06: Use of more than one graphics processor to process data before displaying to one or more screens
- G09G 2360/10: Display system comprising arrangements, such as a coprocessor, specific for motion video images
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An apparatus and method for multi-adapter and/or multi-pass encoding on dual graphics processors. For example, one embodiment of a processor comprises: a central processor integrated on a first die, the central processor comprising a plurality of cores to execute instructions and process data; an first graphics processor integrated on the first die, the first graphics processor comprising media processing circuitry to perform one or more preliminary lookahead operations on video content to generate lookahead statistics; an interconnect to couple the first graphics processor to a lookahead buffer, the first graphics processor to transmit the lookahead statistics over the interconnect to the lookahead buffer; wherein the lookahead statistics are to be used by a second graphics processor to encode the video content to generate encoded video.

## Claims

### Claim 1

An apparatus comprising:
a first graphics processor integrated on a first die with a central processor to parse a video bitstream to identify groups of pictures including a first group of pictures (GOP) and a second GOP, the second GOP comprising a next GOP in the video bitstream after the first GOP, the first graphics processor further to copy the first GOP to a video memory local to a second graphics processor located off the first die; and
the second graphics processor to access and transcode the first GOP in the video memory to generate a first compressed bitstream in parallel with the first graphics processor transcoding the second GOP to generate a second compressed bitstream, the second graphics processor further to copy the first compressed bitstream to a system memory,
wherein the first graphics processor is to stitch the first and the second compressed bitstreams to generate a final bitstream.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the second graphics processor comprises a decoder to decode the first GOP encoded in a first encoding format to generate a first sequence of video frames and an encoder to encode the first sequence of video frames in accordance with a second encoding format to generate the first compressed bitstream.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the first graphics processor comprises a decoder to decode the second GOP encoded in the first encoding format to generate a second sequence of video frames and an encoder to encode the second sequence of video frames in accordance with the second encoding format to generate the second compressed bitstream.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the encoder of the first graphics processor and/or the encoder of the second graphics processor is to determine a quantization parameter of a current GOP being encoded based, at least in part, on bitrates of all previous GOPs.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the central processor is coupled to the first graphics processor and comprises a plurality of cores to execute instructions and process data.

### Claim 6 (depends on 1)

The apparatus of claim 1 further comprising:
a memory controller coupled to the first graphics processor on the first die, the memory controller to couple the first graphics processor to the system memory, wherein the video bitstream is stored on the system memory.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the first graphics processor is further to identify a third GOP and a plurality of mini GOPs within the third GOP.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the first graphics processor is to copy one or more frames associated with a mini GOP within the third GOP to the second graphics processor for transcoding.

### Claim 9

A method comprising:
parsing a video bitstream on a first graphics processor integrated on a first die with a central processor to identify groups of pictures including a first group of pictures (GOP) and a second GOP, the second GOP comprising a next GOP in the video bitstream after the first GOP;
copying the first GOP to a video memory local to a second graphics processor located off the first die;
accessing and transcoding, by the second graphics processor, the first GOP in the video memory to generate a first compressed bitstream in parallel with the first graphics processor transcoding the second GOP to generate a second compressed bitstream;
copying, by the second graphics processor, the first compressed bitstream to a system memory; and
stitching, by the first graphics processor, the first and the second compressed bitstreams to generate a final bitstream.

### Claim 10 (depends on 9)

The method of claim 9, wherein transcoding the first GOP by the second processor comprises:
decoding, by a decoder of the second graphics processor, the first GOP encoded in a first encoding format to generate a first sequence of video frames; and
encoding, by an encoder of the second graphics processor, the first sequence of video frames in accordance with a second encoding format to generate the first compressed bitstream.

### Claim 11 (depends on 10)

The method of claim 10, wherein transcoding the second GOP by the first processor comprises:
decoding, by a decoder of the first graphics processor, the second GOP encoded in the first encoding format to generate a second sequence of video frames; and
encoding, by an encoder of the second graphics processor, the second sequence of video frames in accordance with the second encoding format to generate the second compressed bitstream.

### Claim 12 (depends on 10)

The method of claim 10, further comprising:
determining, by the encoder of the first graphics processor and/or the encoder of the second graphics processor, a quantization parameter of a current GOP being encoded based, at least in part, on bitrates of all previous GOPs.

### Claim 13 (depends on 9)

The method of claim 9, wherein the central processor is coupled to the first graphics processor and comprises a plurality of cores to execute instructions and process data.

### Claim 14 (depends on 9)

The method of claim 9, further comprising:
storing the video bitstream in the system memory, wherein the system memory is coupled to the first graphics processor through a memory controller located on the first die.

### Claim 15 (depends on 9)

The method of claim 9, further comprising:
identifying a third GOP and a plurality of mini GOPs within the third GOP.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
copying one or more frames associated with a mini GOP within the third GOP to the second graphics processor for transcoding.

### Claim 17

A non-transitory machine-readable medium having program code stored thereon which, when executed by a machine, causes the machine to perform operations of:
parsing a video bitstream on a first graphics processor integrated on a first die with a central processor to identify groups of pictures including a first group of pictures (GOP) and a second GOP, the second GOP comprising a next GOP in the video bitstream after the first GOP;
copying the first GOP to a video memory local to a second graphics processor located off the first die;
accessing and transcoding, by the second graphics processor, the first GOP in the video memory to generate a first compressed bitstream in parallel with the first graphics processor transcoding the second GOP to generate a second compressed bitstream;
copying, by the second graphics processor, the first compressed bitstream to a system memory; and
stitching, by the first graphics processor, the first and the second compressed bitstreams to generate a final bitstream.

### Claim 18 (depends on 17)

The non-transitory machine-readable medium of claim 17, wherein transcoding the first GOP by the second processor comprises:
decoding, by a decoder of the second graphics processor, the first GOP encoded in a first encoding format to generate a first sequence of video frames; and
encoding, by an encoder of the second graphics processor, the first sequence of video frames in accordance with a second encoding format to generate the first compressed bitstream.

### Claim 19 (depends on 18)

The non-transitory machine-readable medium of claim 18, wherein transcoding the second GOP by the first processor comprises:
decoding, by a decoder of the first graphics processor, the second GOP encoded in the first encoding format to generate a second sequence of video frames; and
encoding, by an encoder of the second graphics processor, the second sequence of video frames in accordance with the second encoding format to generate the second compressed bitstream.

### Claim 20 (depends on 18)

The non-transitory machine-readable medium of claim 18, wherein the operations further comprise:
determining, by the encoder of the first graphics processor and/or the encoder of the second graphics processor, a quantization parameter of a current GOP being encoded based, at least in part, on bitrates of all previous GOPs.

### Claim 21 (depends on 17)

The non-transitory machine-readable medium of claim 17, wherein the central processor is coupled to the first graphics processor and comprises a plurality of cores to execute instructions and process data.

### Claim 22 (depends on 17)

The non-transitory machine-readable medium of claim 17, wherein the operations further comprise:
storing the video bitstream in the system memory, wherein the system memory is coupled to the first graphics processor through a memory controller located on the first die.

### Claim 23 (depends on 17)

The non-transitory machine-readable medium of claim 17, wherein the operations further comprise:
identifying a third GOP and a plurality of mini GOPs within the third GOP.

### Claim 24 (depends on 23)

The non-transitory machine-readable medium of claim 23, wherein the operations further comprise:
copying one or more frames associated with a mini GOP within the third GOP to the second graphics processor for transcoding.
