# US 11,451,648 B2 · Multimedia communication bridge

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,451,648 B2
- Document ID: US11451648B2
- Status: Granted
- Kind: B2
- Application number: 16/831,818
- Filed: 2020-03-27
- Published: 2020-07-23
- Granted: 2022-09-20
- Earliest claimed: 2018-01-22
- Assignees: Lattice Semiconductor Corporation
- Applicants: Lattice Semiconductor Corporation
- Inventors: Jiong Huang; Henry Tso; Hoon Choi
- Web page: https://patentgrep.com/patent/US11451648B2

## CPC

- G09G 5/10: Intensity circuits
- G09G 3/20: for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix {no fixed position being assigned to or needed to be assigned to the individual characters or partial characters}
- G09G 5/005: {Adapting incoming signals to the display format of the display terminal}
- G09G 5/006: {Details of the interface to the display terminal (specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04)}
- H04L 69/14: Multichannel or multilink protocols
- H04L 69/18: Multiprotocol handlers, e.g. single devices capable of handling multiple protocols
- H04L 69/22: Parsing or analysis of headers
- H04L 69/28: Timers or timing mechanisms used in protocols
- H04N 7/083: with signal insertion during the vertical and the horizontal blanking interval {, e.g. MAC data signals}
- H04N 21/43635: {HDMI}
- H04N 21/816: {involving special video data, e.g 3D video}
- G09G 2370/04: Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
- G09G 2370/12: Use of DVI or HDMI protocol in interfaces along the display data pipeline
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A bridge chip receives a first data stream compliant with the first multimedia communication standard. The first data stream includes first video data of a first incoming video frame, second video data of a second incoming video frame, and information describing a transfer function for the second video data, the information included in a video blanking interval of the first incoming video frame. The bridge chip extracts information describing a transfer function for the second video data. The bridge chip then generates a second data stream compliant with the second multimedia communication standard. The second data stream includes the first video data in a first outbound video frame, the second video data in a second outbound video frame, and the extracted information describing the transfer function for the second video data. Finally, the generated second data stream is transmitted to a destination device.

## Claims

### Claim 1

A device for converting a first data stream compliant with a first multimedia communication standard to a second data stream compliant with a second multimedia communication standard different from the first multimedia communication standard, wherein the first multimedia communication standard is a high-definition multimedia interface (HDMI) 2.0 standard, and the second multimedia communication standard is a HDMI 2.1 standard, the device comprising:
a depacketizer circuit configured to extract data from a non-video area of a first incoming video frame of the first data stream compliant with the first multimedia communication standard;
a buffer coupled to the depacketizer circuit, the buffer configured to receive the data extracted from the non-video area of the first incoming video frame and store the extracted data; and
a transmitter coupled to the buffer, the transmitter configured to receive the stored data from the buffer delayed by at least one frame, and at least video data of a second incoming video frame of the first data stream, the transmitter configured to generate an outgoing video frame for the second data stream compliant with the second multimedia communication standard by combining the received video data of the second incoming video frame and the received extracted data from the non-video area of the first incoming video frame.

### Claim 2 (depends on 1)

The device of claim 1, further comprising:
a packetizer coupled in between the buffer and the transmitter, the packetizer configured to generate a data packet compliant with the second multimedia communication standard, the generated data packet including the data stored in the buffer.

### Claim 3 (depends on 2)

The device of claim 2, wherein:
the depacketizer is configured to identify one or more packets having a first predefined header in the non-video area of the first incoming video frame, and extract a payload from the identified one or more packets; and
the packetizer is configured to generate one or more packets including the extracted data and a second predefined header, the second predefined header different than the first predefined header.

### Claim 4 (depends on 1)

The device of claim 1, wherein the data extracted by the depacketizer from the non-video area of the first incoming video frame describes a transfer function for color information of the video data of the second incoming video frame.

### Claim 5 (depends on 4)

The device of claim 4, wherein the transfer function corresponds to dynamic high-dynamic-range (D-HDR) data for the video data of the second incoming video frame.

### Claim 6 (depends on 4)

The device of claim 4, wherein the transfer function includes one of an S-Log3 electro-optical transfer function (EOTF), a perceptual quantizer (PQ) transfer function, and a hybrid log-gamma (HLG) transfer function.

### Claim 7 (depends on 1)

The device of claim 1, wherein the first and second data streams compliant with the first and second multimedia communication standards, respectively, are provided over wired connections.

### Claim 8 (depends on 1)

The device of claim 1, wherein the data extracted by the depacketizer is a feature that is supported by the second multimedia communication standard and is not supported by the first multimedia communication standard.

### Claim 9 (depends on 1)

The device of claim 1, wherein the extracted data is encoded in a vendor-specific infoframe (VSIF) of first incoming video frame of the first data stream.

### Claim 10 (depends on 1)

The device of claim 1, wherein:
in the first data stream, the extracted data is included in a vertical blanking interval of the first incoming video frame that precedes first video data in the first incoming video frame, or the extracted data is included in a horizontal blanking interval of the first incoming video frame, and
in the second data stream, the extracted data is included in a vertical blanking interval of the outgoing video frame that precedes the video data of the second incoming video frame.

### Claim 11

A method comprising:
receiving a first incoming video frame of a first data stream, the first incoming video frame compliant with a first multimedia communication standard, the first incoming video frame including first video data and first non-video data;
extracting at least a portion of the first non-video data from a non-video area of the first incoming video frame;
receiving a second incoming video frame of the first data stream, the second incoming video frame compliant with the first multimedia communication standard, the second incoming video frame including second video data and second non-video data; and
generating a second data stream compliant with a second multimedia communication standard different from the first multimedia communication standard, the second data stream including an outgoing video frame, the outgoing video frame including at least the second video data of the second incoming video frame and the extracted portion of the first non-video data of the first incoming video frame, wherein the first multimedia communication standard is a high-definition multimedia interface (HDMI) 2.0 standard, and the second multimedia communication standard is a HDMI 2.1 standard.

### Claim 12 (depends on 11)

The method of claim 11, wherein extracting at least a portion of the first non-video data from the non-video area of the first incoming video frame comprises:
identifying one or more packets in the non-video area of the first incoming video frame having a first predefined header, and
extracting a payload from the identified one or more packets.

### Claim 13 (depends on 12)

The method of claim 12, wherein generating a second data stream compliant with a second multimedia communication standard comprises:
generating one or more packets including the extracted portion of the first non-video data, the generated one or more packets having a second predefined header different than the first predefined header.

### Claim 14 (depends on 11)

The method of claim 11, wherein the portion of the first non-video data extracted from the non-video area of the first incoming video frame is encoded in a vendor-specific infoframe (VSIF) of the first incoming video frame of the first data stream.

### Claim 15 (depends on 11)

The method of claim 11, wherein:
in the first data stream, the extracted portion of the first non-video data is included in a vertical blanking interval of the first incoming video frame that precedes the first video data in the first incoming video frame, or the extracted portion of the first non-video data is included in a horizontal blanking interval of the first incoming video frame, and
in the second data stream, the extracted portion of the first non-video data is included in a vertical blanking interval of the outgoing video frame that precedes the second video data of the second incoming video frame.

### Claim 16 (depends on 11)

The method of claim 11, wherein the portion of the first non-video data extracted from a non-video area of the first incoming video frame describes a transfer function for color information of the second video data of the second incoming video frame.

### Claim 17 (depends on 16)

The method of claim 16, wherein the transfer function corresponds to dynamic high-dynamic-range (D-HDR) data for the video data of the second incoming video frame.

### Claim 18 (depends on 16)

The method of claim 16, wherein the transfer function includes one of an S-Log3 electro-optical transfer function (EOTF), a perceptual quantizer (PQ) transfer function, and a hybrid log-gamma (HLG) transfer function.

### Claim 19 (depends on 11)

The method of claim 11, wherein the first and second data streams compliant with the first and second multimedia communication standards, respectively, are provided over wired connections.

### Claim 20

A method comprising:
receiving a first incoming video frame of a first data stream, the first incoming video frame compliant with a first multimedia communication standard, the first incoming video frame including first video data and first non-video data;
extracting at least a portion of the first non-video data from a non-video area of the first incoming video frame, wherein the extracting comprises:
identifying one or more packets in the non-video area of the first incoming video frame having a first predefined header, and
extracting a payload from the identified one or more packets;
receiving a second incoming video frame of the first data stream, the second incoming video frame compliant with the first multimedia communication standard, the second incoming video frame including second video data and second non-video data:
generating a second data stream compliant with a second multimedia communication standard different from the first multimedia communication standard, the second data stream including an outgoing video frame, the outgoing video frame including at least the second video data of the second incoming video frame and the extracted portion of the first non-video data of the first incoming video frame, wherein the generating comprises generating one or more packets including the extracted portion of the first non-video data, the generated one or more packets having a second predefined header different than the first predefined header; and
wherein the first predefined header is not defined in the first multimedia communication standard, and the second predefined header is defined in the second multimedia communication standard, the second predefined header identifying a type of packet in a frame-accurate packet area of the outgoing video frame.
