# US 2021/0344918 A1 · Optimization of multi-sink wi-fi display with intelligent multi-session encoding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0344918 A1
- Document ID: US20210344918A1
- Status: Published application
- Kind: A1
- Application number: 16/490,149
- Filed: 2017-03-31
- Published: 2021-11-04
- Earliest claimed: 2017-03-31
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Ning Luo; Changliang Wang; Ujwal Paidipathi; Karthik Veeramani; Rajneesh Chowdhury
- Web page: https://patentgrep.com/patent/US20210344918A1

## CPC

- H04L 65/70: Media network packetisation
- H04N 19/12: Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/139: Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
- H04N 19/187: the unit being a scalable video layer
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems, apparatuses, and methods may provide for multi-session encoding to optimize multiple encoding sessions on Wi-Fi display (WFD) source devices when the WFD source devices are connected to multiple sink devices. The multiple encoding sessions may be optimized with encoding hints that are generated by a compositor and transmitted to a pre-encoding checking device. The encoding session that has the highest encoding resolution is subjected to hierarchical motion estimation (HME) processing, and the encoding sessions that have lower resolutions are optimized based on a motion vector prediction hint generated by the encoding session that has the highest encoding resolution and a scaling factor.

## Claims

### Claim at position 1

1-25. (canceled)

### Claim 26

A system comprising:
a power supply to provide power to the system; and
a Wi-Fi display (WFD) source device including:
a compositor to generate one or more video streams and one or more video encoding hints;
a pre-encoding checker to perform pre-video encoding operations based on the one or more video encoding hints;
a scaler to generate a scaled motion vector predictor hint;
one or more encoders to encode the one or more video streams in one or more encoding sessions, and
one or more transmitters to transmit the one or more encoded video streams.

### Claim 27 (depends on 26)

The system of claim 26, wherein the video encoding hints are to include one or more of a still scene hint, a layer geometry hint, a dirty rectangle, or a transform matrix hint.

### Claim 28 (depends on 26)

The system of claim 26, wherein hierarchical motion estimation (HME) operations are to be performed on a first encoding session of the one or more encoding sessions that has a first resolution.

### Claim 29 (depends on 28)

The system of claim 28, wherein one or more second encoding sessions that have a resolution lower than the first resolution use a video encoding hint of the first encoding session and a scaling factor to obtain the scaled motion vector prediction hint.

### Claim 30 (depends on 29)

The system of claim 29, wherein the scaled motion vector prediction hint is to be applied to encoding stages for the one or more second encoding sessions.

### Claim 31 (depends on 29)

The system of claim 29, wherein the scaling factor is equal to a ratio of a resolution of each of the one or more second corresponding encoding sessions to the resolution of the first encoding session.

### Claim 32

A method comprising:
generating, by a compositor, video content and one or more video encoding hints;
performing one or more pre-video encoding operations on the video content based on the one or more video encoding hints;
generating a scaled motion vector predictor hint; and
encoding one or more video streams in one or more encoding sessions based on the scaled motion vector predictor hint.

### Claim 33 (depends on 32)

The method of claim 32, wherein the video encoding hints include one or more of a still scene hint, a layer geometry hint, a dirty rectangle, or a transform matrix hint.

### Claim 34 (depends on 32)

The method of claim 32, further comprising performing one or more hierarchical motion estimation (HME) operations during a first encoding session of the one or more encoding sessions that has a first resolution.

### Claim 35 (depends on 34)

The method of claim 34, wherein one or more second encoding sessions that have a resolution lower than the first resolution use a video encoding hint of the first encoding session and a scaling factor to obtain the scaled motion vector prediction hint.

### Claim 36 (depends on 35)

The method of claim 35, wherein the scaled motion vector prediction hint is applied to one or more encoding stages associated with the one or more second encoding sessions.

### Claim 37 (depends on 35)

The method of claim 35, wherein the scaling factor is equal to a ratio of a resolution of each of the one or more second encoding sessions to the resolution of the first encoding session.

### Claim 38

An apparatus comprising:
a compositor to generate one or more video streams and one or more video encoding hints;
a pre-encoding checker to perform pre-video encoding operations based on the one or more video encoding hints;
a scaler to generate a scaled motion vector predictor hint; and
one or more encoders to encode the one or more video streams in one or more encoding sessions.

### Claim 39 (depends on 38)

The apparatus of claim 38, wherein the video encoding hints are to include one or more of a still scene hint, a layer geometry hint, a dirty rectangle, or a transform matrix hint.

### Claim 40 (depends on 38)

The apparatus of claim 38, wherein hierarchical motion estimation (HME) operations are to be performed on a first encoding session of the one or more encoding sessions that has a first resolution.

### Claim 41 (depends on 40)

The apparatus of claim 40, wherein one or more second encoding sessions that have a resolution lower than the first resolution use a video encoding hint of the first encoding session and a scaling factor to obtain the scaled motion vector prediction hint.

### Claim 42 (depends on 41)

The apparatus of claim 41, wherein the scaled motion vector prediction hint is to be applied to encoding stages for the one or more second encoding sessions.

### Claim 43 (depends on 41)

The apparatus of claim 41, wherein the scaling factor is equal to a ratio of a resolution of each of the one or more second corresponding encoding sessions to the resolution of the first encoding session.

### Claim 44

At least one computer readable storage medium comprising a set of instructions, which when executed by an apparatus, cause the apparatus to:
generate video content and one or more video encoding hints;
perform one or more pre-video encoding operations on the video content based on the one or more video encoding hints;
generate a scaled motion vector predictor hint; and
encode one or more video streams in one or more encoding sessions based on the scaled motion vector predictor hint.

### Claim 45 (depends on 44)

The at least one computer readable storage medium of claim 44, wherein the video encoding hints include one or more of a still scene hint, a layer geometry hint, a dirty rectangle, or a transform matrix hint.

### Claim 46 (depends on 44)

The at least one computer readable storage medium of claim 44, further comprising performing one or more hierarchical motion estimation (HME) operations during a first encoding session of the one or more encoding sessions that has a first resolution.

### Claim 47 (depends on 46)

The at least one computer readable storage medium of claim 46, wherein one or more second encoding sessions that have a resolution lower than the first resolution use a video encoding hint of the first encoding session and a scaling factor to obtain the scaled motion vector prediction hint.

### Claim 48

A system comprising:
one or more transmitter devices;
a receiver device to receive a Moving Picture Experts Group (MPEG) transport stream (TS) from the one or more transmitter devices;
the receiver device comprising:
a parameter extractor to extract transmitter device parameters from the MPEG-TS;
a display manager to derive a transmitter identifier based on the extracted transmitter device parameters; and
a display device to display a thumbnail image of the one or more transmitter devices and an associated information bar that includes the transmitter identifier.

### Claim 49 (depends on 48)

The system of claim 48, wherein the transmitter device parameters include ne or more of a friendly name, a transmitter device model number, a transmitter device type, a uniform resource identifier (URI), or a transmitter device color.

### Claim 50 (depends on 48)

The system of claim 48, wherein the thumbnail image is a bitmap depicting a transmitter device type.