# US 11,310,298 B2 · Technologies for providing hints usable to adjust properties of digital media

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,310,298 B2
- Document ID: US11310298B2
- Status: Granted
- Kind: B2
- Application number: 15/063,082
- Filed: 2016-03-07
- Published: 2017-09-07
- Granted: 2022-04-19
- Earliest claimed: 2016-03-07
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Karthik Veeramani; Ashish Singhi; Rajneesh Chowdhury; Brian E. Rogers
- Web page: https://patentgrep.com/patent/US11310298B2

## CPC

- H04L 65/60: Network streaming of media packets
- H04L 65/613: for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637)
- H04L 65/764: {at the destination (reformatting of additional data in video clients H04N21/4355)}
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04L 67/565: Conversion or adaptation of application format or content (adding application control or application functional data H04L67/561)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Technologies for providing hints for adjusting digital media properties include a destination computing device wirelessly coupled to multiple source computing devices. The destination computing device is configured to receive digital media streams from each of a multiple number of source computing devices, process each of the received digital media streams, and output one or more of the processed digital media streams based on one or more output settings and/or or more digital media properties of the digital media. The destination computing device is further configured to determine one or more performance metrics based on an analysis of the output digital media streams, determine one or more hints for one or more of the digital media streams based on the analysis, and transmit each of the hints to a corresponding one of the source computing devices. Other embodiments are described and claimed herein.

## Claims

### Claim 1

A destination computing device for providing hints usable to adjust properties of digital media, the destination computing device comprising:
a digital media stream processing module to process a plurality of digital media streams based on a plurality of digital media properties, wherein each of the digital media streams is received from a different one of a plurality of source computing devices wirelessly coupled to the destination computing device, wherein each of the plurality of digital media streams includes a video stream;
a digital media output module to output one or more of the processed digital media streams to an output device of the destination computing device based on one or more output settings;
a performance metric determination module to (i) analyze the processing and output of the digital media streams and (ii) determine one or more performance metrics based on the analysis, wherein the one or more performance metrics indicate an actual performance level; and
a hint determination module to (i) analyze the one or more performance metrics, (ii) determine whether a hint is to be sent to one or more of the plurality of source computing devices based on the analysis of the one or more performance metrics, wherein the hint identifies information usable by a source computing device of the plurality of source computing devices to determine whether to change one or more of the plurality of digital media properties associated with a digital media stream of that source computing device, (iii) generate, in response to a determination that the hint is to be sent, a message that includes the hint, and (iv) transmit the message to a corresponding one or more of the source computing devices.

### Claim 2 (depends on 1)

The destination computing device of claim 1, wherein to analyze the one or more performance metrics includes to compare one or more of the one or more performance metrics against an expected output performance level, wherein the expected output performance level is determinable from at least one of the one or more output settings or the one or more of the plurality of digital media properties.

### Claim 3 (depends on 1)

The destination computing device of claim 1, wherein to generate the message that includes the hint includes to generate the message that includes one of an indication of underperformance associated with the output of the digital media stream of the source computing device, a type of digital media stream of another of the plurality of source computing devices, or a priority level associated with the digital media stream of the source computing device.

### Claim 4 (depends on 1)

The destination computing device of claim 1, wherein the one or more performance metrics identify at least one of a present processing condition or present output condition.

### Claim 5 (depends on 1)

The destination computing device of claim 1, wherein the one or more performance metrics include at least one of an actual output frame rate, an actual output resolution, a processed bit rate, packet loss information, or decoder queue information.

### Claim 6 (depends on 1)

The destination computing device of claim 1, wherein the plurality of digital media properties include at least one of a frame rate, an aspect ratio, a bit rate, a data rate, a sample rate, an encoder type, or a container format type.

### Claim 7 (depends on 1)

The destination computing device of claim 1, wherein the one or more output settings include at least one of an audio output setting, a video output display layout/configuration setting, and a video display setting.

### Claim 8 (depends on 1)

The destination computing device of claim 1, further including a user interface management module to provide an adjustment interface of the destination computing device usable by a user of the destination computing device to make one or more user initiated adjustments to one or more of the one or more output settings presently being used to output each of the digital media streams.

### Claim 9

One or more non-transitory computer-readable storage media comprising a plurality of instructions stored thereon that in response to being executed cause a destination computing device to:
process a plurality of digital media streams based on a plurality of digital media properties, wherein each of the digital media streams is received from a different one of a plurality of source computing devices wirelessly coupled to the destination computing device wherein each of the plurality of digital media streams includes a video stream;
output one or more of the processed digital media streams to an output device of the destination computing device based on one or more output settings;
analyze the processing and output of the digital media streams;
determine one or more performance metrics based on the analysis;
analyze the one or more performance metrics;
determine whether a hint is to be sent to one or more of the plurality of source computing devices based on the analysis of the one or more performance metrics, wherein the hint identifies information usable by a source computing device of the plurality of source computing devices to determine whether to change one or more of the plurality of digital media properties associated with a digital media stream of that source computing device;
generate, in response to a determination that the hint is to be sent, a message that includes the hint; and
transmit the message to a corresponding one or more of the source computing devices.

### Claim 10 (depends on 9)

The one or more non-transitory computer-readable storage media of claim 9, wherein to analyze the one or more performance metrics includes to compare one or more of the one or more performance metrics against an expected output performance level, wherein the expected output performance level is determinable from at least one of the one or more output settings or the one or more digital media properties.

### Claim 11 (depends on 9)

The one or more non-transitory computer-readable storage media of claim 9, wherein to generate the message that includes the hint includes to generate the message that includes one of an indication of underperformance associated with the output of the digital media stream of the source computing device, a type of digital media stream of another of the plurality of source computing devices, or a priority level associated with the digital media stream of the source computing device.

### Claim 12 (depends on 9)

The one or more non-transitory computer-readable storage media of claim 9, wherein the plurality of digital media properties include at least one of a frame rate, an aspect ratio, a bit rate, a data rate, a sample rate, an encoder type, or a container format type.

### Claim 13 (depends on 9)

The one or more non-transitory computer-readable storage media of claim 9, wherein the one or more output settings include at least one of an audio output setting, a video output display layout/configuration setting, and a video display setting.

### Claim 14 (depends on 9)

The one or more non-transitory computer-readable storage media of claim 9, wherein the plurality of instructions further cause the destination computing device to provide an adjustment interface of the destination computing device usable by a user of the destination computing device to make one or more user initiated adjustments to one or more of the one or more output settings presently being used to output each of the digital media streams.

### Claim 15

A method for providing hints usable to adjust properties of digital media, the method comprising:
processing, by a destination computing device, a plurality of digital media streams based on a plurality of digital media properties, wherein each of the digital media streams is received from a different one of a plurality of source computing devices wirelessly coupled to the destination computing device, wherein each of the plurality of digital media streams includes a video stream;
outputting, by the destination computing device, one or more of the processed digital media streams to an output device of the destination computing device based on one or more output settings;
analyzing, by the destination computing device, the processing and output of the digital media streams;
determining, by the destination computing device, one or more performance metrics based on the analysis;
analyzing, by the destination computing device, the one or more performance metrics
determining, by the destination computing device, whether a hint is to be sent to one or more of the plurality of source computing devices based on the analysis of the one or more performance metrics, wherein the hint identifies information usable by a source computing device of the plurality of source computing devices to determine whether to change one or more of the plurality of digital media properties associated with a digital media stream of that source computing device;
generating, by the destination computing device and in response to a determination that the hint is to be sent, a message that includes the hint; and
transmitting, by the destination computing device, the message to a corresponding one or more of the source computing devices.

### Claim 16 (depends on 15)

The method of claim 15, wherein generating the message that includes the hint includes generating the message that includes one of an indication of underperformance associated with the output of the digital media stream of the source computing device, a type of digital media stream of another of the plurality of source computing devices, or a priority level associated with the digital media stream of the source computing device.

### Claim 17 (depends on 15)

The method of claim 15, further including providing, by the destination computing device, an adjustment interface of the destination computing device usable by a user of the destination computing device to make one or more user initiated adjustments to one or more of the one or more output settings presently being used to output each of the digital media streams.

### Claim 18 (depends on 1)

The destination computing device of claim 1, wherein the hint identifies a parameter of a first digital media stream of a first source computing device of the plurality of source computing devices,
wherein to transmit the message that includes the hint includes to transmit, to a second source computing device of the plurality of source computing devices corresponding to a second digital media stream different from the first digital media stream, the message that includes the hint that identifies the parameter of the first digital media stream.

### Claim 19 (depends on 1)

The destination computing device of claim 1, wherein the one or more performance metrics indicate an actual performance level of a first digital media stream of a first source computing device of the plurality of computing devices,
wherein the hint is indicative of the one or more performance metrics of the first digital media stream,
wherein to transmit the message that includes the hint includes to transmit, to a second source computing device of the plurality of source computing devices corresponding to a second digital media stream different from the first digital media stream, the message that includes the hint that is indicative of the one or more performance metrics of the first digital media stream.

### Claim 20 (depends on 1)

The destination computing device of claim 1, wherein the hint includes an indication that a first digital media stream of a first source computing device of the plurality of computing devices is presently selected for output on the output device,
wherein to transmit the message that includes the hint includes to transmit, to a second source computing device of the plurality of source computing devices corresponding to a second digital media stream different from the first digital media stream, the message that includes the hint that includes the indication that the first digital media stream is presently selected for output.

### Claim 21 (depends on 1)

The destination computing device of claim 1, wherein the hint includes an indication that a sound channel of a first digital media stream of a first source computing device of the plurality of computing devices is being outputted to the output device,
wherein to transmit the message that includes the hint includes to transmit, to a second source computing device of the plurality of source computing devices corresponding to a second digital media stream different from the first digital media stream, the message that includes the hint that includes the indication that the sound channel of the first digital media stream is being outputted to the output device.

### Claim 22 (depends on 1)

The destination computing device of claim 1, wherein the hint includes an indication that a video channel of a first digital media stream of a first source computing device of the plurality of computing devices is not being played by the destination computing device.

### Claim 23 (depends on 1)

The destination computing device of claim 1, wherein a first digital media stream of the plurality of digital media streams is received from a first source computing device of the plurality of source computing devices at a first resolution,
wherein to output the one or more of the processed digital media streams includes to output the first digital media stream at a second resolution lower than the first resolution,
wherein the hint includes an indication that the first digital media stream is outputted at the second resolution lower than the first resolution.

### Claim 24 (depends on 1)

The destination computing device of claim 1, wherein the performance metric determination module is further to determine, for each of the plurality of digital media streams, a rate of motion of video of the corresponding digital media stream,
wherein the hint determination module is further to:
determine, for each of the plurality of digital media streams, a desired frame rate based on the corresponding rate of motion;
generate, for each of the plurality of digital media streams, a frame rate hint indicative of the desired frame rate for the corresponding digital media stream; and
transmit, to each of the plurality of digital media streams, the frame rate hint corresponding to the corresponding digital media stream.

### Claim 25 (depends on 1)

The destination computing device of claim 1, wherein each of the plurality of digital media streams corresponds to screen data of one of the plurality of source computing devices.