# US 2017/0257411 A1 · Technologies for providing hints usable to adjust properties of digital media

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0257411 A1
- Document ID: US20170257411A1
- Status: Published application
- Kind: A1
- Application number: 15/063,082
- Filed: 2016-03-07
- Published: 2017-09-07
- Earliest claimed: 2016-03-07
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Karthik Veeramani; Ashish Singhi; Rajneesh Chowdhury; Brian E. Rogers
- Web page: https://patentgrep.com/patent/US20170257411A1

## CPC

- H04L 65/60: Network streaming of media packets
- H04L 65/613: for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637)
- H04L 65/764: {at the destination (reformatting of additional data in video clients H04N21/4355)}
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04L 67/565: Conversion or adaptation of application format or content (adding application control or application functional data H04L67/561)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Technologies for providing hints for adjusting digital media properties include a destination computing device wirelessly coupled to multiple source computing devices. The destination computing device is configured to receive digital media streams from each of a multiple number of source computing devices, process each of the received digital media streams, and output one or more of the processed digital media streams based on one or more output settings and/or or more digital media properties of the digital media. The destination computing device is further configured to determine one or more performance metrics based on an analysis of the output digital media streams, determine one or more hints for one or more of the digital media streams based on the analysis, and transmit each of the hints to a corresponding one of the source computing devices. Other embodiments are described and claimed herein.

## Claims

### Claim 1

A destination computing device for providing hints usable to adjust properties of digital media, the destination computing device comprising:
a digital media stream processing module to process a plurality of digital media streams based on a plurality of digital media properties, wherein each of the digital media streams is received from one of a plurality of source computing devices wirelessly coupled to the destination computing device;
a digital media output module to output one or more of the processed digital media streams to an output device of the destination computing device based on one or more output settings;
a performance metric determination module to (i) analyze the processing and output of the digital media streams and (ii) determine one or more performance metrics based on the analysis, wherein the one or more performance metrics indicate an actual performance level; and
a hint determination module to (i) analyze the one or more performance metrics, (ii) determine whether a hint is to be sent to one or more of the plurality of source computing devices based on the analysis of the one or more performance metrics, wherein the hint identifies information usable by a source computing device of the plurality of source computing devices to determine whether to change one or more of the plurality of digital media properties associated with a digital media stream of that source computing device, (iii) generate, in response to a determination that the hint is to be sent, a message that includes the hint, and (iv) transmit the message to a corresponding one or more of the source computing devices.

### Claim 2 (depends on 1)

The destination computing device of claim 1, wherein to analyze the one or more performance metrics comprises to compare one or more of the one or more performance metrics against an expected output performance level, wherein the expected output performance level is determinable from at least one of the one or more output settings or the one or more of the plurality of digital media properties.

### Claim 3 (depends on 1)

The destination computing device of claim 1, wherein to generate the message that includes the hint comprises to generate the message that includes one of an indication of underperformance associated with the output of the digital media stream of the source computing device, a type of digital media stream of another of the plurality of source computing devices, or a priority level associated with the digital media stream of the source computing device.

### Claim 4 (depends on 1)

The destination computing device of claim 1, wherein the one or more performance metrics identify at least one of a present processing condition or present output condition.

### Claim 5 (depends on 1)

The destination computing device of claim 1, wherein the one or more performance metrics include at least one of an actual output frame rate, an actual output resolution, a processed bit rate, packet loss information, or decoder queue information.

### Claim 6 (depends on 1)

The destination computing device of claim 1, wherein the plurality of digital media properties include at least one of a frame rate, an aspect ratio, a bit rate, a data rate, a sample rate, an encoder type, or a container format type.

### Claim 7 (depends on 1)

The destination computing device of claim 1, wherein the one or more output settings include at least one of an audio output setting, a video output display layout/configuration setting, and a video display setting.

### Claim 8 (depends on 1)

The destination computing device of claim 1, further comprising a user interface management module to provide an adjustment interface of the destination computing device usable by a user of the destination computing device to make one or more user initiated adjustments to one or more of the one or more output settings presently being used to output each of the digital media streams.

### Claim 9 (depends on 8)

The destination computing device of claim 8, wherein the adjustment interface is to provide a visual reference to at least one of the plurality of digital media properties presently being used to process each of the digital media streams, one or more of the one or more output settings presently being used to output each of the digital media streams, or one or more of the one or more performance metrics.

### Claim 10 (depends on 1)

The destination computing device of claim 1, wherein to output one or more of the processed digital media streams to the output device of the destination computing device comprises to output each of the processed digital media streams to at least one of a display of the destination computing device or a speaker of the destination computing device.

### Claim 11

One or more computer-readable storage media comprising a plurality of instructions stored thereon that in response to being executed cause a destination computing device to:
process a plurality of digital media streams based on a plurality of digital media properties, wherein each of the digital media streams is received from one of a plurality of source computing devices wirelessly coupled to the destination computing device;
output one or more of the processed digital media streams to an output device of the destination computing device based on one or more output settings;
analyze the processing and output of the digital media streams;
determine one or more performance metrics based on the analysis;
analyze the one or more performance metrics;
determine whether a hint is to be sent to one or more of the plurality of source computing devices based on the analysis of the one or more performance metrics, wherein the hint identifies information usable by a source computing device of the plurality of source computing devices to determine whether to change one or more of the plurality of digital media properties associated with a digital media stream of that source computing device;
generate, in response to a determination that the hint is to be sent, a message that includes the hint; and
transmit the message to a corresponding one or more of the source computing devices.

### Claim 12 (depends on 11)

The one or more computer-readable storage media of claim 11, wherein to analyze the one or more performance metrics comprises to compare one or more of the one or more performance metrics against an expected output performance level, wherein the expected output performance level is determinable from at least one of the one or more output settings or the one or more digital media properties.

### Claim 13 (depends on 11)

The one or more computer-readable storage media of claim 11, wherein to generate the message that includes the hint comprises to generate the message that includes one of an indication of underperformance associated with the output of the digital media stream of the source computing device, a type of digital media stream of another of the plurality of source computing devices, or a priority level associated with the digital media stream of the source computing device.

### Claim 14 (depends on 11)

The one or more computer-readable storage media of claim 11, wherein the plurality of digital media properties include at least one of a frame rate, an aspect ratio, a bit rate, a data rate, a sample rate, an encoder type, or a container format type.

### Claim 15 (depends on 11)

The one or more computer-readable storage media of claim 11, wherein the one or more output settings include at least one of an audio output setting, a video output display layout/configuration setting, and a video display setting.

### Claim 16 (depends on 11)

The one or more computer-readable storage media of claim 11, wherein the plurality of instructions further cause the destination computing device to provide an adjustment interface of the destination computing device usable by a user of the destination computing device to make one or more user initiated adjustments to one or more of the one or more output settings presently being used to output each of the digital media streams.

### Claim 17 (depends on 16)

The one or more computer-readable storage media of claim 16, wherein the adjustment interface is to provide a visual reference to at least one of the plurality of digital media properties presently being used to process each of the digital media streams, one or more of the one or more output settings presently being used to output each of the digital media streams, or one or more of the one or more performance metrics.

### Claim 18 (depends on 11)

The one or more computer-readable storage media of claim 11, wherein to output one or more of the processed digital media streams to the output device of the destination computing device comprises to output each of the processed digital media streams to at least one of a display of the destination computing device or a speaker of the destination computing device.

### Claim 19

A method for providing hints usable to adjust properties of digital media, the method comprising:
processing, by a destination computing device, a plurality of digital media streams based on a plurality of digital media properties, wherein each of the digital media streams is received from one of a plurality of source computing devices wirelessly coupled to the destination computing device;
outputting, by the destination computing device, one or more of the processed digital media streams to an output device of the destination computing device based on one or more output settings;
analyzing, by the destination computing device, the processing and output of the digital media streams;
determining, by the destination computing device, one or more performance metrics based on the analysis;
analyzing, by the destination computing device, the one or more performance metrics
determining, by the destination computing device, whether a hint is to be sent to one or more of the plurality of source computing devices based on the analysis of the one or more performance metrics, wherein the hint identifies information usable by a source computing device of the plurality of source computing devices to determine whether to change one or more of the plurality of digital media properties associated with a digital media stream of that source computing device;
generating, by the destination computing device and in response to a determination that the hint is to be sent, a message that includes the hint; and
transmitting, by the destination computing device, the message to a corresponding one or more of the source computing devices.

### Claim 20 (depends on 19)

The method of claim 19, wherein analyzing the one or more performance metrics comprises comparing one or more of the one or more performance metrics against an expected output performance level, wherein the expected output performance level is determinable from at least one of the one or more output settings or the one or more digital media properties.

### Claim 21 (depends on 19)

The method of claim 19, wherein generating the message that includes the hint comprises generating the message that includes one of an indication of underperformance associated with the output of the digital media stream of the source computing device, a type of digital media stream of another of the plurality of source computing devices, or a priority level associated with the digital media stream of the source computing device.

### Claim 22 (depends on 19)

The method of claim 19, wherein outputting the processed digital media streams to the output device based on the one or more output settings comprises outputting the processed digital media streams to the output device based on at least one of an audio output setting, a video output display layout/configuration setting, or a video display setting.

### Claim 23 (depends on 19)

The method of claim 19, further comprising providing, by the destination computing device, an adjustment interface of the destination computing device usable by a user of the destination computing device to make one or more user initiated adjustments to one or more of the one or more output settings presently being used to output each of the digital media streams.

### Claim 24 (depends on 23)

The method of claim 23, further comprising providing, by the destination computing device, a visual reference to at least one of the plurality of digital media properties presently being used to process each of the digital media streams, one or more of the one or more output settings presently being used to output each of the digital media streams, or one or more of the one or more performance metrics.

### Claim 25 (depends on 19)

The method of claim 19, wherein outputting one or more of the processed digital media streams to the output device of the destination computing device comprises outputting each of the processed digital media streams to at least one of a display of the destination computing device or a speaker of the destination computing device.
