# US 2016/0366454 A1 · Adaptive data streaming based on virtual screen size

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0366454 A1
- Document ID: US20160366454A1
- Status: Published application
- Kind: A1
- Application number: 14/739,790
- Filed: 2015-06-15
- Published: 2016-12-15
- Earliest claimed: 2015-06-15
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: IGOR TATOURIAN; HONG LI; RITA H. WOUHAYBI
- Web page: https://patentgrep.com/patent/US20160366454A1

## CPC

- H04N 21/234345: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment}
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G09G 5/391: Resolution modifying circuits, e.g. variable screen formats
- H04N 21/234363: {by altering the spatial resolution, e.g. for clients with a lower screen resolution}
- H04N 21/2393: {involving handling client requests (scheduling or organising the servicing of application requests H04L67/60)}
- H04N 21/25825: {involving client display capabilities, e.g. screen resolution of a mobile phone (optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06)}
- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H04N 21/4516: {involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available}
- H04N 21/4532: {involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- H04N 21/6373: for rate control {, e.g. request to the server to modify its transmission rate (flow control in packet networks H04L47/10)}
- H04N 21/6582: {Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number (arrangements where receivers interact with the broadcast H04H20/38)}
- G09G 2350/00: Solving problems of bandwidth in display systems
- G09G 2370/022: Centralised management of display operation, e.g. in a server instead of locally
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Methods, systems, and storage media are described for adjusting a bitrate for a data stream according to user consumption of the data stream. In embodiments, a computing device may determine a virtual resolution based on an absolute resolution of a display device associated with the computing device and a relative display size of the display device. The relative display size may be based on a user position and an absolute display size of the display device. The computing device may request data stream segments of a data stream encoded at a bitrate based on the virtual resolution, and provide the data stream segment for display on the display device. The virtual resolution may also be based on user attributes and/or device attributes. Other embodiments may be described and/or claimed.

## Claims

### Claim 1

A computing device comprising:
at least one processor;
a virtual display engine to operate on the at least one processor to determine a virtual resolution based at least in part on an absolute resolution of a display device associated with the computing device and a relative display size of the display device, wherein the relative display size is based on a user context and an absolute display size of the display device, wherein the user context is based on a user position and surrounding environmental factors, wherein the user position is a position of a user of the computing device relative to a position of the display device, the surrounding environmental factors include information regarding an environment in which content is to be consumed, and wherein the absolute resolution is based on the absolute display size;
a content access module to operate on the at least one processor to receive, from a content provider, a data stream segment of a data stream encoded at a bitrate based at least in part on the virtual resolution; and
a display module to operate on the at least one processor to provide the data stream segment for display on the display device.

### Claim 2 (depends on 1)

The computing device of claim 1, wherein the virtual display engine is to adjust the virtual resolution according to one or more user preferences such that the content access module is to select the bitrate for the data stream segment based further on the one or more user preferences.

### Claim 3 (depends on 1)

The computing device of claim 1, wherein the content access module is to determine a current bandwidth allocated to the computing device, and select a bitrate for a next data stream segment of the data stream based further on the current bandwidth.

### Claim 4 (depends on 1)

The computing device of claim 1, further comprising:
a device attribute module to operate on the at least one processor to determine one or more device attributes of the computing device, wherein the device attributes indicate one or more sensors associated with the computing device; and
a device interface module to operate on the at least one processor to control the one or more sensors to determine the user position.

### Claim 5 (depends on 4)

The computing device of claim 4, wherein the virtual display engine is to obtain the user position from the device interface module, determine whether the user is within a viewing area based on the user position and the absolute display size wherein the viewing area is a region in which a display area of the display device is observable, determine the virtual resolution to be a minimum acceptable resolution when the user is determined to be outside of the viewing area, and determine the virtual resolution based on the user position when the user is determined to be within the viewing area.

### Claim 6 (depends on 4)

The computing device of claim 4, wherein
the device interface module is to control the one or more sensors to obtain a viewing direction wherein the viewing direction is an angle of the user relative to the display device, and obtain one or more gestures of the user; and
the virtual display engine is to determine a user focus based on the user position, the viewing angle, and the one or more gestures, and determine the virtual resolution based on the user focus, wherein the user focus indicates an amount of attention being paid to data stream segments of the data stream such that the virtual resolution is decreased as the amount of attention is decreased and the virtual resolution is increased as the amount of attention is increased.

### Claim 7 (depends on 6)

The computing device of claim 6, wherein
the device interface module is to control the one or more sensors to determine a number of users consuming the data stream,
when the number of users consuming the data stream is determined to be greater than one, the virtual display engine is to determine the virtual resolution to be the absolute resolution, and
when the number of users consuming the data stream is determined to be equal to one, the virtual display engine is to determine the virtual resolution based on the user focus.

### Claim 8 (depends on 4)

The computing device of claim 4, further comprising:
a user attribute module to operate on the at least one processor to determine one or more user attributes associated with the computing device,
wherein the virtual display engine is to obtain the one or more user attributes from the user attribute module and determine the virtual resolution based on the one or more user attributes.

### Claim 9 (depends on 8)

The computing device of claim 8, wherein
the one or more user attributes define a plurality of desired resolutions for each of a plurality of content types, each of a plurality of device types, and one or more device locations, and
the virtual display engine is to determine the virtual resolution to be one of the plurality of desired resolutions according to a content type of the data stream, a device type of the display device or the computing device, and a location of the display device or the computing device.

### Claim 10 (depends on 8)

The computing device of claim 8, wherein
the one or more user attributes define a first desired resolution and a second desired resolution, wherein the first desired resolution is greater than the second desired resolution,
the device interface module is to control the one or more sensors to determine a user orientation, wherein the user orientation is an orientation of at least one body part of the user, and
the virtual display engine is to obtain the user position and the user orientation from the device interface module, determine a user focus based on the user position and the user orientation, determine the virtual resolution to be the first desired resolution when the user focus is greater than or equal to a focus threshold, and determine the virtual resolution to be the second desired resolution when the user focus is less than the focus threshold.

### Claim 11 (depends on 8)

The computing device of claim 8, wherein
the one or more user attributes define a subscription associated with the user, and the user attribute module is to obtain subscription information indicating an available data usage associated with the subscription, and
the virtual display engine is to obtain the subscription information from the user attribute module, and determine the virtual resolution according to the subscription information such that the virtual resolution is decreased as the available data usage is decreased and the virtual resolution is increased as the available data usage is increased.

### Claim 12 (depends on 11)

The computing device of claim 11, wherein
the one or more user attributes indicate a plurality of other computing devices associated with the user wherein at least one of the plurality of other computing devices are associated with a corresponding subscription, and the user attribute module is to obtain subscription information for each of the plurality of other computing devices indicating an available data usage associated with the corresponding subscription, and
the virtual display engine is to obtain the subscription information for each of the plurality of other computing devices from the user attribute module, and determine the virtual resolution according to the subscription information such that the virtual resolution is decreased as the available data usage is decreased and the virtual resolution is increased as the available data usage is increased.

### Claim 13 (depends on 4)

The computing device of claim 4, wherein the device attributes further indicate one or more internal components of the computing device, and the virtual display engine is to instruct the one or more internal components to adjust a mode of operation according to the virtual resolution.

### Claim 14 (depends on 4)

The computing device of claim 4, wherein the device interface module is to control the one or more sensors to obtain the user position and a user orientation, and the virtual display engine is to determine a user focus based on at least one of the user position and the user orientation wherein the user orientation is an orientation of at least one body part of the user, and the computing device further comprises:
a tiling module to operate on the at least one processor to divide frames of the data stream into a plurality of tiles, determine a tile of interest of the plurality of tiles based on the user focus,
wherein the virtual display engine is to determine the virtual resolution to include a first virtual resolution for the tile of interest and a second virtual resolution for the other tiles of the plurality of tiles, and
wherein the content access module is to enable the computing device to provide the first virtual resolution and the second virtual resolution to the content provider, and receive, from the content provider, the tile of interest encoded according to the first virtual resolution and the other tiles encoded according to the second virtual resolution.

### Claim 15

At least one non-transitory computer-readable medium including instructions to cause a computing device, in response to execution of the instructions by the computing device, to:
determine a virtual resolution based at least in part on an absolute resolution of a display device associated with the computing device and a relative display size of the display device, wherein the relative display size is based on a user context and an absolute display size of the display device, wherein the user context is based on a user position and surrounding environmental factors, wherein the user position is a position of a user of the computing device relative to a position of the display device, the surrounding environmental factors include information regarding an environment in which content is to be consumed, and the absolute resolution is based on the absolute display size;
receive, from a content provider, a data stream segment of a data stream encoded at a bitrate based at least in part on the virtual resolution; and
provide the data stream segment for display on the display device.

### Claim 16 (depends on 15)

The at least one non-transitory computer-readable medium of claim 15, wherein the instructions cause the computing device, in response to execution of the instructions by the computing device, to:
adjust the virtual resolution according to one or more user preferences such that the computing device is to select the bitrate for the data stream segment based further on the one or more user preferences.

### Claim 17 (depends on 15)

The at least one non-transitory computer-readable medium of claim 15, wherein the instructions cause the computing device, in response to execution of the instructions by the computing device, to:
determine a current bandwidth allocated to the computing device, and select a bitrate for a next data stream segment of the data stream based further on the current bandwidth.

### Claim 18 (depends on 15)

The at least one non-transitory computer-readable medium of claim 15, wherein the instructions cause the computing device, in response to execution of the instructions by the computing device, to:
determine one or more device attributes of the computing device, wherein the device attributes indicate one or more sensors associated with the computing device; and
control the one or more sensors to determine the user position.

### Claim 19 (depends on 18)

The at least one non-transitory computer-readable medium of claim 18, wherein the instructions cause the computing device, in response to execution of the instructions by the computing device, to:
obtain the user position;
determine whether the user is within a viewing area based on the user position and the absolute display size, wherein the viewing area is a region in which a display area of the display device is observable;
determine the virtual resolution to be a minimum acceptable resolution when the user is determined to be outside of the viewing area; and
determine the virtual resolution based on the user position when the user is determined to be within the viewing area.

### Claim 20 (depends on 18)

The at least one non-transitory computer-readable medium of claim 18, wherein the instructions cause the computing device, in response to execution of the instructions by the computing device, to:
control the one or more sensors to obtain a viewing direction wherein the viewing direction is an angle of the user relative to the display device, and obtain one or more gestures of the user; and
determine a user focus based on the user position, the viewing angle, and the one or more gestures, and determine the virtual resolution based on the user focus, wherein the user focus indicates an amount of attention being paid to data stream segments of the data stream such that the virtual resolution is decreased as the amount of attention is decreased and the virtual resolution is increased as the amount of attention is increased.

### Claim 21 (depends on 20)

The at least one non-transitory computer-readable medium of claim 20, wherein the instructions cause the computing device, in response to execution of the instructions by the computing device, to:
control the one or more sensors to determine a number of users consuming the data stream;
determine the virtual resolution to be the absolute resolution when the number of users consuming the data stream is determined to be greater than one; and
determine the virtual resolution based on the user focus when the number of users consuming the data stream is determined to be equal to one.

### Claim 22 (depends on 18)

The at least one non-transitory computer-readable medium of claim 18, wherein the instructions cause the computing device, in response to execution of the instructions by the computing device, to:
determine one or more user attributes associated with the computing device; and
determine the virtual resolution based on the one or more user attributes.

### Claim 23 (depends on 22)

The at least one non-transitory computer-readable medium of claim 22, wherein the one or more user attributes define a plurality of desired resolutions for each of a plurality of content types, each of a plurality of device types, and one or more device locations, and wherein the instructions cause the computing device, in response to execution of the instructions by the computing device, to:
determine the virtual resolution to be one of the plurality of desired resolutions according to a content type of the data stream, a device type of the display device or the computing device, and a location of the display device or the computing device.

### Claim 24 (depends on 22)

The at least one non-transitory computer-readable medium of claim 22, wherein the one or more user attributes define a first desired resolution and a second desired resolution, wherein the first desired resolution is greater than the second desired resolution, and wherein the instructions cause the computing device, in response to execution of the instructions by the computing device, to:
control the one or more sensors to determine a user orientation, wherein the user orientation is an orientation of at least one body part of the user;
determine a user focus based on the user position and the user orientation;
determine the virtual resolution to be the first desired resolution when the user focus is greater than or equal to a focus threshold; and
determine the virtual resolution to be the second desired resolution when the user focus is less than the focus threshold.

### Claim 25 (depends on 22)

The at least one non-transitory computer-readable medium of claim 22, wherein the one or more user attributes define a subscription associated with the user, and wherein the instructions cause the computing device, in response to execution of the instructions by the computing device, to:
obtain subscription information indicating an available data usage associated with the subscription;
determine the virtual resolution according to the subscription information such that the virtual resolution is decreased as the available data usage is decreased and the virtual resolution is increased as the available data usage is increased.

### Claim 26 (depends on 25)

The at least one non-transitory computer-readable medium of claim 25, wherein the one or more user attributes indicate a plurality of other computing devices associated with the user wherein at least one of the plurality of other computing devices are associated with a corresponding subscription, and wherein the instructions cause the computing device, in response to execution of the instructions by the computing device, to:
obtain subscription information for each of the plurality of other computing devices indicating an available data usage associated with the corresponding subscription; and
determine the virtual resolution according to the subscription information such that the virtual resolution is decreased as the available data usage is decreased and the virtual resolution is increased as the available data usage is increased.

### Claim 27 (depends on 18)

The at least one non-transitory computer-readable medium of claim 18, wherein the device attributes further indicate one or more internal components of the computing device, and wherein the instructions cause the computing device, in response to execution of the instructions by the computing device, to:
instruct the one or more internal components to adjust a mode of operation according to the virtual resolution.

### Claim 28 (depends on 18)

The at least one non-transitory computer-readable medium of claim 18, wherein the instructions cause the computing device, in response to execution of the instructions by the computing device, to:
control the one or more sensors to determine the user position and a user orientation wherein the user orientation is an orientation of at least one body part of the user;
determine a user focus based on at least one of the user position and the user orientation;
divide frames of the data stream into a plurality of tiles;
determine a tile of interest of the plurality of tiles based on the user focus;
determine the virtual resolution to include a first virtual resolution for the tile of interest and a second virtual resolution for the other tiles of the plurality of tiles;
provide the first virtual resolution and the second virtual resolution to the content provider; and
receive, from the content provider, the tile of interest encoded according to the first virtual resolution and the other tiles encoded according to the second virtual resolution.
