# US 10,455,404 B2 · Quality of experience aware multimedia adaptive streaming

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,455,404 B2
- Document ID: US10455404B2
- Status: Granted
- Kind: B2
- Application number: 16/174,128
- Filed: 2018-10-29
- Published: 2019-03-07
- Granted: 2019-10-22
- Earliest claimed: 2013-03-29
- Assignees: Intel IP Corporation
- Applicants: Intel IP Corporation
- Inventors: Mohamed Rehan; Rana Morsi; Ozgur Oyman
- Web page: https://patentgrep.com/patent/US10455404B2

## CPC

- H04B 7/0452: Multi-user MIMO systems
- H04B 1/56: with provision for simultaneous communication in two directions
- H04B 7/0417: Feedback systems
- H04B 7/0617: {for beam forming}
- H04B 7/0619: {using feedback from receiving side (feedback signaling for adaptive modulation/coding H04L1/0001)}
- H04B 7/063: {Parameters other than those covered in groups H04B7/0623 - H04B7/0634, e.g. channel matrix rank or transmit mode selection}
- H04B 7/0695: {using beam selection}
- H04B 7/088: {using beam selection}
- H04L 1/1864: {ARQ related signaling (H04L1/1607 takes precedence)}
- H04L 5/0048: {Allocation of pilot signals, i.e. of signals known to the receiver (allocation of control signalling H04L5/0053; use of control signalling H04L5/0091)}
- H04L 5/0051: {of dedicated pilots, i.e. pilots destined for a single user or terminal}
- H04L 5/0053: {Allocation of signalling, i.e. of overhead other than pilot signals}
- H04L 5/0057: {Physical resource allocation for CQI}
- H04L 5/0085: {when channel conditions change}
- H04L 5/1469: {using time-sharing}
- H04L 25/0204: {of multiple channels}
- H04L 25/03305: {Joint sequence estimation and interference removal (joint detection of several desired signals H04L25/03331)}
- H04L 47/803: {Application aware}
- H04L 47/83: based on usage prediction
- H04L 65/613: for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637)
- H04L 65/65: Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
- H04L 65/70: Media network packetisation
- H04L 65/752: adapting media to network capabilities
- H04L 65/756: adapting media to device capabilities
- H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)}
- H04L 65/764: {at the destination (reformatting of additional data in video clients H04N21/4355)}
- H04L 65/80: Responding to QoS
- H04M 1/72457: according to geographic location
- H04N 21/2402: {Monitoring of the downstream path of the transmission network, e.g. bandwidth available (traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04N 21/8543: using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] {(information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80)}
- H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
- H04W 8/02: Processing of mobility data, e.g. registration information at HLR [Home Location Register] or VLR [Visitor Location Register]; Transfer of mobility data, e.g. between HLR, VLR or external networks
- H04W 8/06: Registration at serving network Location Register, VLR or user mobility server
- H04W 8/082: {for traffic bypassing of mobility servers, e.g. location registers, home PLMNs or home agents}
- H04W 24/00: Supervisory, monitoring or testing arrangements
- H04W 24/02: Arrangements for optimising operational condition
- H04W 28/02: Traffic management, e.g. flow control or congestion control
- H04W 28/0226: {based on location or mobility (handoff or reselection H04W36/00; mobile application services making use of the location of users or terminals H04W4/02)}
- H04W 28/20: Negotiating bandwidth
- H04W 36/125: {involving different types of service backbones}
- H04W 36/22: for handling the traffic
- H04W 36/26: by agreed or negotiated communication parameters
- H04W 48/06: based on traffic conditions
- H04W 48/16: Discovering, processing access restriction or access information
- H04W 48/18: Selecting a network or a communication service
- H04W 56/001: {Synchronization between nodes}
- H04W 72/0446: Resources in time domain, e.g. slots or frames
- H04W 72/541: using the level of interference
- H04W 76/15: Setup of multiple wireless link connections
- H04L 5/0007: {the frequencies being orthogonal, e.g. OFDM(A) or DMT}
- H04L 5/0055: {Physical resource allocation for ACK/NACK (for physical mapping arrangements in ARQ protocols H04L1/1861)}
- H04L 2025/03426: {transmission using multiple-input and multiple-output channels}
- H04W 28/08: Load balancing or load distribution (transferring a connection for handling the traffic H04W36/22; wireless traffic scheduling H04W72/12)
- H04W 28/082: among bearers or channels
- H04W 36/00226: {wherein the core network technologies comprise IP multimedia system [IMS], e.g. single radio voice call continuity [SRVCC]}
- H04W 36/0072: {of resource information of target access point}
- H04W 48/12: using downlink control channel
- H04W 72/046: {the resource being in the space domain, e.g. beams}
- H04W 84/042: {Public Land Mobile systems, e.g. cellular systems}
- H04W 84/045: {using private Base Stations, e.g. femto Base Stations, home Node B}
- H04W 84/12: WLAN [Wireless Local Area Networks]
- H04W 88/02: Terminal devices
- H04W 88/08: Access point devices
- H04W 88/10: adapted for operation in multiple networks, e.g. multi-mode access points
- Y02D 30/70: in wireless communication networks
- H04B: TRANSMISSION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

Technology to provide quality of experience aware multimedia streaming is disclosed. In an example, a server operable to provide hyper-text transfer protocol (HTTP) adaptive streaming, can include computer circuitry configured to: determine a bandwidth available to the server for transmitting HTTP adaptive streaming content to a plurality of clients; receive HTTP requests from the plurality of clients for representations offered by the server in a manifest file for the HTTP adaptive streaming; and calculate an availability of each representation that is offered in the manifest file for the server. The availability can be calculated, at least in part, based on the determined bandwidth. The availability of each representation can be communicated from the server to the plurality of clients.

## Claims

### Claim 1

An apparatus contained within a user equipment (UE) operable to decode dynamic adaptive streaming over HTTP (DASH) content received from a server, the apparatus comprising one or more processors and memory configured to:
decode, at the UE, a network assistance message received from the server for a client operating at the UE, the network assistance message including an indication of a bandwidth allocation assigned for the client operating at the UE;
decode a media presentation description (MPD) file received from the server that includes a bandwidth associated with each of a plurality of representations;
select a representation, from the plurality of representations of DASH content from the MPD with a bandwidth that is within the assigned bandwidth allocation indicated in the network assistance message for the client operating at the UE;
encode a request for transmission to the server for the selected representation of DASH content from the server; and
decode the selected representation of DASH content received from the server.

### Claim 2 (depends on 1)

The apparatus of claim 1, further comprising a transceiver configured to:
receive, from the server, the network assistance message that includes the indication of the bandwidth allocation assigned to the client operating at the UE; and
receive the selected representation of DASH content from the server.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the one or more processors and memory are further configured to decode the network assistance message received from the server that includes a recommended choice of bitrate for a next segment of the selected representation of DASH content being accessed at the client operating at the UE.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the one or more processors include one or more of a baseband processor or an application processor.

### Claim 5

An apparatus of a server operable to provide dynamic adaptive streaming over HTTP (DASH) content to a client operating at a user equipment (UE), the apparatus comprising one or more processors and memory configured to:
determine, at the server, a bandwidth allocation for the client operating at the UE;
encode, at the server, a network assistance message for transmission to the client operating at the UE, the network assistance message including an indication of the bandwidth allocation for the client;
encode, at the server, a media presentation description (MPD) file for transmission to the client operating at the UE that includes a bandwidth associated with each of a plurality of representations; and
encode, at the server, a representation, from the plurality of representations, of DASH content selected from the MPD for transmission to the client operating at the UE, wherein the selected representation of DASH content is associated with a bandwidth that is within the bandwidth allocation for the client.

### Claim 6 (depends on 5)

The apparatus of claim 5, further comprising a transceiver configured to:
transmit the network assistance message that includes the indication of the bandwidth allocation for the client operating at the UE; and
transmit the representation of DASH content to the client operating at the UE.

### Claim 7 (depends on 5)

The apparatus of claim 5, wherein the one or more processors and memory are further configured to:
determine the bandwidth allocation for each of a plurality of clients operating at UEs; and
encode the network assistance message for transmission to the plurality of clients that includes the indication of the bandwidth allocation.

### Claim 8 (depends on 5)

The apparatus of claim 5, wherein the one or more processors and memory are further configured to encode a second network assistance message for transmission to the client operating at the UE that includes a recommended bitrate for a next segment of the representation of DASH content being accessed at the client.

### Claim 9 (depends on 5)

The apparatus of claim 5, wherein the one or more processors and memory are further configured to decode a request received from the client operating at the UE for the selected representation of DASH content.

### Claim 10 (depends on 5)

The apparatus of claim 5, wherein the server is configured for quality of experience (QoE) aware dynamic adaptive streaming over hyper-text transfer protocol (HTTP) (DASH).

### Claim 11 (depends on 5)

The apparatus of claim 5, wherein the MPD file is a media presentation description for a DASH adaptation set.

### Claim 12 (depends on 5)

The apparatus of claim 5, wherein the one or more processors and memory are further configured to decode a quality of experience (QOE) received from the UE, the QoE of the selected representation of DASH content transmitted from the server.

### Claim 13

At least one non-transitory machine readable storage medium having instructions embodied thereon for decoding dynamic adaptive streaming over HTTP (DASH) content received at a user equipment (UE) from a server, the instructions when executed by one or more processors perform the following:
decoding, at a client operating at the UE, a network assistance message received from the server that includes an indication of a bandwidth allocation for the client operating at the UE;
decoding a media presentation description (MPD) file received from the server that includes a bandwidth associated with each of a plurality of representations; and
selecting a representation, from the plurality of representations, of DASH content from the MPD with a bandwidth that is within the bandwidth allocation for the client operating at the UE.

### Claim 14 (depends on 13)

The at least one non-transitory machine readable storage medium of claim 13, further comprising instructions when executed perform the following: decoding the selected representation of DASH content received from the server.

### Claim 15 (depends on 13)

The at least one non-transitory machine readable storage medium of claim 13, further comprising instructions when executed perform the following: decoding a second network assistance message received from the server that includes a recommended bitrate for a next segment of the selected representation of DASH content being accessed at the client operating at the UE.

### Claim 16 (depends on 13)

The at least one non-transitory machine readable storage medium of claim 13, further comprising instructions when executed perform the following: encoding a request for transmission to the server for the selected representation of DASH content from the server.

### Claim 17 (depends on 13)

The at least one non-transitory machine readable storage medium of claim 13, wherein the client operating at the UE is a Third Generation Partnership Project (3GPP) DASH client.

### Claim 18 (depends on 13)

The at least one non-transitory machine readable storage medium of claim 13, wherein the MPD file is a media presentation description for a DASH adaptation set.

### Claim 19 (depends on 13)

The at least one non-transitory machine readable storage medium of claim 13, further comprising instructions when executed perform the following:
determining a quality of experience (QOE) of the selected representation of DASH content received from the server;
encoding the QOE for transmission to the server.

### Claim 20 (depends on 19)

The at least one non-transitory machine readable storage medium of claim 19, further comprising instructions when executed perform the following: determining the QoE based, at least in part, on a number of rebuffering events that have occurred at the UE while receiving the selected representation of DASH content.