# US 2020/0267429 A1 · Scheduling multiple-layer video segments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0267429 A1
- Document ID: US20200267429A1
- Status: Published application
- Kind: A1
- Application number: 16/061,245
- Filed: 2016-12-12
- Published: 2020-08-20
- Earliest claimed: 2015-12-11
- Assignees: Vid Scale, Inc.
- Applicants: Vid Scale, Inc.
- Inventors: Yong He; Ahmed Hamza; Srinivas Gudumasu; Yan Ye; Eduardo Asbun
- Web page: https://patentgrep.com/patent/US20200267429A1

## CPC

- H04N 21/234327: {by decomposing into layers, e.g. base layer and one or more enhancement layers}
- H04N 21/23439: {for generating different versions}
- H04N 21/26216: {involving the channel capacity, e.g. network bandwidth (admission control, resource allocation in open networks H04L12/5692; flow control in packet networks H04L47/10; establishing a schedule or organising the servicing of application requests taking into account QoS H04L67/61)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A streaming device may request and download multi-layer video segments based on a number of factors including the artistic interest associated with the video segments and/or the status of a buffer area managed by the streaming device. The multi-layer segments may be coded using scalable coding techniques or a combination of scalable coding and simulcast coding techniques by which each of the video segments may be coded into one or more representations of different qualities and/or bitrates. When requesting the multi-layer segments, the streaming device may ensure that the fullness of the buffer area falls between a buffer underflow threshold and a backfilling threshold under various network conditions. The streaming device may estimate the available network bandwidth in order to facilitate the scheduling decisions. The streaming device may consider the artistic interest associated with the video segments during scheduling and may give priority to those segments with higher artistic interest.

## Claims

### Claim at position 1

1-30. (canceled)

### Claim 31

A method for streaming video content, the method comprising:
receiving a description of the video content, wherein the video content comprises a plurality of video segments each associated with a respective playback time and each available for download from a content server at one or more quality levels, the description indicating respective artistic interest values associated with the plurality of video segments;
requesting and buffering one or more video segments of the plurality of video segments associated with a current playback position such that a buffer level of a current playback buffer is above an underflow threshold;
beginning playback of the one or more video segments from the current playback buffer;
determining, based on the artistic interest values indicated in the description of the video content, that a first set of video segments of the plurality of video segments is associated with higher artistic interest values than a second set of video segments of the plurality of video segments, the first set of video segments being associated with a range of future playback times, the second set of video segments being associated with a range of near-term playback times, the future playback times are further away from the current playback position than the near-term playback times; and
based on the determining, requesting and buffering the first set of video segments ahead of at least one of the second set of video segments while maintaining the buffer level of the current playback buffer above the underflow threshold and continuing to play back the video content from the current playback buffer, wherein the buffer level of the current playback buffer is maintained above the underflow threshold by requesting and buffering one or more of the second set of video segments.

### Claim 32 (depends on 31)

The method of claim 31, wherein the first set of video segments associated with the range of future playback times is requested and buffered at a higher quality level than the second set of video segments associated with the range of near-term playback times.

### Claim 33 (depends on 31)

The method of claim 31, wherein the plurality of video segments are coded into a single layer representation.

### Claim 34 (depends on 31)

The method of claim 31, wherein the plurality of video segments are coded into at least a base layer representation and an enhancement layer representation, the first set of video segments is requested and buffered using the enhancement layer representation, the second set of video segments is requested and buffered using the base layer representation.

### Claim 35 (depends on 31)

The method of claim 31, wherein the first set of video segments is coded into a single layer representation using simulcast coding and wherein the second set of video segments is coded into at least a base layer representation and an enhancement layer representation using scalable coding.

### Claim 36 (depends on 31)

The method of claim 31, further comprising determining a time window beyond the current playback position, wherein determining that the first set of video segments is associated with higher artistic interest values than the second set of video segments comprises identifying the first set of video segments based on a determination that the playback times associated with the first set of video segments are within the time window.

### Claim 37 (depends on 36)

The method of claim 36, wherein a size of the time window is indicated in the description of the video content.

### Claim 38 (depends on 36)

The method of claim 36, wherein determining the time window comprises determining the time window based on the current playback position.

### Claim 39 (depends on 31)

The method of claim 31, further comprising, upon requesting and buffering the first set of video segments and maintaining the buffer level of the current playback buffer above the underflow threshold, continuing to request and buffer video segments from the second set of video segments.

### Claim 40 (depends on 31)

The method of claim 31, further comprising playing back the requested and buffered first set of video segments at the associated future playback times.

### Claim 41

A device configured to stream video content, the device comprising:
a processor configured to:
receive a description of the video content, wherein the video content comprises a plurality of video segments each associated with a respective playback time and each available for download from a content server at one or more quality levels, the description indicating respective artistic interest values associated with the plurality of video segments;
request and buffer one or more video segments of the plurality of video segments associated with a current playback position such that a buffer level of a current playback buffer is above an underflow threshold;
begin playback of the one or more video segments from the current playback buffer;
determine, based on the artistic interest values indicated in the description of the video content, that a first set of video segments of the plurality of video segments is associated with higher artistic interest values than a second set of video segments of the plurality of video segments, the first set of video segments being associated with a range of future playback times, the second set of video segments being associated with a range of near-term playback times, the future playback times are further away from the current playback position than the near-term playback times; and
based on the determining, request and buffer the first set of video segments ahead of at least one of the second set of video segments while maintaining the buffer level of the current playback buffer above the underflow threshold and continuing to play back the video content from the current playback buffer, wherein the buffer level of the current playback buffer is maintained above the underflow threshold by requesting and buffering one or more of the second set of video segments.

### Claim 42 (depends on 41)

The device of claim 41, wherein the first set of video segments associated with the range of future playback times is requested and buffered at a higher quality level than the second set of video segments associated with the range of near-term playback times.

### Claim 43 (depends on 41)

The device of claim 41, wherein the plurality of video segments are coded into a single layer representation.

### Claim 44 (depends on 41)

The device of claim 41, wherein the plurality of video segments are coded into at least a base layer representation and an enhancement layer representation, the first set of video segments is requested and buffered using the enhancement layer representation, the second set of video segments is requested and buffered using the base layer representation.

### Claim 45 (depends on 41)

The device of claim 41, wherein the first set of video segments is coded into a single layer representation using simulcast coding and wherein the second set of video segments is coded into at least a base layer representation and an enhancement layer representation using scalable coding.

### Claim 46 (depends on 41)

The device of claim 41, wherein the processor is further configured to determine a time window beyond the current playback position, and wherein the processor being configured to determine that the first set of video segments is associated with higher artistic interest values than the second set of video segments comprises the processor being configured to identify the first set of video segments based on a determination that the playback times associated with the first set of video segments are within the time window.

### Claim 47 (depends on 46)

The device of claim 46, wherein a size of the time window is indicated in the description of the video content.

### Claim 48 (depends on 46)

The device of claim 46, wherein the processor being configured to determine the time window comprises the processor being configured to determine the time window based on the current playback position.

### Claim 49 (depends on 41)

The device of claim 41, wherein the processor is further configured to, upon requesting and buffering the first set of video segments and maintaining the buffer level of the current playback buffer above the underflow threshold, continue to request and buffer video segments from the second set of video segments.

### Claim 50 (depends on 41)

The device of claim 41, wherein the processor is further configured to play back the requested and buffered first set of video segments at the associated future playback times.
