# US 2020/0152234 A1 · Systems and methods for adaptive streaming of multimedia content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0152234 A1
- Document ID: US20200152234A1
- Status: Published application
- Kind: A1
- Application number: 16/680,482
- Filed: 2019-11-11
- Published: 2020-05-14
- Earliest claimed: 2018-11-12
- Assignees: Netflix, Inc.
- Applicants: Netflix, Inc.
- Inventors: Sean Sharma; Guillaume du Pontavice
- Web page: https://patentgrep.com/patent/US20200152234A1

## CPC

- G11B 20/00086: {Circuits for prevention of unauthorised reproduction or copying, e.g. piracy (indicating unauthorised use of record carriers in general G11B23/28; scrambling for television signal recording H04N5/913; network architectures or network protocols for network security H04L63/00; cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00)}
- G06T 1/0021: {Image watermarking}
- H04L 65/752: adapting media to network capabilities
- H04L 65/756: adapting media to device capabilities
- H04L 65/80: Responding to QoS
- H04N 1/32144: {embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp}
- H04N 21/2335: {involving reformatting operations of audio signals, e.g. by converting from one coding standard to another (details of audio signal transcoding G10L19/173)}
- H04N 21/23439: {for generating different versions}
- H04N 21/2402: {Monitoring of the downstream path of the transmission network, e.g. bandwidth available (traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876)}
- H04N 21/26208: {the scheduling operation being performed under constraints}
- H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
- H04N 21/6582: {Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number (arrangements where receivers interact with the broadcast H04H20/38)}
- H04N 21/8358: involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)}
- H04N 2201/324: Selecting a particular authentication information from amongst a plurality of different authentication information
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The disclosed computer-implemented method includes determining that audio quality is to be adjusted for a multimedia streaming connection over which audio data and video data are being streamed to a content player. The audio data is streamed at a specified audio quality level and the video data is streamed at a specified video quality level. The method also includes determining that a specified minimum video quality level is to be maintained while adjusting the audio quality level. Still further, the method includes dynamically adjusting the audio quality level of the multimedia streaming connection while maintaining the video quality level of the multimedia streaming connection at at least the specified minimum video quality level. Various other methods, systems, and computer-readable media are also disclosed.

## Claims

### Claim 1

A computer-implemented method for adaptively streaming multimedia content, the method comprising:
determining that audio quality is to be adjusted for a multimedia streaming connection over which audio data and video data are being streamed to a content player, the audio data being streamed at a specified audio quality level and the video data being streamed at a specified video quality level;
determining that a specified minimum video quality level is to be maintained while adjusting the audio quality level; and
dynamically adjusting the audio quality level of the multimedia streaming connection while maintaining the video quality level of the multimedia streaming connection at at least the specified minimum video quality level.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein dynamically adjusting the audio quality level comprises increasing the audio quality level.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein the audio quality level is automatically increased to one or more subsequent higher quality levels until the video quality level reaches a specified quality level that is higher quality than the specified minimum video quality level.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the audio quality level is adjusted according to a specified bitrate ladder.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the audio quality level is dynamically adjusted according to one or more user preferences, the user preferences indicating whether audio or video is to be prioritized in the multimedia streaming connection.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining that the content player is operating on a specified electronic device;
identifying one or more audio or video hardware capabilities of the specified electronic device; and
dynamically adjusting the audio quality level of the multimedia streaming connection according to the audio or video capabilities of the specified electronic device.

### Claim 7 (depends on 6)

The computer-implemented method of claim 6, wherein the audio quality level is dynamically adjusted for a plurality of different types of electronic devices.

### Claim 8 (depends on 6)

The computer-implemented method of claim 6, wherein an audio data rate at which the audio data is transmitted over the multimedia streaming connection is varied based on a cache size associated with the specified electronic device.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein dynamically adjusting the audio quality level comprises decreasing the audio quality level.

### Claim 10 (depends on 9)

The computer-implemented method of claim 9, wherein the audio quality level is dynamically decreased upon determining that network bandwidth for the multimedia streaming connection has dropped below a specified amount.

### Claim 11 (depends on 9)

The computer-implemented method of claim 9, wherein the video data corresponds to a movie or television show and wherein the audio quality level is dynamically decreased upon determining that an audio track associated with the movie or television show is substantially silent for at least a minimum specified period of time.

### Claim 12

A system comprising:
at least one physical processor;
physical memory comprising computer-executable instructions that, when executed by the physical processor, cause the physical processor to:
determine that audio quality is to be adjusted for a multimedia streaming connection over which audio data and video data are being streamed to a content player, the audio data being streamed at a specified audio quality level and the video data being streamed at a specified video quality level;
determine that a specified minimum video quality level is to be maintained while adjusting the audio quality level; and
dynamically adjust the audio quality level of the multimedia streaming connection while maintaining the video quality level of the multimedia streaming connection at at least the specified minimum video quality level.

### Claim 13 (depends on 12)

The system of claim 12, wherein the video quality level is prioritized over the audio quality level in the multimedia streaming connection, such that the audio quality level is dynamically reduced to maintain a specified minimum video quality level.

### Claim 14 (depends on 12)

The system of claim 12, wherein a bit rate associated with the audio data in the multimedia streaming connection is varied dynamically based on underlying content associated with the audio data.

### Claim 15 (depends on 12)

The system of claim 12, further comprising, prior to streaming data through the multimedia streaming connection, determining a startup delay that would be incurred if a higher audio bitrate were to be used to stream the audio data.

### Claim 16 (depends on 12)

The system of claim 12, wherein the audio and video data are streamed to the content player according to one or more margin curves.

### Claim 17 (depends on 12)

The system of claim 12, wherein the audio quality level is dynamically adjusted for a plurality of audio data streams that are part of the multimedia streaming connection.

### Claim 18 (depends on 12)

The system of claim 12, further comprising:
analyzing one or more portions of prior transmission data associated with audio and video data transferred during the multimedia streaming connection;
predicting a future amount of audio and video data that will be transferred using the multimedia streaming connection; and
dynamically adjusting the audio quality level based on the predicted future amount of audio and video data that is to be transferred using the multimedia streaming connection.

### Claim 19 (depends on 12)

The system of claim 12, further comprising locking the audio quality level at a specified level for at least a minimum amount of time after the dynamic adjustment.

### Claim 20

A non-transitory computer-readable medium comprising one or more computer-executable instructions that, when executed by at least one processor of a computing device, cause the computing device to:
determine that audio quality is to be adjusted for a multimedia streaming connection over which audio data and video data are being streamed to a content player, the audio data being streamed at a specified audio quality level and the video data being streamed at a specified video quality level;
determine that a specified minimum video quality level is to be maintained while adjusting the audio quality level; and
dynamically adjust the audio quality level of the multimedia streaming connection while maintaining the video quality level of the multimedia streaming connection at at least the specified minimum video quality level.
