# US 12,192,541 B2 · Adaptive audio bitrate selection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,192,541 B2
- Document ID: US12192541B2
- Status: Granted
- Kind: B2
- Application number: 18/126,838
- Filed: 2023-03-27
- Published: 2024-10-03
- Granted: 2025-01-07
- Earliest claimed: 2023-03-27
- Assignees: Roku, Inc.
- Applicants: Roku, Inc.
- Inventors: Rodrigo Emiliano Tocalini; Andrey Marsavin; Govind Vaidya; Robert Fitzgerald Watts; Wim Michiels
- Web page: https://patentgrep.com/patent/US12192541B2

## CPC

- H04N 21/2335: {involving reformatting operations of audio signals, e.g. by converting from one coding standard to another (details of audio signal transcoding G10L19/173)}
- H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
- H04N 21/44209: {Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network (arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for performing adaptive audio bitrate selection. An example embodiment operates by receiving a data streaming request. The embodiment then streams data at a first audio bitrate. The embodiment then determines whether there is a streaming discontinuity associated with the data. The embodiment then determines, in response to the determination that there is a streaming discontinuity, whether a network condition satisfies one or more conditions based on one or more streaming parameters. The embodiment then, in response to the determination that the network condition satisfies the one or more conditions, adjusts the first audio bitrate to a second audio bitrate during the streaming discontinuity. The embodiment then continues to stream the data, subsequent to the streaming discontinuity, at the second audio bitrate to complete the data streaming request.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving, by a media device, a data streaming request;
streaming data comprising video data at a first video bitrate and audio data at a first audio bitrate in response to the data streaming request;
first determining there is a streaming discontinuity associated with the data;
second determining, in response to the first determination that there is the streaming discontinuity, that a measured network bandwidth available for video downloads is lower or equal to a lowest available video bitrate, that a selected bitrate for the video data is equal to the lowest available video bitrate, and that the measured network bandwidth plus a difference between a highest available audio bitrate for the audio data and a lowest available audio bitrate for the audio data is greater than or equal to the selected bitrate for the video data;
in response to the second determination, adjusting the first audio bitrate to a second audio bitrate during the streaming discontinuity, wherein the second audio bitrate is different from the first audio bitrate; and
continuing to stream the data, subsequent to the streaming discontinuity, at the second audio bitrate to complete the data streaming request.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the streaming discontinuity comprises an event of a rebuffer, an event of a streaming session paused by a user, or an event of an interruption on the data.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the selected bitrate is associated with previously downloaded information.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the adjusting the first audio bitrate to the second audio bitrate during the streaming discontinuity comprises: selecting an audio stream at the second bitrate.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising:
subsequent to the continuing to stream the data at the second audio bitrate, third determining whether there is a subsequent streaming discontinuity associated with the data;
fourth determining, in response to the third determination that there is a subsequent streaming discontinuity, that the measured network bandwidth available for video downloads is lower or equal to the lowest available video bitrate, that the selected bitrate for the video data is equal to the lowest available video bitrate, and that the measured network bandwidth plus the difference between the highest available audio bitrate for the audio data and the lowest available audio bitrate for the audio data is greater than or equal to the selected bitrate for the video data;
in response to the fourth determination, adjusting the second audio bitrate to the first audio bitrate during the subsequent streaming discontinuity; and
continuing to stream the data, subsequent to the subsequent streaming discontinuity, at the first audio bitrate to complete the data streaming request.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising:
selecting the second audio bitrate based on an adaptive audio bitrate selection process.

### Claim 7

A computing system for performing adaptive audio bitrate selection, comprising:
one or more memories; and
at least one processor each coupled to at least one of the memories and configured to perform operations comprising:
receiving a data streaming request;
streaming data comprising video data at a first video bitrate and audio data at a first audio bitrate in response to the data streaming request;
first determining there is a streaming discontinuity associated with the data;
second determining, in response to the first determination that there is the streaming discontinuity, that a measured network bandwidth available for video downloads is lower or equal to a lowest available video bitrate, that a selected bitrate for the video data is equal to the lowest available video bitrate, and that the measured network bandwidth plus a difference between a highest available audio bitrate for the audio data and a lowest available audio bitrate for the audio data is greater than or equal to the selected bitrate for the video data;
in response to the second determination, adjusting the first audio bitrate to a second audio bitrate during the streaming discontinuity, wherein the second audio bitrate is different from the first audio bitrate; and
continuing to stream the data, subsequent to the streaming discontinuity, at the second audio bitrate to complete the data streaming request.

### Claim 8 (depends on 7)

The computing system of claim 7, wherein the streaming discontinuity comprises an event of a rebuffer, an event of a streaming session paused by a user, or an event of an interruption on the data.

### Claim 9 (depends on 7)

The computing system of claim 7, wherein the selected bitrate is associated with previously downloaded information.

### Claim 10 (depends on 7)

The computing system of claim 7, wherein the operation of the adjusting the first audio bitrate to the second audio bitrate during the streaming discontinuity comprises: selecting an audio stream at the second bitrate.

### Claim 11 (depends on 7)

The computing system of claim 7, the operations further comprising:
subsequent to the continuing to stream the data at the second audio bitrate, third determining whether there is a subsequent streaming discontinuity associated with the data;
fourth determining, in response to the third determination that there is a subsequent streaming discontinuity, that the measured network bandwidth available for video downloads is lower or equal to the lowest available video bitrate, that the selected bitrate for the video data is equal to the lowest available video bitrate, and that the measured network bandwidth plus the difference between the highest available audio bitrate for the audio data and the lowest available audio bitrate for the audio data is greater than or equal to the selected bitrate for the video data;
in response to the fourth determination, adjusting the second audio bitrate to the first audio bitrate during the subsequent streaming discontinuity; and
continuing to stream the data, subsequent to the subsequent streaming discontinuity, at the first audio bitrate to complete the data streaming request.

### Claim 12 (depends on 7)

The computing system of claim 7, wherein the operations further comprise:
selecting the second audio bitrate based on an adaptive audio bitrate selection process.

### Claim 13

A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:
receiving a data streaming request;
streaming data comprising video data at a first video bitrate and audio data at a first audio bitrate in response to the data streaming request;
first determining there is a streaming discontinuity associated with the data;
second determining, in response to the first determination that there is the streaming discontinuity, that a measured network bandwidth available for video downloads is lower or equal to a lowest available video bitrate, that a selected bitrate for the video data is equal to the lowest available video bitrate, and that the measured network bandwidth plus a difference between a highest available audio bitrate for the audio data and a lowest available audio bitrate for the audio data is greater than or equal to the selected bitrate for the video data;
in response to the second determination, adjusting the first audio bitrate to a second audio bitrate during the streaming discontinuity, wherein the second audio bitrate is different from the first audio bitrate; and
continuing to stream the data, subsequent to the streaming discontinuity, at the second audio bitrate to complete the data streaming request.

### Claim 14 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the streaming discontinuity comprises an event of a rebuffer, an event of a streaming session paused by a user, or an event of an interruption on the data.

### Claim 15 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the selected bitrate is associated with previously downloaded information.

### Claim 16 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the operation of the adjusting the first audio bitrate to the second audio bitrate during the streaming discontinuity comprises: selecting an audio stream at the second bitrate.

### Claim 17 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the operations further comprise:
selecting the second audio bitrate based on an adaptive audio bitrate selection process.
