# US 10,454,811 B2 · Apparatus and method for de-jitter buffer delay adjustment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,454,811 B2
- Document ID: US10454811B2
- Status: Granted
- Kind: B2
- Application number: 15/644,206
- Filed: 2017-07-07
- Published: 2018-10-11
- Granted: 2019-10-22
- Earliest claimed: 2017-04-07
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Tien-Hsin Lee; Matthew Zivney; Manjunatha Kantharaju; Shankar Ganesh Lakshmanaswamy; Kirankumar Bhoja Anchan; Vasudev Nayak
- Web page: https://patentgrep.com/patent/US10454811B2

## CPC

- H04L 45/121: by minimising delays
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- H04L 43/04: Processing captured monitoring data, e.g. for logfile generation
- H04L 43/0858: {One way delays}
- H04L 43/087: Jitter
- H04L 47/30: in combination with information about buffer occupancy at either end or at transit nodes
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An apparatus includes de-jitter buffer control circuitry configured to determine an arrival delay value based on previously received audio packets, to identify a receive time of a first audio packet of a talk spurt, to determine an offset value of the first audio packet based on the receive time and the arrival delay value, and to adjust a target delay value associated with a de-jitter buffer based on the offset value. The apparatus also includes a de-jitter buffer configured to buffer the first audio packet based on the adjusted target delay value.

## Claims

### Claim 1

An apparatus comprising:
de-jitter buffer control circuitry configured to determine an arrival delay value based on previously received audio packets, to identify a receive time of a first audio packet of a talk spurt, to determine an offset value of the first audio packet based on the receive time and the arrival delay value, and to adjust a target delay value associated with a de-jitter buffer in response to determining that a difference between a first delay value of a first particular subset of the previously received audio packets and a second delay value of a second particular subset of the previously received audio packets satisfies a convergence threshold, the target delay value adjusted based on the offset value; and
a de-jitter buffer configured to output the first audio packet at a first playout time and to output a second audio packet of the talk spurt at a second playout time, the first playout time based on the adjusted target delay value and the second playout time based on the first playout time and a playout rate.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the arrival delay value indicates an estimated average network delay associated with the previously received audio packets, wherein the adjusted target delay value represents an amount of time the first audio packet is buffered by the de-jitter buffer prior to output of the first audio packet from the de-jitter buffer.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the de-jitter buffer control circuitry is further configured to:
designate a particular received audio packet as a control frame; and
for each audio packet of the previously received audio packets:
determine a corresponding expected receive time for the audio packet based on a receive time of the control frame;
identify a corresponding receive time for the audio packet; and
determine a corresponding reference delay value of the audio packet based on a difference between the corresponding expected receive time of the audio packet and the corresponding receive time of the audio packet.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the arrival delay value comprises an average of the reference delay values of the previously received audio packets.

### Claim 5 (depends on 3)

The apparatus of claim 3, wherein the de-jitter buffer control circuitry is further configured to:
determine an expected receive time for the first audio packet based on a receive time of the control frame;
identify a received time for the first audio packet;
determine a reference delay value of the first audio packet based on a first difference between the expected receive time of the first audio packet and the receive time of the first audio packet; and
determine a second difference between the arrival delay value and the reference delay value of the first audio packet, wherein the offset value corresponds to the second difference.

### Claim 6 (depends on 5)

The apparatus of claim 5, further comprising a speaker device configured to, in response to receiving the first audio packet from the de-jitter buffer at the first playout time, output an audio representation of the first audio packet, wherein the de-jitter buffer control circuitry is configured to, in response to determining that the arrival delay value is less than the reference delay value of the first audio packet, generate the adjusted target delay value by decreasing the target delay value.

### Claim 7 (depends on 1)

The apparatus of claim 1, further comprising a receiver configured to receive the first audio packet.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the first audio packet comprises an initial audio packet of the talk spurt.

### Claim 9 (depends on 1)

The apparatus of claim 1, further comprising:
an antenna; and
a receiver coupled to the antenna and configured to receive the audio packets and to provide the audio packets to the de-jitter buffer control circuitry.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the de-jitter buffer control circuitry and the de-jitter buffer are included in a mobile communication device.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the de-jitter buffer control circuitry and the de-jitter buffer are included in a base station.

### Claim 12

A method comprising:
determining, at a device, an arrival delay value based on previously received audio packets;
identifying a receive time of a first audio packet of a talk spurt;
determining an offset value of the first audio packet based on the receive time and the arrival delay value;
adjusting a target delay value associated with a de-jitter buffer of the device in response to determining that a difference between a first delay value of a first particular subset of the previously received audio packets and a second delay value of a second particular subset of the previously received audio packets satisfies a convergence threshold, the target delay value adjusted based on the offset value;
outputting the first audio packet at a first playout time, the first playout time based on the adjusted target delay value; and
outputting a particular audio packet of the talk spurt at a second playout time, the second playout time based on the first playout time and a playout rate.

### Claim 13 (depends on 12)

The method of claim 12, further comprising detecting the first audio packet as an initial audio packet of the talk spurt.

### Claim 14 (depends on 12)

The method of claim 12, wherein adjusting the target delay value comprises increasing the target delay value.

### Claim 15 (depends on 12)

The method of claim 12, wherein adjusting the target delay value comprises decreasing the target delay value.

### Claim 16 (depends on 12)

The method of claim 12, further comprising:
determining a second arrival delay value; and
identifying a second receive time of a second audio packet of a second talk spurt.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
determining a second offset value of the second audio packet based on the second receive time and the second arrival delay value; and
determining whether to drop the second audio packet based on a comparison of the second offset value to a threshold.

### Claim 18 (depends on 17)

The method of claim 17, further comprising determining whether to adjust a second target delay value associated with the de-jitter buffer based on the second offset value.

### Claim 19 (depends on 18)

The method of claim 18, further comprising maintaining the second target delay value for the second audio packet based on a determination that a delay corresponding to the second audio packet is less than or equal to the second arrival delay value.

### Claim 20 (depends on 18)

The method of claim 18, further comprising adjusting the second target delay value in response a determination that a delay corresponding to the second audio packet is greater than the second arrival delay value.

### Claim 21 (depends on 17)

The method of claim 17, further comprising dropping the second audio packet in response to a determination that the second offset value is greater than or equal to the threshold.

### Claim 22 (depends on 21)

The method of claim 21, wherein the second audio packet comprises an initial audio packet of the second talk spurt.

### Claim 23 (depends on 21)

The method of claim 21, further comprising outputting a third audio packet of the second talk spurt, wherein the third audio packet comprises a sequentially next audio packet after the second audio packet.

### Claim 24 (depends on 12)

The method of claim 12, wherein the device comprises a mobile device or a base station.

### Claim 25

A computer-readable storage device storing instructions that, when executed by a processor, cause the processor to perform operations comprising:
determining an arrival delay value based on previously received audio packets;
identifying a receive time of a first audio packet of a talk spurt;
determining an offset value of the first audio packet based on the receive time and the arrival delay value;
adjusting a target delay value associated with a de-jitter buffer, the target delay value adjusted in response to determining that a difference between a first delay value of a first particular subset of the previously received audio packets and a second delay value of a second particular subset of the previously received audio packets satisfies a convergence threshold, the target delay value adjusted based on the offset value;
outputting the first audio packet at a first playout time, the first playout time based on the adjusted target delay value; and
outputting a particular audio packet of the talk spurt at a second playout time, the second playout time based on the first playout time and a playout rate.

### Claim 26 (depends on 25)

The computer-readable storage device of claim 25, wherein the instructions, when executed by the processor, further cause the processor to perform the operations comprising, in response to identifying the first audio packet of the talk spurt:
determining the first delay value as a first converged value based on first reference delay values of the first particular subset of the previously received audio packets, a reference delay value of an audio packet based on a difference between a receive time of the audio packet and an expected receive time of the audio packet; and
determining the second delay value as a second converged value based on second reference delay values of the second particular subset of the previously received audio packets.

### Claim 27 (depends on 25)

The computer-readable storage device of claim 25, wherein the arrival delay value is further based on a receive time of the first audio packet.

### Claim 28

An apparatus comprising:
means for determining an arrival delay value based on previously received audio packets;
means for identifying a receive time of a first audio packet of a talk spurt;
means for determining an offset value of the first audio packet based on the receive time and the arrival delay value;
means for adjusting a target delay value associated with means for buffering, the target delay value adjusted in response to a determination that a difference between a first delay value of a first particular subset of the previously received audio packets and a second delay value of a second particular subset of the previously received audio packets satisfies a convergence threshold, the target delay value adjusted based on the offset value;
means for outputting the first audio packet at a first playout time, the first playout time based on the adjusted target delay value; and
means for outputting a particular audio packet of the talk spurt at a second playout time, the second playout time based on the first playout time and a playout rate.

### Claim 29 (depends on 28)

The apparatus of claim 28, wherein the means for determining the arrival delay value, the means for identifying the receive time, the means for determining the offset value, the means for adjusting the target delay value, the means for outputting the first audio packet, and the means for outputting the particular audio packet are integrated into a mobile device.

### Claim 30 (depends on 28)

The apparatus of claim 28, wherein the means for determining the arrival delay value, the means for identifying the receive time, the, means for determining the offset value, the means for adjusting the target delay value, the means for outputting the first audio packet, and the means for outputting the particular audio packet are integrated into a base station.
