# US 2014/0270196 A1 · Method and system for mitigating delay in receiving audio stream during production of sound from audio stream

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0270196 A1
- Document ID: US20140270196A1
- Status: Published application
- Kind: A1
- Application number: 13/835,638
- Filed: 2013-03-15
- Published: 2014-09-18
- Earliest claimed: 2013-03-15
- Assignees: Vocollect, Inc.
- Applicants: Vocollect, Inc.
- Inventors: Keith Braho; Russell Barr; Josh Karabin
- Web page: https://patentgrep.com/patent/US20140270196A1

## CPC

- G10L 21/047: characterised by the type of waveform to be thinned out or inserted
- G10L 13/08: Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
- H04R 2201/107: Monophonic and stereophonic headphones with microphone for two-way hands free communication
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

A communication component modifies production of an audio waveform at determined modification segments to thereby mitigate the effects of a delay in processing and/or receiving a subsequent audio waveform. The audio waveform and/or data associated with the audio waveform are analyzed to identify the modification segments based on characteristics of the audio waveform and/or data associated therewith. The modification segments show where the production of the audio waveform may be modified without substantially affecting the clarity of the sound or audio. In one embodiment, the invention modifies the sound production at the identified modification segments to extend production time and thereby mitigate the effects of delay in receiving and/or processing a subsequent audio waveform for production.

## Claims

### Claim 1

An apparatus comprising:
transceiver circuitry configured to receive an audio stream, the audio stream including an audio waveform;
a memory configured to store the received audio stream;
audio production circuitry configured to produce sound using the audio waveform;
processing circuitry configured to:
analyze the received audio stream and identify at least one modification segment of the audio waveform, where the modification segment corresponds to a segment of the audio waveform where production of the audio waveform may be modified to mitigate a delay in receiving the audio stream, and
drive production of sound using the audio waveform based at least in part on the at least one modification segment that was identified.

### Claim 2 (depends on 1)

The apparatus of claim 1 wherein the processing circuitry is configured to extend the audio waveform at the at least one identified modification segment.

### Claim 3 (depends on 2)

The apparatus of claim 2 wherein the processing circuitry is configured to analyze remaining time to produce sound using a received audio waveform and the expected time to receive a subsequent portion of an audio stream and to determine the duration for the extension of the audio waveform.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the identified modification segment corresponds to a segment of low amplitude in the audio waveform.

### Claim 5 (depends on 2)

The apparatus of claim 2, wherein the processing circuitry is configured to extend the audio waveform by pausing production of sound at the identified modification segment of the audio waveform for a desired time period.

### Claim 6 (depends on 1)

The apparatus of claim 1 wherein the processing circuitry is configured to drive production of sound by delaying production of sound until the modification segment is identified.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the identified modification segment corresponds to a segment of the audio waveform where the audio waveform is quasi-stationary.

### Claim 8 (depends on 2)

The apparatus of claim 2, wherein the processing circuitry is configured to extend the audio waveform by repeating the identified modification segment to extend the sound represented by the identified modification segment.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the audio stream includes metadata associated with the audio waveform that indicates a position of a type of sound included in the audio waveform, and the processing circuitry is configured to analyze the associated metadata to identify at least one modification segment corresponding to the position of the type of sound.

### Claim 10 (depends on 1)

The apparatus of claim 1, the processing circuitry being further configured to:
determine whether production of sound using the audio waveform will end before a subsequent portion of the audio stream is expected to be received, and
drive production of sound using the audio waveform based at least in part on the processing circuitry determining that the production of sound using the audio waveform will end before a subsequent portion of the audio stream is expected to be received.

### Claim 11 (depends on 1)

The apparatus of claim 1, the processing circuitry being further configured to:
determine whether production of sound using the audio waveform will end before a subsequent portion of the audio stream with an identified modification segment is expected to be received, and
drive production of sound using the audio waveform based at least in part on the processing circuitry determining that the production of sound using the audio waveform will end before a subsequent portion of the audio stream with an identified modification segment is expected to be received.

### Claim 12

A system comprising:
a transmitting device for transmitting an audio stream including an audio waveform;
a receiving device for receiving the audio stream including audio production circuitry configured to produce sound using the audio waveform of the audio stream;
processing circuitry of the transmitting device configured to analyze the audio stream and identify at least one modification segment of the audio waveform, where the modification segment corresponds to a segment of the audio waveform where production of the audio waveform may be modified to mitigate a delay when the receiving device receives the audio stream; and
processing circuitry of the receiving device configured for driving the production of sound using the audio waveform based at least in part on the at least one modification segment that was identified.

### Claim 13 (depends on 12)

The system of claim 12 wherein the processing circuitry of the receiving device is configured to extend the audio waveform at the at least one identified modification segment.

### Claim 14 (depends on 12)

The system of claim 12, wherein the identified modification segment corresponds to a segment of low amplitude in the audio waveform.

### Claim 15 (depends on 13)

The system of claim 13, wherein the processing circuitry is configured to extend the audio waveform by pausing production of sound at the identified modification segment of the audio waveform for a desired time period.

### Claim 16 (depends on 12)

The system of claim 12, wherein the identified modification segment corresponds to a segment of the audio waveform where the audio waveform is quasi-stationary.

### Claim 17 (depends on 13)

The system of claim 13, wherein the processing circuitry is configured to extend the audio waveform by repeating the identified modification segment to extend the sound represented by the identified modification segment.

### Claim 18

A method of producing sound from an audio waveform, the audio waveform being included in a received audio stream, the method comprising:
analyzing the audio stream to identify at least one modification segment of the audio waveform, where the modification segment corresponds to a segment of the audio waveform where production of the audio waveform may be modified to mitigate a delay in receiving the received the audio stream; and
producing sound using the audio waveform based at least in part on the at least one modification portion that was identified.

### Claim 19 (depends on 18)

The method of claim 18 further comprising extending the audio waveform at the at least one indentified modification segment and producing sound using the extended audio waveform.

### Claim 20 (depends on 19)

The method of claim 19 further comprising analyzing remaining time to produce sound using the received audio waveform and the expected time to receive a subsequent portion of an audio stream and to determine the duration for the extension of the audio waveform.

### Claim 21 (depends on 18)

The method of claim 18, wherein analyzing the audio stream includes analyzing the audio waveform to determine a segment of the audio waveform having a low amplitude, and identifying a segment of low amplitude as a modification segment.

### Claim 22 (depends on 19)

The method of claim 19 including pausing production of sound at the identified modification portion of the audio waveform for a desired time period to extend the audio waveform.

### Claim 23 (depends on 18)

The method of claim 18, wherein analyzing the audio stream includes analyzing the audio waveform to determine a segment of the audio waveform where the audio waveform is quasi-stationary, and identifying a quasi-stationary segment as a modification segment.

### Claim 24 (depends on 19)

The method of claim 19 including extending the waveform by repeating the identified modification segment to extend the sound represented by the identified modification segment.

### Claim 25 (depends on 18)

The method of claim 18, wherein the audio stream includes metadata associated with the audio waveform that indicates a position of a type of sound included in the audio waveform, the method further comprising analyzing the associated metadata and identifying at least one modification segment corresponding to the position of the type of sound.

### Claim 26 (depends on 18)

The method of claim 18, further comprising:
determining whether production of sound using the audio waveform of the received audio stream will end before a subsequent portion of the audio stream is expected to be received; and
producing the sound using the audio waveform based at least in part on whether production of sound using the audio waveform will end before a subsequent portion of the audio stream is expected to be received.
