# US 2015/0106102 A1 · Gain shape estimation for improved tracking of high-band temporal characteristics

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0106102 A1
- Document ID: US20150106102A1
- Status: Published application
- Kind: A1
- Application number: 14/508,486
- Filed: 2014-10-07
- Published: 2015-04-16
- Earliest claimed: 2013-10-10
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Venkata Subrahmanyam Chandra Sekhar Chebiyyam; Venkatraman S. Atti
- Web page: https://patentgrep.com/patent/US20150106102A1

## CPC

- G10L 19/02: using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L 13/00: Speech synthesis; Text to speech systems
- G10L 19/0208: {Subband vocoders}
- G10L 19/04: using predictive techniques
- G10L 21/038: using band spreading techniques
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A method includes determining, at a speech encoder, first gain shape parameters based on a harmonically extended signal and/or based on a high-band residual signal associated with a high-band portion of an audio signal. The method also includes determining second gain shape parameters based on a synthesized high-band signal and based on the high-band portion of the audio signal. The method further includes inserting the first gain parameters and the second gain shape parameters into an encoded version of the audio signal to enable gain adjustment during reproduction of the audio signal from the encoded version of the audio signal.

## Claims

### Claim 1

A method comprising:
determining, at a speech encoder, first gain shape parameters based on a harmonically extended signal, based on a high-band residual signal associated with a high-band portion of an audio signal, or any combination thereof;
determining second gain shape parameters based on a synthesized high-band signal and based on the high-band portion of the audio signal; and
inserting the first gain shape parameters and the second gain shape parameters into an encoded version of the audio signal to enable gain adjustment during reproduction of the audio signal from the encoded version of the audio signal.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first gain shape parameters are determined in a linear prediction residual domain.

### Claim 3 (depends on 1)

The method of claim 1, wherein the second gain shape parameters are determined in a linear prediction synthesis domain.

### Claim 4 (depends on 1)

The method of claim 1, wherein the harmonically extended signal is generated from a low-band portion of the audio signal through non-linear harmonic extension.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
adjusting the harmonically extended signal based on the first gain shape parameters to generate a modified harmonically extended signal; and
generating a high-band excitation signal, wherein the high-band excitation signal is at least partially based on the modified harmonically extended signal.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
sampling a low-band frame of the harmonically extended signal to generate a first plurality of sub-frames;
sampling a corresponding high-band frame of the high-band residual signal to generate a second plurality of sub-frames; and
generating the first gain shape parameters based on energy levels of the first plurality of sub-frames, based on energy levels of the second plurality of sub-frames, or any combination thereof.

### Claim 7 (depends on 6)

The method of claim 6, wherein adjusting the harmonically extended signal comprises scaling a particular sub-frame of the first plurality of sub-frames to approximate an energy level of a corresponding sub-frame of the second plurality of sub-frames.

### Claim 8 (depends on 6)

The method of claim 6, wherein the second plurality of sub-frames includes a first number of sub-frames in response to a determination that the high-band frame is a voiced frame, and wherein the second plurality of sub-frames includes a second number of sub-frames that is less than the first number of sub-frames in response to a determination that the high-band frame is not a voiced frame.

### Claim 9 (depends on 6)

The method of claim 6, wherein the first plurality of sub-frames and the second plurality of sub-frames include the same number of sub-frames for both a voiced frame and an unvoiced frame, wherein the first plurality of sub-frames and the second plurality of sub-frames include four sub-frames if a low band core sample rate is 12.8 kilohertz (kHz), and wherein the first plurality of sub-frames and the second plurality of sub-frames include five sub-frames if the low band core sample rate is 16 kHz.

### Claim 10 (depends on 5)

The method of claim 5, further comprising:
performing a linear prediction synthesis operation on the high-band excitation signal to generate a synthesized high-band signal;
determining second gain shape parameters based on the synthesized high-band signal and based on the high-band portion of the audio signal; and
inserting the second gain shape parameters into the encoded version of the audio signal.

### Claim 11 (depends on 10)

The method of claim 10, further comprising adjusting the synthesized high-band signal based on the second gain shape parameters.

### Claim 12

An apparatus comprising:
a first gain shape estimator configured to determine first gain shape parameters based on a harmonically extended signal, based on a high-band residual signal associated with a high-band portion of an audio signal, or any combination thereof;
a second gain shape estimator configured to determine second gain shape parameters based on a synthesized high-band signal and based on the high-band portion of the audio signal; and
circuitry configured to insert the first gain shape parameters and the second gain shape parameters into an encoded version of the audio signal to enable gain adjustment during reproduction of the audio signal from the encoded version of the audio signal.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the first gain shape parameters are determined in the linear prediction residual domain.

### Claim 14 (depends on 12)

The apparatus of claim 12, wherein the circuitry includes a multiplexer.

### Claim 15 (depends on 12)

The apparatus of claim 12, wherein the harmonically extended signal is generated from a low-band portion of the audio signal through non-linear harmonic extension.

### Claim 16 (depends on 12)

The apparatus of claim 12, further comprising a first gain shape adjuster configured to adjust the harmonically extended signal based on the first gain shape parameters to generate a modified harmonically extended signal.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the first gain shape estimator is further configured to:
sample a low-band frame of the harmonically extended signal to generate a first plurality of sub-frames;
sample a corresponding high-band frame of the high-band residual signal to generate a second plurality of sub-frames; and
generate the first gain shape parameters based on energy levels of the first plurality of sub-frames, based on energy levels of the second plurality of sub-frames, or any combination thereof.

### Claim 18 (depends on 17)

The apparatus of claim 17, further comprising a first gain shape adjuster configured to adjust the harmonically extended signal by scaling a particular sub-frame of the first plurality of sub-frames to approximate an energy level of a corresponding sub-frame of the second plurality of sub-frames.

### Claim 19 (depends on 17)

The apparatus of claim 17, wherein the first plurality of sub-frames includes a first number of sub-frames in response to a determination that the high-band frame is a voiced frame, and wherein the first plurality of sub-frames includes a second number of sub-frames that is less than the first number of sub-frames in response to a determination that the high-band frame is not a voiced frame.

### Claim 20 (depends on 17)

The apparatus of claim 17, wherein the first plurality of sub-frames includes sixteen sub-frames in response to a determination that the high-band frame is a voiced frame.

### Claim 21 (depends on 16)

The apparatus of claim 16, further comprising a linear prediction synthesizer configured to perform a linear prediction synthesis operation on the high-band excitation signal to generate the synthesized high-band signal.

### Claim 22 (depends on 12)

The apparatus of claim 12, further comprising a second gain shape adjuster configured to adjust the synthesized high-band signal based on the second gain shape parameters.

### Claim 23

A method comprising:
receiving, at a speech decoder, an encoded audio signal from a speech encoder, wherein the encoded audio signal comprises:
first gain shape parameters based on a first harmonically extended signal generated at the speech encoder, based on a high-band residual signal generated at the speech encoder, or any combination thereof; and
second gain shape parameters based on a first synthesized high-band signal generated at the speech encoder and based on a high-band of an audio signal; and
reproducing the audio signal from the encoded audio signal based on the first gain shape parameters and based on the second gain shape parameters.

### Claim 24 (depends on 23)

The method of claim 23, wherein reproducing the audio signal at the speech decoder comprises:
generating a second harmonically extended signal based on non-linearly extending a low-band excitation of the encoded audio signal; and
adjusting the second harmonically extended signal based on the first gain shape parameters to obtain a second modified harmonically extended signal.

### Claim 25 (depends on 24)

The method of claim 24, further comprising generating a second high-band excitation signal based on the modified second harmonically extended signal.

### Claim 26 (depends on 25)

The method of claim 25, further comprising performing a linear prediction synthesis operation on the second high-band excitation signal to generate a second synthesized high-band signal.

### Claim 27 (depends on 26)

The method of claim 26, further comprising adjusting the second synthesized high-band signal based on the second gain shape parameters.

### Claim 28

A speech decoder configured to:
receive an encoded audio signal from a speech encoder, wherein the encoded audio signal comprises:
first gain shape parameters based on a first harmonically extended signal generated at the speech encoder, based on a high-band residual signal generated at the speech encoder, or any combination thereof; and
second gain shape parameters based on a first synthesized high-band signal generated at the speech encoder and based on a high-band of an audio signal; and
reproduce the audio signal from the encoded audio signal based on the first gain shape parameters and based on the second gain shape parameters.

### Claim 29 (depends on 28)

The speech decoder of claim 28, comprising:
a non-linear excitation generator configured to generate a second harmonically extended signal based on a low-band excitation of the encoded audio signal; and
a first gain shape adjuster configured to adjust the second harmonically extended signal based on the first gain shape parameters to obtain a second modified harmonically extended signal.

### Claim 30 (depends on 29)

The speech decoder of claim 29, further comprising a high-band excitation generator configured to generate a second high-band excitation signal based on the modified second harmonically extended signal.
