# US 2020/0349958 A1 · Apparatus for encoding and decoding of integrated speech and audio

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0349958 A1
- Document ID: US20200349958A1
- Status: Published application
- Kind: A1
- Application number: 16/925,946
- Filed: 2020-07-10
- Published: 2020-11-05
- Earliest claimed: 2008-07-14
- Assignees: Electronics and Telecommunications Research Institute; Kwangwoon University Industry-Academic Collaboration Foundation
- Applicants: Electronics and Telecommunications Research Institute; Kwangwoon University Industry-Academic Collaboration Foundation
- Inventors: Tae Jin LEE; Seung-Kwon BAEK; Min Je KIM; Dae Young JANG; Jeongil SEO; Kyeongok KANG; Jin-Woo HONG; Hochong PARK; Young-Cheol PARK
- Web page: https://patentgrep.com/patent/US20200349958A1

## CPC

- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- G10L 19/02: using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L 19/04: using predictive techniques
- G10L 19/12: the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
- G10L 19/20: using sound class specific coding, hybrid encoders or object based coding
- G10L 19/00: Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis (in musical instruments G10H)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Provided is an encoding apparatus for integrally encoding and decoding a speech signal and a audio signal, and may include: an input signal analyzer to analyze a characteristic of an input signal; a stereo encoder to down mix the input signal to a mono signal when the input signal is a stereo signal, and to extract stereo sound image information; a frequency band expander to expand a frequency band of the input signal; a sampling rate converter to convert a sampling rate ; a speech signal encoder to encode the input signal using a speech encoding module when the input signal is a speech characteristics signal; a audio signal encoder to encode the input signal using a audio encoding module when the input signal is a audio characteristic signal; and a bitstream generator to generate a bitstream.

## Claims

### Claim 1

An encoding method of an input signal performed by at least one processor, the encoding method comprising:
determining a frame of the input signal whether the frame is a speech frame or an audio frame;
encoding the input signal in a speech encoder based CELP coding scheme when the frame is the speech frame, and
encoding the input signal in an audio encoder based MDCT coding scheme when the frame is the audio frame; and
wherein the input signal is processed by using information for compensating a change of a frame unit between the speech frame and the audio frame when a switching occurs between the speech frame and the audio frame in a decoding process about the input signal.

### Claim 2 (depends on 1)

The encoding method of claim 1, wherein the input signal is encoded with respect to a core band,
wherein the core band is a low frequency band which is not expanded in a frequency band of the input signal,
wherein a high frequency band is generated from the core band based on a frequency band expander in a decoding process.

### Claim 3 (depends on 1)

The encoding method of claim 1, further comprising:
generating information for generating the high frequency band;
wherein the bitstream includes the generated information.

### Claim 4 (depends on 1)

The encoding method of claim 1, further comprising:
converting a sampling rate of the input signal to a sampling rate for the encoding a core band of the input signal.

### Claim 5 (depends on 4)

The encoding method of claim 4, wherein the converting comprises:
converting the sampling rate of the input signal to a sampling rate with respect to a core band of the input signal.

### Claim 6 (depends on 4)

The encoding method of claim 4, wherein the converting comprises:
down-sampling the sampling rate of the input signal by one half (½).

### Claim 7 (depends on 4)

The encoding method of claim 4, wherein the converting comprises:
down-sampling the sampling rate of the input signal by one quarter (¼).

### Claim 8 (depends on 1)

The encoding method of claim 1, wherein the information for compensating at least one change between the speech frame and the audio frame includes an encoded portion of the speech frame of the input signal for decoding the audio frame of the input signal.

### Claim 9

A decoding method for an encoded input signal performed by at least one processor, the decoding method comprising:
determining whether a frame of the input signal is a speech frame or an audio frame;
decoding a core band of the input signal by:
decoding the core band of the input signal in a speech decoder based on CELP coding scheme when the frame is the speech frame, and
decoding the core band of the input signal in an audio decoder based on MDCT coding scheme when the frame is the audio frame.

### Claim 10 (depends on 9)

The decoding method of claim 9, wherein the input signal is decoded with respect to a core band,
wherein the core band is a low frequency band which is not expanded in a frequency band of the input signal.

### Claim 11 (depends on 10)

The decoding method of claim 10, further comprising:
expanding a frequency band of the input signal by generating a high frequency band from the core band of the input signal.

### Claim 12 (depends on 9)

The decoding method of claim 9, further comprising:
generating a stereo signal from the input signal having the expanded frequency band.

### Claim 13 (depends on 9)

The decoding method of claim 9, wherein the input signal is compensated using information for compensating at least one change between the speech frame and the audio frame.

### Claim 14 (depends on 13)

The decoding method of claim 13, wherein the information includes an encoded portion of the speech frame of the input signal for decoding the audio frame of the input signal

### Claim 15 (depends on 9)

The decoding method of claim 9, further comprising:
converting a sampling rate of the decoded input signal based on a sampling rate for the decoding the core band.

### Claim 16 (depends on 12)

The decoding method of claim 12, wherein the sampling rate for the SBR is twice the sampling rate for the decoding a core band of the input signal.

### Claim 17 (depends on 12)

The decoding method of claim 12, wherein the sampling rate for the SBR is fourfold the sampling rate for the decoding a core band of the input signal.

### Claim 18

A decoding method for an encoded input signal performed by at least one processor, comprising:
determining whether a frame of the input signal is a speech frame or an audio frame;
decoding a core band of the input signal by:
decoding the core band of the input signal in a speech decoder based on CELP when the frame is the speech frame, wherein the core band is a low frequency band which is not expanded in a frequency band of the input signal, and
decoding the core band of the input signal in an audio decoder based on MDCT when the frame is the audio frame; and
expanding the frequency band of the input signal by generating a high frequency band from the core band of the input signal based a SBR (Spectral Band Replication).

### Claim 19 (depends on 18)

The decoding method of claim 18, further comprising:
generating a stereo signal from the decoded input signal having the expanded frequency band.

### Claim 20 (depends on 18)

The decoding method of claim 18, wherein the sampling rate for the SBR is n times the sampling rate for the decoding a core band.
