# US 2021/0174815 A1 · Quantization method of latent vector for audio encoding and computing device for performing the method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174815 A1
- Document ID: US20210174815A1
- Status: Published application
- Kind: A1
- Application number: 17/112,480
- Filed: 2020-12-04
- Published: 2021-06-10
- Earliest claimed: 2019-12-05
- Assignees: Electronics and Telecommunications Research Institute
- Applicants: Electronics and Telecommunications Research Institute
- Inventors: Seung Kwon BEACK; Jooyoung LEE; Jongmo SUNG; Mi Suk LEE; Tae Jin LEE; Woo-taek LIM; Seunghyun CHO; Jin Soo CHOI
- Web page: https://patentgrep.com/patent/US20210174815A1

## CPC

- G10L 19/00: Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis (in musical instruments G10H)
- G10L 19/038: Vector quantisation, e.g. TwinVQ audio
- G06N 3/02: Neural networks
- G06N 3/045: Combinations of networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N 3/08: Learning methods
- G10L 19/028: Noise substitution, i.e. substituting non-tonal spectral components by noisy source (comfort noise for discontinuous speech transmission G10L19/012)
- G10L 19/24: Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
- G10L 25/30: using neural networks
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Disclosed are a quantizing method for a latent vector and a computing device for performing the quantization method. A quantizing method of a latent vector includes performing information shaping on the latent vector resulting from reduction in a dimension of an input signal using a target neural network; clamping a residual signal of the latent vector derived based on the information shaping; performing resealing on the clamped residual signal; and performing quantization on the resealed residual signal.

## Claims

### Claim 1

A quantization method of a latent vector, comprising:
performing information shaping on the latent vector resulting from reduction in a dimension of an input signal using a target neural network;
clamping a residual signal of the latent vector derived based on the information shaping;
performing resealing on the clamped residual signal; and
performing quantization on the resealed residual signal.

### Claim 2 (depends on 1)

The method of claim 1, wherein the performing the information shaping to performs information shaping by applying a scale factor predicted by a helper neural network to the latent vector.

### Claim 3 (depends on 1)

The method of claim 1, wherein the performing the information shaping performs scaling down the latent vector by dividing the latent vector using the scale vector and is determines the residual signal of the latent vector.

### Claim 4 (depends on 1)

The method of claim 1, wherein the clamping the residual signal of the latent vector performs clipping by applying a predetermined minimum value and a predetermined maximum value to the residual signal of the latent vector derived from the information shaping.

### Claim 5 (depends on 1)

The method of claim 1, wherein the performing the resealing adjusts a scale of a clamped residual signal by applying a quantization resolution to the clamped residual signal.

### Claim 6 (depends on 5)

The method of claim 5, wherein the quantization resolution of the latent vector is adjusted according to a bit rate.

### Claim 7 (depends on 1)

The method of claim 1, wherein the performing the quantization quantizes a residual signal by applying random noise to the resealed residual signal.

### Claim 8

A computing device for performing a quantization method of a latent vector, comprising:
one or more processor configured to:
perform information shaping on the latent vector resulting from reduction in a dimension of an input signal using a target neural network;
clamp a residual signal of the latent vector derived based on the information shaping;
perform resealing on the clamped residual signal; and
perform quantization on the resealed residual signal.

### Claim 9 (depends on 8)

The computing device of claim 8, wherein the processor performs information shaping by applying a scale factor predicted by a helper neural network to the latent vector.

### Claim 10 (depends on 8)

The computing device of claim 8, wherein the processor performs scaling down the latent vector by dividing the latent vector using the scale vector and determines the residual signal of the latent vector.

### Claim 11 (depends on 8)

The computing device of claim 8, wherein the processor performs clipping by applying a predetermined minimum value and a predetermined maximum value to the residual signal of the latent vector derived from the information shaping.

### Claim 12 (depends on 8)

The computing device of claim 8, wherein the processor adjusts a scale of a clamped residual signal by applying a quantization resolution to the clamped residual signal.

### Claim 13 (depends on 12)

The computing device of claim 12, wherein the quantization resolution of the latent vector is adjusted according to a bit rate.

### Claim 14 (depends on 8)

The computing device of claim 8, wherein the processor quantizes a residual signal by applying random noise to the resealed residual signal.
