# US 2025/0029594 A1 · Timbre selection method and apparatus, electronic device, readable storage medium, and program product

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0029594 A1
- Document ID: US20250029594A1
- Status: Published application
- Kind: A1
- Application number: 18/708,538
- Filed: 2022-11-10
- Published: 2025-01-23
- Earliest claimed: 2021-11-11
- Assignees: Beijing Zitiao Network Technology Co., Ltd.
- Applicants: Beijing Zitiao Network Technology Co., Ltd.
- Inventors: Keke WANG; Chen DING; Xudong MAO
- Web page: https://patentgrep.com/patent/US20250029594A1

## CPC

- G10L 13/033: Voice editing, e.g. manipulating the voice of the synthesiser
- G10L 13/04: Details of speech synthesis systems, e.g. synthesiser structure or memory management
- G10L 21/0308: characterised by the type of parameter measurement, e.g. correlation techniques, zero crossing techniques or predictive techniques
- G10L 25/18: the extracted parameters being spectral information of each sub-band
- G10L 25/51: for comparison or discrimination
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

The present disclosure relates to a timbre selection method and apparatus, an electronic device, a readable storage medium, and a program product. According to the method, a timbre feature of a speech to be matched is obtained by analyzing a spectral feature of the speech to be matched, and then a target sample audio is determined from at least one sample audio based on a similarity between the timbre feature of the speech to be matched and a timbre feature of the at least one sample audio, where a timbre of the target sample audio matches the timbre of the speech to be matched.

## Claims

### Claim 1

A timbre selection method, comprising:
performing spectral feature extraction on a speech to be matched, to obtain a spectral feature of the speech to be matched;
performing timbre feature extraction on the spectral feature of the speech to be matched, to obtain a timbre feature of the speech to be matched; and
determining a target sample audio from at least one initial sample audio based on the timbre feature of the speech to be matched and a timbre feature of the at least one initial sample audio, wherein a timbre of the target sample audio matches the timbre feature of the speech to be matched.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the timbre feature comprises a feature in one or more specific dimensions; and the determining a target sample audio from at least one initial sample audio based on the timbre feature of the speech to be matched and a timbre feature of the at least one initial sample audio comprises:
obtaining a similarity between a feature, in the specific dimension, of the timbre of the speech to be matched and the timbre of the at least one initial sample audio in the specific dimension according to a preset order corresponding to the one or more specific dimensions; and
performing step-by-step selection based on the similarity between the feature, in the specific dimension, of the timbre of the speech to be matched and the timbre of the at least one initial sample audio in the specific dimension, to determine the target sample audio from the at least one initial sample audio.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the feature in the one or more specific dimensions comprises: a timbre style feature and/or a voiceprint feature.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the determining a target sample audio from at least one initial sample audio based on the timbre feature of the speech to be matched and a timbre feature of the at least one initial sample audio comprises:
determining a plurality of candidate sample audios from a plurality of initial sample audios based on the timbre feature of the speech to be matched and timbre features of the plurality of initial sample audios; and
determining the target sample audio from the plurality of candidate sample audios.

### Claim 5 (depends on 1)

The method according to claim 1, wherein before the performing spectral feature extraction on a speech to be matched, to obtain a spectral feature of the speech to be matched, the method further comprises:
performing speech segmentation on an original speech, to obtain at least one speech segment; and
performing clustering on the at least one speech segment, to obtain the one or more speech segment sets, wherein each of the speech segment sets belongs to one voice role, and one of the speech segment sets comprises the speech to be matched.

### Claim 6 (depends on 5)

The method according to claim 5, wherein before the performing speech segmentation on an original speech, the method further comprises:
performing speech separation on an overlapping speech segment in the original speech, to obtain a speech segment corresponding to each voice role in the overlapping speech segment.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the method further comprises:
inputting a text to be dubbed to a speech synthesis model corresponding to the target sample audio, to obtain a target dub output by the speech synthesis model.

### Claim 8

(canceled)

### Claim 9

An electronic device, comprising: a memory and a processor;
wherein the memory is configured to store computer program instructions; and
the processor is configured to execute the computer program instructions, to implement a timbre selection method, the timbre selection method comprising:
performing spectral feature extraction on a speech to be matched, to obtain a spectral feature of the speech to be matched;
performing timbre feature extraction on the spectral feature of the speech to be matched, to obtain a timbre feature of the speech to be matched; and
determining a target sample audio from at least one initial sample audio based on the timbre feature of the speech to be matched and a timbre feature of the at least one initial sample audio, wherein a timbre of the target sample audio matches the timbre feature of the speech to be matched.

### Claim at position 10

10-11. (canceled)

### Claim 12 (depends on 9)

The electronic device according to claim 9, wherein the timbre feature comprises a feature in one or more specific dimensions; and the determining a target sample audio from at least one initial sample audio based on the timbre feature of the speech to be matched and a timbre feature of the at least one initial sample audio comprises:
obtaining a similarity between a feature, in the specific dimension, of the timbre of the speech to be matched and the timbre of the at least one initial sample audio in the specific dimension according to a preset order corresponding to the one or more specific dimensions; and
performing step-by-step selection based on the similarity between the feature, in the specific dimension, of the timbre of the speech to be matched and the timbre of the at least one initial sample audio in the specific dimension, to determine the target sample audio from the at least one initial sample audio.

### Claim 13 (depends on 9)

The electronic device according to claim 9, wherein the feature in the one or more specific dimensions comprises: a timbre style feature and/or a voiceprint feature.

### Claim 14 (depends on 9)

The electronic device according to claim 9, wherein the determining a target sample audio from at least one initial sample audio based on the timbre feature of the speech to be matched and a timbre feature of the at least one initial sample audio comprises:
determining a plurality of candidate sample audios from a plurality of initial sample audios based on the timbre feature of the speech to be matched and timbre features of the plurality of initial sample audios; and
determining the target sample audio from the plurality of candidate sample audios.

### Claim 15 (depends on 9)

The electronic device according to claim 9, wherein before the performing spectral feature extraction on a speech to be matched, to obtain a spectral feature of the speech to be matched, the method further comprises:
performing speech segmentation on an original speech, to obtain at least one speech segment; and
performing clustering on the at least one speech segment, to obtain the one or more speech segment sets, wherein each of the speech segment sets belongs to one voice role, and one of the speech segment sets comprises the speech to be matched.

### Claim 16 (depends on 9)

The electronic device according to claim 9, wherein the method further comprises:
inputting a text to be dubbed to a speech synthesis model corresponding to the target sample audio, to obtain a target dub output by the speech synthesis model.

### Claim 17

A non-transitory readable storage medium, comprising: computer program instructions; wherein when the computer program instructions are executed by at least one processor of an electronic device a timbre selection method, the timbre selection method comprising:
performing spectral feature extraction on a speech to be matched, to obtain a spectral feature of the speech to be matched;
performing timbre feature extraction on the spectral feature of the speech to be matched, to obtain a timbre feature of the speech to be matched; and
determining a target sample audio from at least one initial sample audio based on the timbre feature of the speech to be matched and a timbre feature of the at least one initial sample audio, wherein a timbre of the target sample audio matches the timbre feature of the speech to be matched.

### Claim 18 (depends on 17)

The non-transitory readable storage medium according to claim 17, wherein the timbre feature comprises a feature in one or more specific dimensions; and the determining a target sample audio from at least one initial sample audio based on the timbre feature of the speech to be matched and a timbre feature of the at least one initial sample audio comprises:
obtaining a similarity between a feature, in the specific dimension, of the timbre of the speech to be matched and the timbre of the at least one initial sample audio in the specific dimension according to a preset order corresponding to the one or more specific dimensions; and
performing step-by-step selection based on the similarity between the feature, in the specific dimension, of the timbre of the speech to be matched and the timbre of the at least one initial sample audio in the specific dimension, to determine the target sample audio from the at least one initial sample audio.

### Claim 19 (depends on 17)

The non-transitory readable storage medium according to claim 17, wherein the feature in the one or more specific dimensions comprises: a timbre style feature and/or a voiceprint feature.

### Claim 20 (depends on 17)

The non-transitory readable storage medium according to claim 17, wherein the determining a target sample audio from at least one initial sample audio based on the timbre feature of the speech to be matched and a timbre feature of the at least one initial sample audio comprises:
determining a plurality of candidate sample audios from a plurality of initial sample audios based on the timbre feature of the speech to be matched and timbre features of the plurality of initial sample audios; and
determining the target sample audio from the plurality of candidate sample audios.

### Claim 21 (depends on 17)

The non-transitory readable storage medium according to claim 17, wherein before the performing spectral feature extraction on a speech to be matched, to obtain a spectral feature of the speech to be matched, the method further comprises:
performing speech segmentation on an original speech, to obtain at least one speech segment; and
performing clustering on the at least one speech segment, to obtain the one or more speech segment sets, wherein each of the speech segment sets belongs to one voice role, and one of the speech segment sets comprises the speech to be matched.

### Claim 22 (depends on 21)

The non-transitory readable storage medium according to claim 21, wherein before the performing speech segmentation on an original speech, the method further comprises:
performing speech separation on an overlapping speech segment in the original speech, to obtain a speech segment corresponding to each voice role in the overlapping speech segment.

### Claim 23 (depends on 17)

The non-transitory readable storage medium according to claim 17, wherein the method further comprises: inputting a text to be dubbed to a speech synthesis model corresponding to the target sample audio, to obtain a target dub output by the speech synthesis model.
