# US 2025/0232784 A1 · Display method relating to sound waveform characteristic distribution

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0232784 A1
- Document ID: US20250232784A1
- Status: Published application
- Kind: A1
- Application number: 19/169,733
- Filed: 2025-04-03
- Published: 2025-07-17
- Earliest claimed: 2022-10-04
- Assignees: Yamaha Corporation
- Applicants: Yamaha Corporation
- Inventors: Ryunosuke DAIDO; Keijiro SAINO; Masanari NISHIMURA; Masahiro SHIMIZU
- Web page: https://patentgrep.com/patent/US20250232784A1

## CPC

- G10L 21/10: Transforming into visible information
- G10H 1/0008: {Associated control or indicating means}
- G10H 7/12: by means of a recursive algorithm using one or more sets of parameters stored in a memory and the calculated amplitudes of one or more preceding sample points
- G10L 15/063: {Training}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 25/30: using neural networks
- G10H 2210/091: for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
- G10H 2220/005: Non-interactive screen display of musical or status data
- G10H 2220/126: for graphical editing of individual notes, parts or phrases represented as variable length segments on a 2D or 3D representation, e.g. graphical edition of musical collage, remix files or pianoroll representations of MIDI-like files
- G10H 2250/455: Gensound singing voices, i.e. generation of human voices for musical applications, vocal singing sounds or intelligible words at a desired pitch or with desired vocal effects, e.g. by phoneme synthesis
- G10L 13/00: Speech synthesis; Text to speech systems
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE

## Abstract

A method for displaying information relating to an acoustic model that is established by being trained using a plurality of sound waveforms so as to generate acoustic features includes acquiring characteristic distribution of the plurality of sound waveforms used for training of the acoustic model. A characteristic of the characteristic distribution is one or more sound waveform characteristics.

## Claims

### Claim 1

A method for displaying information relating to an acoustic model that is established by being trained using a plurality of sound waveforms so as to generate acoustic features, the method comprising:
acquiring characteristic distribution of the plurality of sound waveforms used for training of the acoustic model, a characteristic of the characteristic distribution being one or more sound waveform characteristics; and
displaying information relating to the characteristic distribution.

### Claim 2 (depends on 1)

The display method according to claim 1, wherein
the characteristic distribution is acquired by analyzing the plurality of sound waveforms.

### Claim 3 (depends on 1)

The display method according to claim 1, wherein
the information relating to the characteristic distribution indicates a lack of the training of the acoustic model.

### Claim 4 (depends on 1)

The display method according to claim 1, wherein
the information relating to the characteristic distribution indicates an ability acquired by the acoustic model through the training.

### Claim 5 (depends on 1)

The display method according to claim 1, wherein
the acquiring is performed by acquiring, before the training of the acoustic model that is expected to be established through the training, the characteristic distribution of the plurality of sound waveforms used for the training of the acoustic model, and
in the displaying, information relating to the characteristic distribution of the plurality of sound waveforms used for the training of the acoustic model is displayed.

### Claim 6 (depends on 5)

The display method according to claim 5, wherein
the training is additional training, and
the characteristic distribution is a characteristic distribution obtained by analyzing a plurality of sound waveforms that have been used for previous training of the acoustic model before the additional training and a sound waveform that is additionally used for the additional training.

### Claim 7 (depends on 6)

The display method according to claim 6, wherein
the acoustic model before the additional training is selected by a user from among a plurality of trained acoustic models.

### Claim 8 (depends on 1)

The display method according to claim 1, wherein
the one or more sound waveform characteristics include one or more of pitch, intensity, phoneme, duration, or style.

### Claim 9 (depends on 1)

The display method according to claim 1, wherein
the one or more sound waveform characteristics include a first characteristic and a second characteristic, and
in the displaying, a graph indicating a two-dimensional distribution of the first characteristic and the second characteristic is displayed.

### Claim 10 (depends on 1)

The display method according to claim 1, wherein
the acquiring of the characteristic distribution is performed by analyzing the plurality of sound waveforms and acquiring, as the one or more sound waveform characteristics, a first characteristic and a second characteristic, and
in the displaying, the characteristic distribution of the second characteristic in a state in which the first characteristic is within a prescribed range is displayed.

### Claim 11 (depends on 1)

The display method according to claim 1, wherein
the displaying includes
detecting, in the characteristic distribution that has been acquired, a lacking range of the plurality of sound waveforms related to the characteristic distribution, which is a range in which the characteristic distribution is smaller than a threshold value, and
displaying the lacking range.

### Claim 12 (depends on 11)

The display method according to claim 11, wherein
in the displaying, a characteristic value of at least one of an upper limit and a lower limit of the lacking range is displayed.

### Claim 13 (depends on 11)

The display method according to claim 11, wherein
the displaying includes
detecting, from among a plurality of musical pieces, a plurality of candidate musical pieces containing a note with a characteristic value within the lacking range, and
presenting the plurality of candidate musical pieces to a user.

### Claim 14 (depends on 1)

The display method according to claim 1, wherein
the acoustic model is a model that has acquired an ability to generate second acoustic features in accordance with musical score features of a second musical piece, by being trained using training data that contain musical score features of at least a part of the plurality of sound waveforms of a first musical piece and contain first acoustic features of the plurality of sound waveforms,
the acquiring includes
acquiring history data indicating a history of the plurality of sound waveforms used for the training of the acoustic model, and
acquiring the information related to the characteristic distribution of the plurality of sound waveforms used for the training of the acoustic model, based on the history data, and
in the displaying, the information that relates to the characteristic distribution and has been acquired is displayed.

### Claim 15 (depends on 14)

The display method according to claim 14, wherein
in the displaying, a degree of proficiency of the acoustic model with respect to the musical score features of the second musical piece is displayed based on the characteristic distribution that has been acquired.

### Claim 16 (depends on 14)

The display method according to claim 14, wherein
the displaying includes
evaluating a degree of proficiency of the acoustic model with respect to the second musical piece based on a musical score of the second musical piece and the characteristic distribution that has been acquired, and
displaying the degree of proficiency.

### Claim 17 (depends on 14)

The method according to claim 14, wherein
the displaying includes
evaluating, based on a musical score of each section of the second musical piece and the characteristic distribution that has been acquired, a degree of proficiency of the acoustic model with respect to each section of the second musical piece, and
displaying the degree of proficiency for each section.

### Claim 18 (depends on 14)

The display method according to claim 14, wherein
the displaying includes
evaluating a degree of proficiency of the acoustic model with respect to each of a plurality of second musical pieces based on a plurality of musical scores of the plurality of second musical pieces and the characteristic distribution that has been acquired, and
displaying a recommendation of at least one of the plurality of second musical pieces based on the degree of proficiency.

### Claim 19 (depends on 14)

The display method according to claim 14, wherein
the acquiring is performed for each of a plurality of acoustic models including the acoustic model to acquire a plurality of characteristic distribution of the plurality of acoustic models, and
in the displaying, a recommendation of one or more acoustic models matching the second musical piece is displayed based on a musical score of the second musical piece and the plurality of characteristic distributions of the plurality of acoustic models that have been acquired.

### Claim 20 (depends on 14)

The display method according to claim 14, wherein
during execution of a generation method, in which portions of a musical score of a second musical piece are sequentially received, features of each of the portions of the musical score is subjected to real-time processing using the acoustic model, and a portion of the second acoustic features which corresponds to each of the portions of the musical score is generated in real time, the displaying includes
evaluating, in real time, a degree of proficiency of the acoustic model with respect to each of the portions of the musical score based on each of the portions of the musical score and the characteristic distribution that has been acquired, and
displaying the degree of proficiency evaluated in real time.
