# US 2023/0186877 A1 · Musical piece structure analysis device and musical piece structure analysis method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0186877 A1
- Document ID: US20230186877A1
- Status: Published application
- Kind: A1
- Application number: 18/164,575
- Filed: 2023-02-04
- Published: 2023-06-15
- Earliest claimed: 2020-08-17
- Assignees: Yamaha Corporation
- Applicants: Yamaha Corporation
- Inventors: Kouhei SUMI
- Web page: https://patentgrep.com/patent/US20230186877A1

## CPC

- G10H 1/0008: {Associated control or indicating means}
- G10G 1/00: Means for the representation of music
- G10H 2210/036: of musical genre, i.e. analysing the style of musical pieces, usually for selection, filtering or classification
- G10H 2210/051: for extraction or detection of onsets of musical sounds or notes, i.e. note attack timings
- G10H 2210/056: for extraction or identification of individual instrumental parts, e.g. melody, chords, bass; Identification or separation of instrumental parts by their characteristic voices or timbres
- G10H 2210/061: for extraction of musical phrases, isolation of musically relevant segments, e.g. musical thumbnail generation, or for temporal structure analysis of a musical piece, e.g. determination of the movement sequence of a musical work
- G10H 2210/066: for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
- G10H 2210/081: for automatic key or tonality recognition, e.g. using musical rules or a knowledge base
- G10H 2210/576: Chord progression
- G10H 2250/135: Autocorrelation
- G10H 2250/311: Neural networks for electrophonic musical instruments or musical processing, e.g. for musical recognition or control, automatic composition or improvisation
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10G: REPRESENTATION OF MUSIC; RECORDING MUSIC IN NOTATION FORM; ACCESSORIES FOR MUSIC OR MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR, e.g. SUPPORTS (music stands A47B; non-musical aspects of musical toy instruments A63H5/00; metronomes G04F5/02; teaching music G09B15/00)

## Abstract

A musical piece structure analysis method includes acquiring an acoustic signal of a musical piece, extracting a first feature amount indicating changes in tone from the acoustic signal of the musical piece, extracting a second feature amount indicating changes in chords from the acoustic signal of the musical piece, outputting a first boundary likelihood indicating likelihood of a constituent boundary of the musical piece from the first feature amount using a first learning model, outputting a second boundary likelihood indicating likelihood of the constituent boundary of the musical piece from the second feature amount using a second learning model, identifying the constituent boundary of the musical piece by performing weighted synthesis of the first boundary likelihood and the second boundary likelihood, and dividing the acoustic signal of the musical piece into a plurality of sections at the constituent boundary that has been identified.

## Claims

### Claim 1

A musical piece structure analysis method executed by a computer, the musical piece structure analysis method comprising:
acquiring an acoustic signal of a musical piece;
extracting a first feature amount indicating changes in tone from the acoustic signal of the musical piece;
extracting a second feature amount indicating changes in chords from the acoustic signal of the musical piece;
outputting a first boundary likelihood indicating likelihood of a constituent boundary of the musical piece from the first feature amount using a first learning model;
outputting a second boundary likelihood indicating likelihood of the constituent boundary of the musical piece from the second feature amount using a second learning model;
identifying the constituent boundary of the musical piece by performing weighted synthesis of the first boundary likelihood and the second boundary likelihood; and
dividing the acoustic signal of the musical piece into a plurality of sections at the constituent boundary that has been identified.

### Claim 2 (depends on 1)

The musical piece structure analysis method according to claim 1, further comprising estimating a section qualifying as a chorus of the musical piece from among the plurality of sections.

### Claim 3 (depends on 1)

The musical piece structure analysis method according to claim 1, further comprising accepting designation of a weighting coefficient, wherein
the identifying of the constituent boundary of the musical piece is carried out by performing the weighted synthesis of the first boundary likelihood and the second boundary likelihood based on the weighting coefficient.

### Claim 4

A musical piece structure analysis method executed by a computer, the musical piece structure analysis method comprising:
acquiring an acoustic signal of a musical piece;
dividing the acoustic signal of the musical piece into a plurality of sections;
classifying the plurality of sections into clusters based on similarity; and
estimating a section qualifying as a specific constituent type portion of the musical piece from the plurality of sections based on result of the classifying of the plurality of the sections.

### Claim 5 (depends on 4)

The musical piece structure analysis method according to claim 4, further comprising outputting the result of the classifying of the plurality of the sections in a viewable manner.

### Claim 6 (depends on 4)

The musical piece structure analysis method according to claim 4, wherein
the specific constituent type portion of the musical piece is a chorus portion of the musical piece.

### Claim 7 (depends on 4)

The musical piece structure analysis method according to claim 4, further comprising
extracting a first feature amount indicating changes in tone from the acoustic signal of the musical piece,
extracting a second feature amount indicating changes in chords from the acoustic signal of the musical piece,
outputting a first boundary likelihood indicating likelihood of a constituent boundary of the musical piece from the first feature amount using a first learning model,
outputting a second boundary likelihood indicating likelihood of the constituent boundary of the musical piece from the second feature amount using a second learning model,
accepting designation of a weighting coefficient, and
identifying the constituent boundary of the musical piece by performing weighted synthesis of the first boundary likelihood and the second boundary likelihood based on the weighting coefficient, wherein
the dividing of the acoustic signal of the musical piece into the plurality of sections is performed at the constituent boundary that has been identified.

### Claim 8

A musical piece structure analysis method executed by a computer, the musical piece structure analysis method comprising:
acquiring a divided acoustic signal of a musical piece that has been divided into a plurality of sections;
classifying the plurality of sections into clusters based on similarity; and
estimating a section qualifying as a chorus of the musical piece from the plurality of sections based on a counted number of one or more sections belonging to each of the clusters.

### Claim 9 (depends on 8)

The musical piece structure analysis method according to claim 8, further comprising
acquiring an acoustic signal of the musical piece,
extracting a first feature amount indicating changes in tone from the acoustic signal of the musical piece,
extracting a second feature amount indicating changes in chords from the acoustic signal of the musical piece,
outputting a first boundary likelihood indicating likelihood of a constituent boundary of the musical piece from the first feature amount using a first learning model,
outputting a second boundary likelihood indicating likelihood of the constituent boundary of the musical piece from the second feature amount using a second learning model,
accepting designation of a weighting coefficient,
identifying the constituent boundary of the musical piece by performing weighted synthesis of the first boundary likelihood and the second boundary likelihood based on the weighting coefficient, and
dividing the acoustic signal of the musical piece into the plurality of sections at the constituent boundary that has been identified, to obtain the divided acoustic signal of the musical piece.

### Claim 10

A musical piece structure analysis method executed by a computer, the musical piece structure analysis method comprising:
acquiring a divided acoustic signal of a musical piece that has been divided into a plurality of sections;
calculating a score for each of the plurality of section of the divided acoustic signal of the musical piece, based on at least one of similarity of a starting chord or an ending chord in each of the plurality of sections to a tonic chord of a key, or a likelihood of vocals being included in each of the plurality of sections, or both; and
estimating a section qualifying as a specific constituent type portion of the musical piece from the plurality of sections based on the score that has been calculated for each of the plurality of sections.

### Claim 11 (depends on 10)

The musical piece structure analysis method according to claim 10, wherein
the specific constituent type portion of the musical piece is a chorus portion of the musical piece.

### Claim 12 (depends on 10)

The musical piece structure analysis method according to claim 10, further comprising
acquiring an acoustic signal of the musical piece,
extracting a first feature amount indicating changes in tone from the acoustic signal of the musical piece,
extracting a second feature amount indicating changes in chords from the acoustic signal of the musical piece,
outputting a first boundary likelihood indicating likelihood of a constituent boundary of the musical piece from the first feature amount using a first learning model,
outputting a second boundary likelihood indicating likelihood of the constituent boundary of the musical piece from the second feature amount using a second learning model,
accepting designation of a weighting coefficient,
identifying the constituent boundary of the musical piece by performing weighted synthesis of the first boundary likelihood and the second boundary likelihood based on the weighting coefficient, and
dividing the acoustic signal of the musical piece into the plurality of sections at the constituent boundary that has been identified, to obtain the divided acoustic signal of the musical piece.
