# US 2019/0378483 A1 · Method and system for generating an audio or midi output file using a harmonic chord map

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378483 A1
- Document ID: US20190378483A1
- Status: Published application
- Kind: A1
- Application number: 16/550,051
- Filed: 2019-08-23
- Published: 2019-12-12
- Earliest claimed: 2018-03-15
- Assignees: Score Music Productions Limited
- Applicants: Score Music Productions Limited
- Inventors: Michael John Kiely
- Web page: https://patentgrep.com/patent/US20190378483A1

## CPC

- G10H 1/0066: {using a MIDI interface}
- G10H 1/0025: {Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece (automatically producing a series of tones G10H1/26)}
- G10H 1/38: Chord
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G10H 2210/076: for extraction of timing, tempo; Beat detection
- G10H 2210/081: for automatic key or tonality recognition, e.g. using musical rules or a knowledge base
- G10H 2210/086: for transcription of raw audio or music data to a displayed or printed staff representation or to displayable MIDI-like note-oriented data, e.g. in pianoroll format
- G10H 2210/125: Medley, i.e. linking parts of different musical pieces in one single piece, e.g. sound collage, DJ mix
- G10H 2210/375: Tempo or beat alterations; Music timing control
- G10H 2210/576: Chord progression
- G10H 2240/056: MIDI or other note-oriented file format
- G10H 2240/081: Genre classification, i.e. descriptive metadata for classification or selection of musical pieces according to style
- G10H 2240/085: Mood, i.e. generation, detection or selection of a particular emotional content or atmosphere in a musical piece
- G10H 2240/131: Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

Techniques are provided for generating an output file. One technique involves the steps of generating audio or MIDI content blocks from one or more musical performances; receiving an input file having audio or MIDI music content; generating a harmonic chord map for the input file; using the harmonic chord map to automatically select a subset of the audio or MIDI content blocks, and generating the output file by combining the selected subset of content blocks and the input file. This technique may enable the creation of unique and new musical accompaniments by re-purposing audio or MIDI content from back catalogs and/or out-takes of musical works. The new arrangement may be provided in multiple music styles, genres, or moods and may contain performances from multiple musical instruments, which may be pre-recorded from live instrument performances and/or of MIDI generated musical content.

## Claims

### Claim 1

A computer implemented method for generating an audio or MIDI output file, the method including using one or more processors to perform steps of:
generating audio or MIDI content blocks from one or more musical performances;
receiving an input file having audio or MIDI music content;
automatically generating a harmonic chord map for the input file;
using the harmonic chord map to automatically select a subset of the audio or MIDI content blocks, and
generating the audio or MIDI output file by combining the subset of the audio or MIDI content blocks and the input file.

### Claim 2 (depends on 1)

The method as claimed in claim 1, in which the step of generating the audio or MIDI content blocks includes steps of:
receiving an audio or MIDI file including content in a particular harmonic key from a musical performance;
determining the particular harmonic key and adapting the musical performance to correspond to a plurality of harmonic keys, including minor and major keys, and to a plurality of different tempos, and
recording said adapted musical performance in said plurality of harmonic keys and said plurality of tempos to generate the audio or MIDI content blocks.

### Claim 3 (depends on 2)

The method as claimed in claim 2, in which the step of using the harmonic chord map to select the subset of the audio or MIDI content blocks includes steps of:
for each bar in the harmonic chord map, determining a harmonic key and tempo;
selecting content blocks corresponding to one or more musical instruments for each bar in the harmonic chord map according to the harmonic key and tempo for said each bar.

### Claim 4 (depends on 1)

The method as claimed in claim 1, in which the step of generating the audio or MIDI content blocks includes steps of:
receiving an audio or MIDI file including content in a harmonic key from at least one musical performance;
determining the harmonic key of the musical performance, and
storing the audio or MIDI file as an audio or MIDI content block.

### Claim 5 (depends on 4)

The method as claimed in claim 4, in which the step of using the harmonic chord map to select the subset of the audio or MIDI content blocks includes steps of:
selecting one or more instrument types;
for each instrument type of the one or more instrument types:
identifying a set of content blocks for said each instrument type that match the tempo of each bar of music in the harmonic chord map, and
for each bar of music in the harmonic chord map, automatically selecting, from the set of content blocks, a content block that is in the same harmonic key, or that has a part or section that is in the same harmonic key, as the bar of music.

### Claim 6 (depends on 5)

The method as claimed in claim 5, further including a step of removing sections of the content block that are not in the same harmonic key as the bar of music of the harmonic chord map.

### Claim 7 (depends on 1)

The method as claimed in claim 1, including a step of cutting the audio or MIDI content blocks to desired intervals and/or lengths.

### Claim 8 (depends on 1)

The method as claimed in claim 1, in which the harmonic chord map is generated automatically or by a user manually inputting a chord structure and tempo for the input file.

### Claim 9 (depends on 1)

The method as claimed in claim 1, in which each bar of the harmonic chord map defines a linear time slot for a musical chord and each content block in the subset is assigned to a time slot of the harmonic chord map.

### Claim 10 (depends on 1)

The method as claimed in claim 1, wherein selecting the subset is further refined according to one or more of mood, style, or genre, wherein refining a content block according to one or more of mood, style or genre is performed before or after generation of the audio or MIDI output file.

### Claim 11 (depends on 1)

The method as claimed in claim 1, including a step of assigning a unique identifier to each of the audio or MIDI content blocks and using the unique identifiers to select a unique combination of the audio or MIDI content blocks.

### Claim 12 (depends on 11)

The method as claimed in claim 11, including a step of storing a record of the unique combination of unique identifiers for the subset of the audio or MIDI content blocks of the audio or MIDI output file generated in a storage device.

### Claim 13 (depends on 1)

The method as claimed in claim 1, including a step of operating a hold and replace module to hold some of the subset of the audio or MIDI content blocks and replace others of the subset of the audio or MIDI content blocks with alternative audio or MIDI content blocks according to user preference input and matching the harmonic chord map.

### Claim 14 (depends on 1)

The method as claimed in claim 1, including a step of operating a shuffle module to automatically hold some of the subset of the audio or MIDI content blocks and replace others of the subset of the audio or MIDI content blocks with alternative audio or MIDI content blocks matching the harmonic chord map.

### Claim 15 (depends on 1)

The method as claimed in claim 1, including a step of operating an audio editing and mixing module to modify, refine, adjust, vary or change audio or MIDI characteristics of a content block or the audio or MIDI output file.

### Claim 16 (depends on 1)

The method as claimed in claim 1, including a step of importing other instrument performances or voice from an external source for incorporation into the audio or MIDI output file.

### Claim 17 (depends on 1)

The method as claimed in claim 1, including a step of operating a synchronisation module to synchronise the audio or MIDI output file with an audio or MIDI file, a video file, a still image file, or a text file.

### Claim 18 (depends on 1)

The method as claimed in claim 1, including a step of storing each output file generated in a storage device for retrieval and re-use and linking a plurality of storage devices to provide an extended storage library of content blocks and audio or MIDI output files for creating further content blocks for re-use.

### Claim 19 (depends on 1)

A non-transitory machine-readable medium including instructions that, when executed by one or more processors, cause the one or processors to perform the steps according to claim 1.

### Claim 20

A computer implemented system for generating an audio or MIDI output file, the system including:
means for generating audio or MIDI content blocks from one or more musical performances;
means for receiving an input file having audio or MIDI music content;
means for automatically generating a harmonic chord map for the input file;
means for using the harmonic chord map to automatically select a subset of the audio or MIDI content blocks, and
means for generating the audio or MIDI output file by combining the subset of the audio or MIDI content blocks and the input file.
