# US 12,225,648 B2 · Systems and methods for a music feature file and coordinated light show

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,225,648 B2
- Document ID: US12225648B2
- Status: Granted
- Kind: B2
- Application number: 18/332,234
- Filed: 2023-06-09
- Published: 2023-10-05
- Granted: 2025-02-11
- Earliest claimed: 2019-12-20
- Assignees: Harman Professional Denmark ApS
- Applicants: Harman Professional Denmark ApS
- Inventors: Niels Joergen Rasmussen; Claus Ellevang Hansen
- Web page: https://patentgrep.com/patent/US12225648B2

## CPC

- G06F 16/4393: {Multimedia presentations, e.g. slide shows, multimedia albums}
- H05B 47/12: by detecting audible sound
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G06F 16/685: {using automatically derived transcript of audio data, e.g. lyrics (speech recognition G10L15/00)}
- G10L 25/51: for comparison or discrimination
- H04R 1/403: {loud-speakers}
- H04R 3/12: for distributing signals to two or more loudspeakers {(specially adapted for hearing aids H04R25/407)}
- H05B 47/115: by determining the presence or movement of objects or living beings
- H05B 47/155: Coordinated control of two or more light sources
- H05B 47/165: following a pre-assigned programmed sequence; Logic control [LC]
- Y02B 20/40: Control techniques providing energy savings, e.g. smart controller or presence detection
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H05B: ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- Y02B: CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS

## Abstract

Examples are disclosed for systems and methods for providing an automated light show synchronized to one or more music files. In one embodiment, a method comprises generating a music feature file based on selected audio, the music feature file comprising metadata for the selected audio including a plurality of time markers indicating audio events in the selected audio, and automatically controlling one or more lights according to the music feature file. In another embodiment, other approaches and systems are provided to improve a light show or to provide structures and processed files which can be used to improve a light show or provide other features.

## Claims

### Claim 1

A method executable by one or more processors according to instructions stored in memory, the method comprising:
obtaining metadata for a selected audio, the metadata identifying a plurality of song events in the selected audio and a plurality of trigger beats in the selected audio; and
automatically controlling one or more lights according to the metadata.

### Claim 2 (depends on 1)

The method of claim 1, further comprising outputting the selected audio to one or more speakers, and synchronizing automatic control of the one or more lights according to the metadata with output of the selected audio.

### Claim 3 (depends on 1)

The method of claim 1, wherein automatically controlling the one or more lights according to the metadata includes adjusting one or more of a color, a state, a beam movement, and an intensity of the one or more lights based on the plurality of song events and the plurality of trigger beats stored as the metadata.

### Claim 4 (depends on 1)

The method of claim 1, wherein the metadata further includes one or more of a time signature, a number of beats per minute, a musical key, and a genre of the selected audio.

### Claim 5 (depends on 1)

The method of claim 1, wherein the metadata is included in a music feature file that further comprises the selected audio.

### Claim 6 (depends on 1)

The method of claim 1, wherein the metadata is included in a music feature file that further comprises a video file synchronized to the selected audio.

### Claim 7 (depends on 1)

The method of claim 1, wherein the selected audio comprises an analog signal including the selected audio or a music file stored in the memory.

### Claim 8 (depends on 1)

The method of claim 1, further comprising receiving the selected audio from a remote streaming server, and generating the metadata while receiving the selected audio.

### Claim 9 (depends on 1)

The method of claim 1, further comprising receiving the selected audio and the metadata from a remote streaming server.

### Claim 10 (depends on 1)

The method of claim 1, wherein the plurality of trigger beats indexes the plurality of song events of the selected audio to a timeline, and wherein the plurality of song events includes one or more of a break, an intro, a verse, a chorus, and a build-up.

### Claim 11 (depends on 1)

The method of claim 1, wherein the metadata is included in a music feature file that comprises a plurality of packets, each packet of the plurality of packets including an entirety of the metadata.

### Claim 12 (depends on 1)

The method of claim 1, further comprising receiving a position for each of the one or more lights in a light show environment, mapping the position for each of the one or more lights to a grid corresponding to the light show environment, and further adjusting control of the one or more lights based on the position mapped for the one or more lights in the grid.

### Claim 13 (depends on 12)

The method of claim 12, wherein the position for each of the one or more lights in the light show environment is determined based on a signal from a motion sensing device.

### Claim 14

A light show system, comprising:
a plurality of lights; and
a controller communicatively coupled to the plurality of lights and configured with instructions stored in non-transitory memory that when executed by a processor of the controller cause the controller to:
control one or more lights of the plurality of lights based on metadata of a music feature file for a selected audio file, the metadata including a plurality of song events and a plurality of trigger beats in the selected audio file, wherein the music feature file further comprises a video file synchronized to the selected audio file.

### Claim 15 (depends on 14)

The light show system of claim 14, wherein the video file is segmented based on one or more of the plurality of song events and the plurality of trigger beats, and wherein the music feature file includes the selected audio file.

### Claim 16 (depends on 14)

The light show system of claim 14, wherein the plurality of lights is distributed throughout a light show environment, and wherein the controller is further configured with instructions that when executed cause the controller to:
receive a position of each light of the plurality of lights within the light show environment;
map the position of each light to a virtual grid corresponding to the light show environment; and
adjust control of the one or more lights based on the metadata of the music feature file and the mapped position of each light in the virtual grid.

### Claim 17

A system, comprising:
a plurality of lights and a plurality of speakers arranged in a light show environment; and
a controller with computer-readable instructions stored on non-transitory memory thereof that when executed enable the controller to:
in response to a request for a light show for a selected audio file, obtain a music feature file for audio data of the selected audio file, wherein the music feature file comprises one or more of a plurality of song events, a plurality of trigger beats, a genre, a time signature, a number of beats per minute, and a musical key of the audio data;
signal to the plurality of lights to adjust one or more of a color, an intensity, a pulsation, and a brightness based on the music feature file; and
signal to the plurality of speakers to play audio based on the selected audio file.

### Claim 18 (depends on 17)

The system of claim 17, wherein the music feature file comprises the plurality of song events and the plurality of trigger beats, and wherein the plurality of trigger beats index the plurality of song events to a timeline.

### Claim 19 (depends on 18)

The system of claim 18, wherein the plurality of song events includes one or more of a break, an intro, a verse, a chorus, and a build-up.

### Claim 20 (depends on 17)

The system of claim 17, wherein the one or more of the plurality of song events, the plurality of trigger beats, the genre, the time signature, the number of beats per minute, and the musical key are saved as metadata of the music feature file, and wherein the music feature file further includes the selected audio file.
