# US 2022/0044661 A1 · Network musical instrument

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044661 A1
- Document ID: US20220044661A1
- Status: Published application
- Kind: A1
- Application number: 17/301,097
- Filed: 2021-03-24
- Published: 2022-02-10
- Earliest claimed: 2016-12-15
- Assignees: VoiceLessons, Inc.
- Inventors: Michael John Elson
- Web page: https://patentgrep.com/patent/US20220044661A1

## CPC

- G10H 1/0008: {Associated control or indicating means}
- G09B 15/00: Teaching music (metronomes G04F5/02)
- G10H 1/0033: {Recording/reproducing or transmission of music for electrophonic musical instruments}
- G10H 1/20: for transposition
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04L 43/0858: {One way delays}
- H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display}
- H04N 7/15: Conference systems
- G10H 2210/066: for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
- G10H 2210/076: for extraction of timing, tempo; Beat detection
- G10H 2210/081: for automatic key or tonality recognition, e.g. using musical rules or a knowledge base
- G10H 2210/091: for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
- G10H 2220/015: Musical staff, tablature or score displays, e.g. for score reading during a performance
- G10H 2220/126: for graphical editing of individual notes, parts or phrases represented as variable length segments on a 2D or 3D representation, e.g. graphical edition of musical collage, remix files or pianoroll representations of MIDI-like files
- G10H 2240/016: File editing, i.e. modifying musical data files or streams as such
- G10H 2240/056: MIDI or other note-oriented file format
- G10H 2240/131: Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set
- G10H 2240/171: Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
- G10H 2240/175: for jam sessions or musical collaboration through a network, e.g. for composition, ensemble playing or repeating; Compensation of network or internet delays therefor
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and systems are described that are utilized for remotely controlling a musical instrument. A first digital record comprising musical instrument digital commands from a first electronic instrument for a first item of music is accessed. The first digital record is transmitted over a network using a network interface to a remote, second electronic instrument for playback to a first user. Optionally, video data is streamed to a display device of a user while the first digital record is played back by the second electronic instrument. A key change command is transmitted over the network using the network interface to the second electronic instrument to cause the second electronic instrument to playback the first digital record for the first item of music in accordance with the key change command. The key change command may be transmitted during the streaming of the video data.

## Claims

### Claim 1

(canceled)

### Claim 2

A networked music instrument system, comprising:
a network interface;
a computing device; and
non-transitory memory that stores program instructions that, when executed by the computing device, cause the networked music instrument system to perform operations comprising:
transmitting musical instrument digital commands of a first electronic instrument, associated with a first user, for a first item of music over a network using the network interface to a plurality of electronic instruments, remote from the first electronic instrument, associated with a first plurality of respective users for reproduction, at a same time, by respective remote electronic instruments in the plurality of electronic instruments;
setting, in response to detecting a key range command, a key range for at least one of the plurality of remote electronic instruments comprising a lowest note boundary and a highest note boundary;
causing, in response to detecting a transpose command, a transposition of at least a portion of the first item of music to a first key to be performed on at least one of the plurality of remote electronic instruments;
muting audio of a portion of the first plurality of respective users, wherein audio of a second user in the first plurality of respective users is not muted; and
enabling audio of the second user to be streamed over the network to respective devices of the first user and devices of the portion of the first plurality of respective users.

### Claim 3 (depends on 2)

The networked music instrument system as defined in claim 2, further comprising:
detecting a music change command from the first user, wherein the music change command comprises at least one of a key change command, tempo change command, play command, an intensity change command, pause command, stop command, fast forward command, resume command, repeat command, style command, duration command, or automated direction command; and
transmitting the music change command to one or more of the plurality of remote electronic instruments.

### Claim 4 (depends on 2)

The networked music instrument system as defined in claim 2, wherein at least one of the plurality of remote electronic instruments is associated with a respective computing device, a microphone, and a speaker.

### Claim 5 (depends on 2)

The networked music instrument system as defined in claim 2, the operations further comprising transmitting instructions to one or more of the respective users of the plurality of remote electronic instruments, the instructions related to performance of a vowel, a consonant, an intensity or a volume.

### Claim 6 (depends on 2)

The networked music instrument system as defined in claim 2, the operations further comprising performing an analysis of a vocal exercise to determine a respective absolute key, a tempo, an order of vocal exercise progression, a vocal concept, a vocal cause and effect, a vowel selection, a phoneme, and/or a vocal fault.

### Claim 7 (depends on 2)

The networked music instrument system as defined in claim 2, the operations further comprising causing music notation currently playing indicators displayed by the first electronic instrument and at least a portion of the plurality of remote electronic instruments to be synchronized.

### Claim 8 (depends on 2)

The networked music instrument system as defined in claim 2, the operations further comprising enabling a live stream feed of audio and video of multiple users singing and/or playing respective electronic instruments to be live streamed to respective devices of a plurality of users.

### Claim 9 (depends on 2)

The networked music instrument system as defined in claim 2, the operations further comprising:
conducting a video conference in full duplex mode between the first user and a second user local to a second electronic instrument while the first item of music is reproduced by the second electronic instrument.

### Claim 10 (depends on 2)

The networked music instrument system as defined in claim 2, the operations further comprising:
conducting a video conference between the first user local to the first electronic instrument and at least one other user local to a remote electronic instrument in the plurality of remote electronic instruments while the first item of music is reproduced by the remote electronic instrument;
generating and providing for display a user interface, the user interface:
depicting notes of the first item of music;
displaying an image corresponding to the first electronic instrument; and
displaying an animation of key presses corresponding to the notes of the first item of music using the image corresponding to the first electronic instrument.

### Claim 11 (depends on 2)

The networked music instrument system as defined in claim 2, the operations further comprising:
enabling a live stream feed of audio and video of multiple users singing and/or playing respective electronic instruments to be live streamed to respective devices of a plurality of users; and
conducting a video conference in full duplex mode between the first user and a second user local to a second electronic instrument while the first item of music is reproduced by the second electronic instrument.

### Claim 12 (depends on 2)

The networked music instrument system as defined in claim 2, the operations further comprising:
enabling a live stream feed of audio and video of multiple users singing and/or playing respective electronic instruments to be live streamed to respective devices of a plurality of users; and
conducting a video conference between the first user local to the first electronic instrument and at least one other user local to a remote electronic instrument in the plurality of remote electronic instruments while the first item of music is reproduced by the remote electronic instrument;
generating and providing for display a user interface, the user interface:
depicting notes of the first item of music;
displaying an image corresponding to the first electronic instrument; and
displaying an animation of key presses corresponding to the notes of the first item of music using the image corresponding to the first electronic instrument.

### Claim 13 (depends on 2)

The networked music instrument system as defined in claim 2, wherein detecting the transpose command further comprises detecting a predefined pattern, tempo variation, chord combination, or triad combination.

### Claim 14 (depends on 2)

The networked music instrument system as defined in claim 2, wherein the transpose command is received from a user of the at least one of the plurality of remote electronic instruments or from the first electronic instrument.

### Claim 15 (depends on 2)

The networked music instrument system as defined in claim 2, the operations further comprising:
enabling a user to specify a range command by specifying:
range boundary keys comprising:
a highest note played, and
a lowest note played;
at least one of an ascending key direction command or a descending key direction command;
an interval;
transmitting a user specified range command to at least one electronic instrument to cause the at least one electronic instrument to play at least one item of music in the specified ascending or descending direction in accordance with the specified interval until a corresponding range boundary key is reached.

### Claim 16

A computer-implemented method, the method comprising:
transmitting musical instrument digital commands of a first electronic instrument, associated with a first user, for a first item of music over a network to a plurality of devices comprising or connected to electronic instruments associated with a first plurality of respective users for reproduction, at the same time, by respective remote electronic instruments in the plurality of remote electronic instruments;
setting, in response to detecting a key range command, a key range for at least one of the plurality of remote electronic instruments comprising a lowest note boundary and a highest note boundary;
causing, in response to detecting a transpose command, a transposition of at least a portion of the first item of music to a first key to be performed on at least one of the plurality of remote electronic instruments;
muting audio of a portion of the first plurality of respective users, the portion comprising at least a second user; and
enabling audio of the second user to be streamed over the network to respective devices of the first user and devices of the portion of the first plurality of respective users.

### Claim 17 (depends on 16)

The computer-implemented method as defined in claim 16, the method further comprising:
detecting a music change command from the first user, wherein the music change command comprises at least one of a key change command, tempo change command, play command, an intensity change command, pause command, stop command, fast forward command, resume command, repeat command, style command, duration command, or automated direction command; and
transmitting the music change command to one or more of the plurality of devices.

### Claim 18 (depends on 16)

The computer-implemented method as defined in claim 16, the method further comprising causing music notation currently playing indicators displayed by the first electronic instrument and at least a portion of the plurality of remote electronic instruments to be synchronized.

### Claim 19 (depends on 16)

The computer-implemented method as defined in claim 16, the method further comprising enabling a live stream feed of audio and video of multiple users singing and/or playing respective electronic instruments to be live streamed to respective devices of a plurality of users.

### Claim 20 (depends on 16)

The computer-implemented method as defined in claim 16, the method further comprising:
conducting a video conference in full duplex mode between the first user and a second user local to a second electronic instrument while the first item of music is reproduced by the second electronic instrument.

### Claim 21 (depends on 16)

The computer-implemented method as defined in claim 16, the method further comprising:
conducting a video conference between the first user local to the first electronic instrument and at least one other user local to a remote electronic instrument in the plurality of remote electronic instruments while the first item of music is reproduced by the remote electronic instrument;
generating and providing for display a user interface, the user interface:
depicting notes of the first item of music;
displaying an image corresponding to the first electronic instrument; and
displaying an animation of key presses corresponding to the notes of the first item of music using the image corresponding to the first electronic instrument.

### Claim 22 (depends on 16)

The computer-implemented method as defined in claim 16, the method further comprising:
enabling a live stream feed of audio and video of multiple users singing and/or playing respective electronic instruments to be live streamed to respective devices of a plurality of users; and
conducting a video conference in full duplex mode between the first user and a second user local to a second electronic instrument while the first item of music is reproduced by the second electronic instrument.

### Claim 23 (depends on 16)

The computer-implemented method as defined in claim 16, the method further comprising:
enabling a live stream feed of audio and video of multiple users singing and/or playing respective electronic instruments to be live streamed to respective devices of a plurality of users; and
conducting a video conference between the first user local to the first electronic instrument and at least one other user local to a remote electronic instrument in the plurality of remote electronic instruments while the first item of music is reproduced by the remote electronic instrument;
generating and providing for display a user interface, the user interface:
depicting notes of the first item of music;
displaying an image corresponding to the first electronic instrument; and
displaying an animation of key presses corresponding to the notes of the first item of music using the image corresponding to the first electronic instrument.

### Claim 24 (depends on 16)

The computer-implemented method as defined in claim 16, wherein the transpose command is received from a user of the at least one of the plurality of remote electronic instruments or from the first electronic instrument.

### Claim 25

A non-transitory memory that stores program instructions that, when executed by a computing device, cause the computing device to perform operations comprising:
transmitting musical instrument digital commands of a first electronic instrument, associated with a first user, for a first item of music over a network to a plurality of devices comprising or connected to electronic instruments associated with a first plurality of respective users for reproduction, at the same time, by respective remote electronic instruments in the plurality of remote electronic instruments;
setting, in response to detecting a key range command, a key range for at least one of the plurality of remote electronic instruments comprising a lowest note boundary and a highest note boundary;
causing, in response to detecting a transpose command, a transposition of at least a portion of the first item of music to a first key to be performed on at least one of the plurality of remote electronic instruments;
muting audio of a portion of the first plurality of respective users, the portion comprising at least a second user; and
enabling audio of the second user to be streamed over the network to respective devices of the first user and devices of the portion of the first plurality of respective users.

### Claim 26 (depends on 25)

The non-transitory memory as defined in claim 25, the operations further comprising enabling a live stream feed of audio and video of multiple users singing and/or playing respective electronic instruments to be live streamed to respective devices of a plurality of users.

### Claim 27 (depends on 25)

The non-transitory memory as defined in claim 25, the operations further comprising:
conducting a video conference in full duplex mode between the first user and a second user local to a second electronic instrument while the first item of music is reproduced by the second electronic instrument.

### Claim 28 (depends on 25)

The non-transitory memory as defined in claim 25, the operations further comprising:
conducting a video conference between the first user local to the first electronic instrument and at least one other user local to a remote electronic instrument in the plurality of remote electronic instruments while the first item of music is reproduced by the remote electronic instrument;
generating and providing for display a user interface, the user interface:
depicting notes of the first item of music;
displaying an image corresponding to the first electronic instrument; and
displaying an animation of key presses corresponding to the notes of the first item of music using the image corresponding to the first electronic instrument.

### Claim 29 (depends on 25)

The non-transitory memory as defined in claim 25, the operations further comprising:
enabling a live stream feed of audio and video of multiple users singing and/or playing respective electronic instruments to be live streamed to respective devices of a plurality of users; and
conducting a video conference in full duplex mode between the first user and a second user local to a second electronic instrument while the first item of music is reproduced by the second electronic instrument.

### Claim 30 (depends on 25)

The non-transitory memory as defined in claim 25, the operations further comprising:
enabling a live stream feed of audio and video of multiple users singing and/or playing respective electronic instruments to be live streamed to respective devices of a plurality of users; and
conducting a video conference between the first user local to the first electronic instrument and at least one other user local to a remote electronic instrument in the plurality of remote electronic instruments while the first item of music is reproduced by the remote electronic instrument;
generating and providing for display a user interface, the user interface:
depicting notes of the first item of music;
displaying an image corresponding to the first electronic instrument; and
displaying an animation of key presses corresponding to the notes of the first item of music using the image corresponding to the first electronic instrument.
