# US 12,112,773 B2 · Method and apparatus for production of a real-time virtual concert or collaborative online event

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,112,773 B2
- Document ID: US12112773B2
- Status: Granted
- Kind: B2
- Application number: 17/726,103
- Filed: 2022-04-21
- Published: 2022-10-27
- Granted: 2024-10-08
- Earliest claimed: 2021-04-22
- Applicants: Andrew Levin; Aaron Cohen; Kyle Levin
- Inventors: Andrew Levin; Aaron Cohen; Kyle Levin
- Web page: https://patentgrep.com/patent/US12112773B2

## CPC

- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- H04N 5/2224: {related to virtual studio applications}
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and apparatus for producing virtual concerts or other online collaborative events. One or more musicians or other presenters or contributors at disparate geolocations transmit continuums of audio and/or image data as well as synchronization data continuums. Digital processing may be used to superimpose musicians or other presenters or contributors onto a virtual background (such as a concert stage or other virtual environment). Audio and video feeds from multiple musicians or other presenters or contributors may be synchronized to give the appearance of each being on the same stage in a 2D, 3D or virtual reality (VR) environment. Multiple continuums of audio data may be transmitted at different speeds and quality in order to allow musicians, presenters or other contributors to remain synchronized while a remote production studio receives high quality data transmissions for generation of a combinative, immersive, multi-dimensional end user audio/visual experience.

## Claims

### Claim 1

A method for generating a collaborative concert with participants at disparate geolocations, the method comprising the steps of:
capturing audio data at at least a first geolocation and a second geolocation;
with a local audio processor computer at each of the first geolocation and the second geolocation, processing the audio data captured at the respective geolocations;
establishing peer to peer connections between the local audio processor computer at each of the first geolocation and the second geolocation and a remote audio processing computer;
receiving the processed audio captured at the first geolocation and the second geolocation at the remote audio processing computer as processed audio feed;
with the remote audio processing computer, synchronizing the processed audio feed captured at the disparate geolocations;
by remotely controlling from the remote audio processing computer, downgrading audio quality of one or more peer to peer transmissions in order to decrease transmission time to ensure that the processed audio feed remain synchronized with the remote audio processing computer;
concurrent with the receiving of the processed audio captured at the disparate geolocations to the remote audio processing computer as the processed audio feed, receiving video data for embedding into a virtual video environment;
eliminating jitter in the virtual video environment by remotely controlling from the remote audio processing computer to introduce a delay into the receiving of the video data for embedding into the virtual video environment; and
combining multiple video streams and the synchronized audio into the virtual video environment.

### Claim 2 (depends on 1)

The method of claim 1, additionally comprising the step of receiving multiple audio continuums as the processed audio feed and aligning timing of the audio continuums into a playback sequence.

### Claim 3 (depends on 2)

The method of claim 2, additionally comprising the step of receiving multiple video continuums as processed video feeds and aligning timing of the multiple video continuums into a playback sequence.

### Claim 4 (depends on 2)

The method of claim 2 additionally comprising the step of generating avatars and including the avatars in the virtual video environment.

### Claim 5 (depends on 4)

The method of claim 4, additionally comprising the step of fashioning the avatars to resemble a likeness of a physical person.

### Claim 6 (depends on 4)

The method of claim 4, additionally comprising the step of fabricating a virtual concert venue by combining imagery reproduced from one or more of: physical settings, virtual reality settings and augmented reality settings and including the virtual concert venue in the virtual video environment.

### Claim 7 (depends on 4)

The method of claim 4 additionally comprising the step of including multiple virtual musicians in the virtual video environment.

### Claim 8 (depends on 7)

The method of claim 7 additionally comprising the step of dynamically arranging the multiple virtual musicians in the virtual video environment.

### Claim 9 (depends on 8)

The method of claim 8 additionally comprising the step of generating a virtual stage and including the virtual stage in the virtual video environment.

### Claim 10 (depends on 9)

The method of claim 9 additionally comprising the step of generating a virtual backdrop and including the virtual backdrop in the virtual video environment.

### Claim 11 (depends on 10)

The method of claim 10 additionally comprising the step of generating a virtual likeness of a production professional and including the virtual likeness of the production professional in the virtual video environment.

### Claim 12 (depends on 9)

The method of claim 9 additionally comprising receiving a video stream of a first musician at the first geolocation and synchronizing the processed audio feed with the video stream of the first musician at the first geolocation.

### Claim 13 (depends on 12)

The method of claim 12 additionally comprising receiving a video stream of a second musician at the second geolocation and synchronizing the processed audio feed with the video stream of the second musician at the second geolocation.

### Claim 14 (depends on 13)

The method of claim 13 additionally comprising the step of generating virtual imagery and including the virtual imagery in the virtual video environment.

### Claim 15 (depends on 14)

The method of claim 14 wherein the virtual imagery comprises architectural aspects of a venue.

### Claim 16 (depends on 14)

The method of claim 14 wherein the virtual imagery comprises lighting trusses.

### Claim 17 (depends on 14)

The method of claim 14 wherein the virtual imagery comprises an audience dance floor.

### Claim 18 (depends on 14)

The method of claim 14 wherein the virtual imagery comprises audience seating.

### Claim 19 (depends on 18)

The method of claim 18 additionally comprising the step of generating a virtual audience member in the audience seating, wherein the virtual audience member has a likeness of a non-virtual person.

### Claim 20 (depends on 18)

The method of claim 18 additionally comprising the step of generating a virtual audience member in the audience seating, wherein the virtual audience member has a likeness of a non-fungible token.