# US 2019/0379994 A1 · Applications and format for immersive spatial sound

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0379994 A1
- Document ID: US20190379994A1
- Status: Published application
- Kind: A1
- Application number: 16/544,343
- Filed: 2019-08-19
- Published: 2019-12-12
- Earliest claimed: 2016-03-03
- Assignees: Mach 1, Corp.
- Applicants: Mach 1, Corp.
- Inventors: Drazen BOSNJAK; Dylan J. MARCUS
- Web page: https://patentgrep.com/patent/US20190379994A1

## CPC

- H04S 7/304: {For headphones}
- H04R 5/033: Headphones for stereophonic communication {(details thereof, e.g. relating to batteries, cables or control elements H04R1/10)}
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- H04S 7/303: {Tracking of listener position or orientation}
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S: STEREOPHONIC SYSTEMS
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

Methods, systems, and apparatuses are disclosed for generating a spatial audio format. An input audio source may include one or more individual channels. The one or more individual channels may be designated to be played by a corresponding one or more speakers. The one or more individual channels of the audio source may be separated. The one or more individual tracks may be input into a modeling space representing a multi-dimensional space. The modeling space may include a plurality of emitters at various locations in a vector space. Each of the one or more individual channels may be panned to one or more of the plurality of emitters. The panning may be based on a normalized proximity of the one or more individual channels in the modeling space to the plurality of emitters. The one or more of the plurality of emitters may be encoded into a single multichannel file.

## Claims

### Claim 1

A method for generating a spatial audio signal representative of an audio source, the method comprising:
dividing one or more individual audio tracks of the audio source into one or more mono input (MI) emitters;
rendering a modeling space representing a multi-dimensional space, the modeling space comprising a plurality of emitters at various locations;
moving the one or more MI emitters around the rendered modeling space;
routing a percentage of gain from the one or more MI emitters to each of the plurality of emitters based on a proximity of the one or more MI emitters to each of the plurality of emitters;
creating one or more stereo output pairs via a surround sound track routed from mono busses output from the routed gain of each of the plurality of emitters; and
crossfading between the one or more stereo output pairs based on orientation and position information of a user.

### Claim 2 (depends on 1)

The method of claim 1, wherein the modeling space comprises a three-dimensional (3D) cube.

### Claim 3 (depends on 2)

The method of claim 2, wherein the 3D cube has eight emitters located on its vertices.

### Claim 4 (depends on 1)

The method of claim 1, wherein the modeling space comprises a multi-order diamond configuration of a cube with a 2-sided three-dimensional (3D) cone on opposite sides of the cube.

### Claim 5 (depends on 4)

The method of claim 4, wherein the multi-order diamond configuration of the cube includes ten emitters located on vertices of the multi-order diamond configuration of the cube.

### Claim 6 (depends on 1)

The method of claim 1, wherein the modeling space comprises of a three-dimensional (3D) icosahedron.

### Claim 7 (depends on 6)

The method of claim 6, wherein modeling the 3D icosahedron has an emitter located on each of twelve vertices of the icosahedron.

### Claim 8 (depends on 1)

The method of claim 1, wherein the modeling space comprises of a dual of three-dimensional (3D) cubes with vertices of each cube corresponding to faces of the other 3D cubes.

### Claim 9 (depends on 8)

The method of claim 8, wherein modeling the dual of 3D cubes includes an emitter located on each of twelve vertices of the dual of 3D cubes.

### Claim 10 (depends on 1)

The method of claim 1, wherein the modeling space can be extended by adding any number of emitters to the modeling space as vertices.

### Claim 11 (depends on 1)

The method of claim 1, wherein the modeling space can be detailed by adding additional emitters to faces and edges of the modeling space.

### Claim 12 (depends on 1)

The method of claim 1, wherein the surround sound track is quad (4.0) surround comprising 4 mono busses.

### Claim 13 (depends on 1)

The method of claim 1, wherein the surround sound track is 5.1 surround comprising 6 mono busses.

### Claim 14 (depends on 1)

The method of claim 1, wherein the surround sound track is 7.1 surround comprising 8 mono busses.

### Claim 15 (depends on 1)

The method of claim 1, wherein the orientation and position information of the user correlates to a location of the one or more MI emitters in the modeling space.

### Claim 16 (depends on 1)

The method of claim 1, wherein the orientation and position information comprises pitch, yaw, roll angel, acceleration, and elevation of a head of the user.

### Claim 17 (depends on 1)

The method of claim 1, wherein the orientation and position information is provided by an inertial measurement unit (IMU) coupled to headtracking headphones.

### Claim 18 (depends on 1)

The method of claim 1, wherein the spatial audio signal is a biphonic audio mix.

### Claim 19 (depends on 1)

The method of claim 1, further comprising:
calculating coefficients based on Euler angles of the orientation and position information of the user; and
multiplying the mono busses by the coefficients to account for movement of the user.

### Claim 20 (depends on 19)

The method of claim 19, wherein the Euler angles are calculated from horizontal/yaw movement of a head of the user.

### Claim 21 (depends on 19)

The method of claim 19, wherein the Euler angles are calculated from horizontal/yaw, vertical/pitch, and tilt/roll movements of a head of the user.

### Claim 22

A method of providing a spatial audio signal representative of physical sound to a listener, the method comprising:
receiving position and orientation data of a head of the listener at an enabled application, wherein the enabled application is coupled to an authoring software development kit (SDK);
routing one or more busses of a surround sound audio track into one or more stereo pairs based on a routing track;
crossfading between the routed one or more stereo pairs based on the received position and orientation data, wherein the received position and orientation is compared to a location of a mono input (MI) emitter in a modeling space that is encoded in the surround sound audio track; and
generating one or more output channels.

### Claim 23 (depends on 22)

The method of claim 22, wherein the position and orientation data is measured using an inertial measurement unit (IMU).

### Claim 24 (depends on 23)

The method of claim 23, wherein the IMU comprises an accelerometer, a magnetometer, and a gyroscope.

### Claim 25 (depends on 23)

The method of claim 23, wherein the IMU is affixed to a pair of headphones.

### Claim 26 (depends on 22)

The method of claim 22, wherein the orientation and position data comprises pitch, yaw, roll angel, acceleration, and elevation of the listener's head.

### Claim 27 (depends on 22)

The method of claim 22, wherein the modeling space comprises a plurality of emitters at various locations.

### Claim 28 (depends on 22)

The method of claim 22, wherein the spatial audio signal can be broadcasted to any number of listeners, each receiving position and orientation data of the listener's head at an enabled application, wherein the enabled application is coupled to an authoring software development kit (SDK).

### Claim 29 (depends on 28)

The method of claim 28, wherein the broadcast can be transmitted over LAN or WAN.
