# US 12,604,152 B2 · Binarual rendering

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,604,152 B2
- Document ID: US12604152B2
- Status: Granted
- Kind: B2
- Application number: 18/436,010
- Filed: 2024-02-07
- Published: 2024-06-13
- Granted: 2026-04-14
- Earliest claimed: 2022-12-07
- Assignees: Dolby Laboratories Licensing Corporation; Dolby International AB
- Applicants: Dolby Laboratories Licensing Corporation; Dolby International AB
- Inventors: Rishabh Tyagi; Stefan Bruhn; Juan Felix Torres
- Web page: https://patentgrep.com/patent/US12604152B2

## CPC

- H04S 7/304: {For headphones}
- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/03: Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 (H04S2400/01 takes precedence)
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2420/03: Application of parametric coding in stereophonic audio systems
- H04S: STEREOPHONIC SYSTEMS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

An aspect of the present disclosure relates to processing audio comprising decoding a first bitstream (b1) to obtain decoded immersive audio content (A), decoding a second bitstream (bp) to obtain pose information (P, V, V′) associated with a user of a lightweight processing device, determining a first head-pose (P′) based on the pose information, providing a downmix representation (Dmx) of the immersive audio content (A) corresponding to the first head pose (P′), rendering a set of binaural representations (BINn) of the immersive audio content (A), wherein the binaural representations correspond to a second set of head poses (Pn), computing reconstruction metadata (M) to enable reconstruction of the set of binaural representations from the downmix representation (Dmx), the metadata (M) including the first head pose (P′), and encoding the downmix representation (Dmx) and the reconstruction metadata (M) in a third bitstream (b2).

## Claims

### Claim 1

A method of processing audio in a main device, the method comprising:
receiving a first bitstream (b1);
decoding the first bitstream (b1) to obtain decoded immersive audio content (A);
receiving a second bitstream (bp);
decoding the second bitstream (bp) to obtain pose information (P; P″; P, V) associated with a user of a lightweight processing device;
determining a first head-pose (P′) based on the pose information (P; P″; P, V);
generating a downmix representation (Dmx) of the immersive audio content (A) corresponding to the first head pose (P′);
rendering a set of binaural representations (BINn) of the immersive audio content (A), wherein the binaural representations correspond to a second set of head poses (Pn);
computing reconstruction metadata (M) to enable reconstruction of the set of binaural representations from the downmix representation (Dmx), the metadata (M) including the first head pose (P′);
encoding the downmix representation (Dmx) and the reconstruction metadata (M) in a third bitstream (b2); and
outputting the third bitstream (b2).

### Claim 2 (depends on 1)

A non-transitory computer-readable storage medium storing a program comprising instructions that, when executed by a processor, cause the processor to carry out the method according to claim 1.