Audio processing in immersive audio services
AssigneesDolby Laboratories Licensing Corporation, Dolby International AB
InventorsStefan Bruhn, Juan Felix Torres, David S. McGrath, Brian Lee
Life of this patent
Estimating the term…
Abstract
The disclosure herein generally relates to capturing, acoustic pre-processing, encoding, decoding, and rendering of directional audio of an audio scene. In particular, it relates to a device adapted to modify a directional property of a captured directional audio in response to spatial data of a microphone system capturing the directional audio. The disclosure further relates to a rendering device configured to modify a directional property of a received directional audio in response to received spatial data.
Claims28
A device comprising or connected to a microphone system comprising one or more microphones for capturing audio, the device comprising:
- a receiving unit configured to:
- receive directional audio captured by the microphone system;
- receive metadata associated with the microphone system, the metadata comprising spatial data of the microphone system, the spatial data being indicative of a spatial orientation and/or spatial position of the microphone system and comprising at least one an azimuth, pitch, roll angle(s), or spatial coordinates of the microphone system;
- a computing unit configured to:
- modify at least some of the directional audio to produce modified directional audio, wherein a directional property of the audio is modified in response to the spatial orientation and/or spatial position of the microphone system;
- encode the modified directional audio into digital audio data and
- a transmitting unit configured to transmit the digital audio data.
A device for rendering audio signals, the device comprising:
- a receiving unit configured to receive digital audio data,
- a decoding unit configured to:
- decode the received digital audio data into directional audio and into metadata, the metadata comprising spatial data comprising at least one of an azimuth, pitch, roll angle(s) or spatial coordinates;
- a rendering unit configured to:
- modify a directional property of the directional audio using the spatial data;
- and
- render the modified directional audio.
A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
- receiving directional audio from a microphone system comprising one or more microphones;
- receiving metadata associated with the microphone system, the metadata comprising spatial data of the microphone system, the spatial data being indicative of at least one of a spatial orientation or spatial position of the microphone system and comprising at least one of an azimuth, pitch, roll angle(s), or spatial coordinates of the microphone system;
- modifying at least a portion of the directional audio to produce modified directional audio, wherein a directional property of the audio is modified in response to the spatial orientation and/or spatial position of the microphone system;
- encoding the modified directional audio into digital audio data;
- and
- transmitting the digital audio data.
Dependencies are inferred from the claim text.