Back to results
US 11,153,704 B2Granted
Concept for generating an enhanced sound-field description or a modified sound field description using a multi-layer description
AssigneeFraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
InventorsJürgen Herre, Emanuel Habets
Life of this patent
Estimating the term…
Abstract
An apparatus for generating an enhanced sound field description has: a sound field generator for generating at least two sound field layer descriptions indicating sound fields with respect to at least one reference location; and a meta data generator for generating meta data relating to spatial information of the sound fields, wherein the sound field descriptions and the meta data constitute the enhanced sound field description. The meta data can be a geometrical information for each layer such as a representative distance to the reference location.
Claims30
An apparatus for generating a modified sound field description from a sound field description and meta data relating to spatial information of the sound field description, comprising:
- an input interface for receiving the sound field description, the meta data, and translation information;
- and
- a sound field calculator for calculating the modified sound field using the spatial information, the sound field description and the translation information, wherein the translation information indicates a translation of a reference location to a different reference location, wherein the sound field calculator is configured
- to receive, as the sound field description, a first layer sound field description and a second layer sound field description,
- to perform a source separation on the first and second layer sound field descriptions, to extract sources of the first and the second layer sound field descriptions and direction of arrival (DoA) data for extracted sources,
- to calculate, for each extracted source, modified DoA data with respect to the different location using the DoA data and the translation information, and to process the extracted sources and the modified DoA data to acquire the modified sound field description.
3 more elements
An apparatus for generating a modified sound field description from a sound field description and meta data relating to spatial information of the sound field description, comprising:
- an input interface for receiving the sound field description, the meta data, and translation information;
- and
- a sound field calculator for calculating the modified sound field using the spatial information, the sound field description and the translation information, wherein the translation information indicates a translation of a reference location to a different reference location,
- wherein the sound field description comprises, for each layer, a plurality of sound field components, the plurality of sound field components comprising an omnidirectional component and at least one directional component, and
- wherein the sound field calculator is configured, for each layer:
- for analyzing the sound field components to derive, for different frequency bins, direction of arrival information;
- for calculating modified direction of arrival information per frequency bin using the direction information and the meta data, the meta data comprising a depth map associating a distance information to a layer;
- and
- for calculating the modified sound field using a distance compensation information depending on the distance provided by the depth map for the layer, and a new distance associated with the frequency bin being related to the modified direction of arrival information.
6 more elements
An apparatus for generating a modified sound field description from a sound field description and meta data relating to spatial information of the sound field description, comprising:
- an input interface for receiving the sound field description, the meta data, and translation information;
- and
- a sound field calculator for calculating the modified sound field using the spatial information, the sound field description and the translation information, wherein the translation information indicates a translation of a reference location to a different reference location wherein the sound field calculator is configured, for each layer,
- for calculating a first vector pointing from the reference location to a sound source acquired by the analysis of the sound field;
- for calculating a second vector pointing from the different reference location to the sound source using the first vector and the translation information, the translation information defining a translation vector from the reference location to the different reference location;
- and
- for calculating a distance modification value using the different reference location, a location of the sound source, and the second vector, or using a distance from the different reference location to the location of the sound source and the second vector.
4 more elements
A method of generating a modified sound field description from a sound field description and meta data relating to spatial information of the sound field description, the method comprising:
- calculating the modified sound field using the spatial information, the sound field description and a translation information indicating a translation from a reference location to a different reference location,
- wherein the calculating comprises
- to receive, as the sound field description, a first layer sound field description and a second layer sound field description,
- to perform a source separation on the first and second layer sound field descriptions, to extract sources of the first and the second layer sound field descriptions and direction of arrival (DoA) data for extracted sources,
- to calculate, for each extracted source, modified DoA data with respect to the different location using the DoA data and the translation information, and
- to process the extracted sources and the modified DoA data to acquire the modified sound field description, or
- wherein the calculating comprises
- to generate, for each of extracted sources, a sound field description using a modified DoA data,
- to select sound field descriptions of sound sources based on a distance between a corresponding extracted source and the different reference location for a specific layer and to add a sound field description of each of selected sources in the layer to acquire a modified layer sound field description, or
- to add the sound field description of each source in a sound scene to acquire a modified overall sound field description.
7 more elements
A non-transitory digital storage medium having stored thereon a computer program for performing, when said computer program is run by a computer, a method of generating a modified sound field description from a sound field description and meta data relating to spatial information of the sound field description, the method comprising:
- calculating the modified sound field using the spatial information, the sound field description and a translation information indicating a translation from a reference location to a different reference location,
- wherein the calculating comprises
- to receive, as the sound field description, a first layer sound field description and a second layer sound field description,
- to perform a source separation on the first and second layer sound field descriptions, to extract sources of the first and the second layer sound field descriptions and direction of arrival (DoA) data for extracted sources,
- to calculate, for each extracted source, modified DoA data with respect to the different location using the DoA data and the translation information, and
- to process the extracted sources and the modified DoA data to acquire the modified sound field description, or
- wherein the calculating comprises
- to generate, for each of extracted sources, a sound field description using a modified DoA data, to select sound field descriptions of sound sources based on a distance between a corresponding extracted source and the different reference location for a specific layer and to add a sound field description of each of selected sources in the layer to acquire a modified layer sound field description, or
- to add the sound field description of each source in a sound scene to acquire a modified overall sound field description.
6 more elements
A method of generating a modified sound field description from a sound field description and meta data relating to spatial information of the sound field description, the method comprising:
- calculating the modified sound field using the spatial information, the sound field description and a translation information indicating a translation from a reference location to a different reference location, wherein the sound field description comprises, for each layer, a plurality of sound field components, the plurality of sound field components comprising an omnidirectional component and at least one directional component,
- wherein the sound field calculating comprises, for each layer
- analyzing the sound field components to derive, for different frequency bins, direction of arrival information;
- calculating modified direction of arrival information per frequency bin using the direction information and the meta data, the meta data comprising a depth map associating a distance information to a layer;
- and
- calculating the modified sound field using a distance compensation information depending on the distance provided by the depth map for the layer, and a new distance associated with the frequency bin being related to the modified direction of arrival information, or
- wherein the calculating comprises, for each layer,
- calculating a first vector pointing from the reference location to a sound source acquired by the analysis of the sound field;
- calculating a second vector pointing from the different reference location to the sound source using the first vector and the translation information, the translation information defining a translation vector from the reference location to the different reference location;
- and
- calculating a distance modification value using the different reference location, a location of the sound source, and the second vector, or using a distance from the different reference location to the location of the sound source and the second vector.
8 more elements
A non-transitory digital storage medium having stored thereon a computer program for performing, when said computer program is run by a computer, a method of generating a modified sound field description from a sound field description and meta data relating to spatial information of the sound field description, the method comprising:
- calculating the modified sound field using the spatial information, the sound field description and a translation information indicating a translation from a reference location to a different reference location,
- wherein the sound field calculating comprises, for each layer
- analyzing the sound field components to derive, for different frequency bins, direction of arrival information;
- calculating modified direction of arrival information per frequency bin using the direction information and the meta data, the meta data comprising a depth map associating a distance information to a layer;
- and
- calculating the modified sound field using a distance compensation information depending on the distance provided by the depth map for the layer, and a new distance associated with the frequency bin being related to the modified direction of arrival information, or
- wherein the calculating comprises, for each layer,
- calculating a first vector pointing from the reference location to a sound source acquired by the analysis of the sound field;
- calculating a second vector pointing from the different reference location to the sound source using the first vector and the translation information, the translation information defining a translation vector from the reference location to the different reference location;
- and
- calculating a distance modification value using the different reference location, a location of the sound source, and the second vector, or using a distance from the different reference location to the location of the sound source and the second vector.
8 more elements
Dependencies are inferred from the claim text.