Back to results
US 11,379,178 B2Granted
Loudness control for user interactivity in audio coding systems
AssigneeFraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
InventorsFabian Küch, Christian Uhle, Michael Kratschmer, Bernhard Neugebauer, Michael Meier
Life of this patent
Estimating the term…
Abstract
An audio processor for processing an audio signal includes: an audio signal modifier for modifying the audio signal in response to a user input; a loudness controller for determining a loudness compensation gain based on a reference loudness or a reference gain and a modified loudness or a modified gain, where the modified loudness or the modified gain depends on the user input; and a loudness manipulator for manipulating a loudness of a signal using the loudness compensation gain.
Claims25
An audio processor for processing an audio signal comprising metadata, the audio processor comprising:
- an audio signal modifier, wherein the audio signal modifier is configured to modify the audio signal in response to a user input via amplifying or attenuating a group comprising one or more audio elements belonging to the audio signal and according to a selected or a default preset covered by the metadata;
- a loudness controller, wherein the loudness controller is configured to determine a loudness compensation gain based on the one hand on a reference loudness or a reference gain corresponding to an original audio scene and on the other hand on a modified loudness or a modified gain, wherein the modified loudness or the modified gain depends on the user input, and
- a loudness manipulator, wherein the loudness manipulator is configured to manipulate a loudness of a signal using the loudness compensation gain and using the metadata,
- wherein the loudness controller is configured to determine the loudness compensation gain based on the metadata of the audio signal indicating which group is to be used for determining the loudness compensation gain, or indicating which group is not to be used for determining the loudness compensation gain, and wherein a group comprises one or more audio elements, or
- wherein the loudness controller is configured to determine the loudness compensation gain based on the metadata of the audio signal referring to at least one preset, wherein the preset refers to a set of at least one group comprising one or more audio elements, or
- wherein the loudness controller is configured to determine the loudness compensation gain based on the metadata of the audio signal indicating whether a group is switched off or switched on, wherein the group comprises one or more audio elements, or
- wherein the loudness controller is configured to determine the loudness compensation gain based on the metadata of the audio signal with at least one group loudness missing in the metadata of a group comprising one or more audio elements comprised by the audio signal, or
- wherein the loudness controller is configured to determine the loudness compensation gain based on the metadata of the audio signal referring to a playback configuration for a reproduction of the signal.
5 more elements
An audio encoder for generating an audio signal comprising metadata, comprising:
- a loudness determiner configured for determining a loudness value for at least one group comprising one or more audio elements;
- and
- a metadata writer configured for introducing the determined loudness value as a group loudness into the metadata,
- further comprising a controller, wherein the controller is configured to determine that a group is to be used for determining a loudness compensation gain and another group is to be neglected for determining a loudness compensation gain, and wherein the metadata writer is configured for writing an indication into the metadata indicating the group to be used and the other group to be neglected for determining the loudness compensation gain, or
- wherein the loudness determiner is configured to determine different loudness values and/or different gain values for different presets referring to sets of at least one group comprising one or more audio elements, and wherein the metadata writer is configured to introduce the determined different loudness values and/or different gain values in association with the respective preset into the metadata, or
- wherein the metadata writer is configured to introduce whether a group is switched off or switched on for determining a reference loudness in a decoder, or
- wherein the metadata writer is configured to introduce the determined loudness value as a group loudness into the metadata, and wherein at least one group loudness is missing in the metadata, or
- wherein the loudness determiner is configured to determine different loudness values and/or different gain values for different playback configurations, and wherein the metadata writer is configured to introduce the determined different loudness values and/or different gain values in association with the respective playback configuration into the metadata.
5 more elements
A method for processing an audio signal comprising metadata, the method comprising:
- modifying the audio signal in response to a user input via amplifying or attenuating a group comprising one or more audio elements belonging to the audio signal and according to a selected or a default preset covered by the metadata;
- determining a loudness compensation gain based on the one hand on a reference loudness or a reference gain and on the other hand on a modified loudness or a modified gain corresponding to an original audio scene, where the modified loudness or the modified gain depends on the user input,
- wherein the loudness compensation gain is determined based on the metadata of the audio signal indicating whether a group comprised by the audio signal is to be used for determining the loudness compensation gain, or indicating whether a group comprised by the audio is not to be used for determining the loudness compensation gain, wherein a group comprises one or more audio elements, and/or
- wherein the loudness compensation gain is determined based on the metadata of the audio signal referring to a preset, wherein the preset refers to a set of at least one group comprising one or more audio elements, and/or
- wherein the loudness compensation gain is determined based on the metadata of the audio signal indicating whether a group is switched off or switched on, wherein the group comprises one or more audio elements, and/or
- wherein the loudness compensation gain is determined based on the metadata of the audio signal with at least one group loudness missing in the metadata of a group comprised by the audio signal, and/or
- wherein the loudness compensation gain is determined based on the metadata of the audio signal referring to a playback configuration for a reproduction of the signal;
- and
- manipulating a loudness of a signal using the loudness compensation gain wherein the loudness compensation gain is applied together with the loudness normalization gain to the signal.
6 more elements
A method for generating an audio signal comprising metadata, comprising:
- determining a loudness value for a group comprising one or more audio elements;
- and
- introducing the determined loudness value for the group as a group loudness into the metadata,
- further comprising determining that a group is to be used for determining a loudness compensation gain and another group is to be neglected for determining a loudness compensation gain, and writing an indication into the metadata indicating the group to be used and the other group to be neglected for determining the loudness compensation gain, or
- determining different loudness values and/or different gain values for different presets referring to sets of at least one group comprising one or more audio elements, and introducing the determined different loudness values and/or different gain values in association with the respective preset into the metadata, or
- introducing into the metadata, whether a group is switched off or switched on for determining a reference loudness in a decoder, or
- introducing into the metadata the determined loudness value as a group loudness into the metadata, and wherein at least one group loudness is missing in the metadata, or
- determining different loudness values and/or different gain values for different playback configurations, and introducing the determined different loudness values and/or different gain values in association with the respective playback configuration into the metadata.
5 more elements
A non-transitory digital storage medium having a computer program stored thereon to perform the method for processing an audio signal comprising metadata, the method comprising:
- modifying the audio signal in response to a user input via amplifying or attenuating a group comprising one or more audio elements belonging to the audio signal and according to a selected or a default preset covered by the metadata;
- determining a loudness compensation gain based on the one hand on a reference loudness or a reference gain and on the other hand on a modified loudness or a modified gain corresponding to an original audio scene, where the modified loudness or the modified gain depends on the user input,
- wherein the loudness compensation gain is determined based on the metadata of the audio signal indicating whether a group comprised by the audio signal is to be used for determining the loudness compensation gain, or indicating whether a group comprised by the audio is not to be used for determining the loudness compensation gain, wherein a group comprises one or more audio elements, and/or
- wherein the loudness compensation gain is determined based on the metadata of the audio signal referring to a preset, wherein the preset refers to a set of at least one group comprising one or more audio elements, and/or
- wherein the loudness compensation gain is determined based on the metadata of the audio signal indicating whether a group is switched off or switched on, wherein the group comprises one or more audio elements, and/or
- wherein the loudness compensation gain is determined based on the metadata of the audio signal with at least one group loudness missing in the metadata of a group comprised by the audio signal, and/or
- wherein the loudness compensation gain is determined based on the metadata of the audio signal referring to a playback configuration for a reproduction of the signal;
- and
- manipulating a loudness of a signal using the loudness compensation gain wherein the loudness compensation gain is applied together with the loudness normalization gain to the signal,
- when said computer program is run by a computer.
7 more elements
A non-transitory digital storage medium having a computer program stored thereon to perform the method for generating an audio signal comprising metadata, comprising:
- determining a loudness value for a group comprising one or more audio elements;
- and
- introducing the determined loudness value for the group as a group loudness into the metadata,
- further comprising determining that a group is to be used for determining a loudness compensation gain and another group is to be neglected for determining a loudness compensation gain, and writing an indication into the metadata indicating the group to be used and the other group to be neglected for determining the loudness compensation gain, or
- determining different loudness values and/or different gain values for different presets referring to sets of at least one group comprising one or more audio elements, and introducing the determined different loudness values and/or different gain values in association with the respective preset into the metadata, or
- introducing into the metadata, whether a group is switched off or switched on for determining a reference loudness in a decoder, or
- introducing into the metadata the determined loudness value as a group loudness into the metadata, and wherein at least one group loudness is missing in the metadata, or
- determining different loudness values and/or different gain values for different playback configurations, and introducing the determined different loudness values and/or different gain values in association with the respective playback configuration into the metadata,
- when said computer program is run by a computer.
6 more elements
Dependencies are inferred from the claim text.