# US 2025/0147717 A1 · Audio processing method and apparatus, electronic device, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0147717 A1
- Document ID: US20250147717A1
- Status: Published application
- Kind: A1
- Application number: 18/934,568
- Filed: 2024-11-01
- Published: 2025-05-08
- Earliest claimed: 2023-11-03
- Assignees: Beijing Zitiao Network Technology Co., Ltd.
- Applicants: Beijing Zitiao Network Technology Co., Ltd.
- Inventors: Ye Ma; Chang Xiao
- Web page: https://patentgrep.com/patent/US20250147717A1

## CPC

- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present disclosure relates to the field of computer technologies, and discloses an audio processing method and apparatus, an electronic device, and a storage medium. The method includes: obtaining media data to be processed and audio metadata of the media data to be processed; performing first loudness compensation on the media data to be processed based on the audio metadata to obtain first media data, where the first loudness compensation includes loudness compensation for dynamic range control; determining a second loudness compensation value corresponding to peak limiting based on an audio feature of the first media data; and performing second loudness compensation and peak limiting on the first media data based on the second loudness compensation value to determine target media data for playback.

## Claims

### Claim 1

An audio processing method, wherein the method comprises:
obtaining media data to be processed and audio metadata of the media data to be processed;
performing first loudness compensation on the media data to be processed based on the audio metadata to obtain first media data, wherein the first loudness compensation comprises loudness compensation for dynamic range control;
determining a second loudness compensation value corresponding to peak limiting based on an audio feature of the first media data; and
performing second loudness compensation and peak limiting on the first media data based on the second loudness compensation value to determine target media data for playback.

### Claim 2 (depends on 1)

The method according to claim 1, wherein determining the second loudness compensation value corresponding to peak limiting based on the audio feature of the first media data comprises:
obtaining a target performance requirement;
determining a second loudness compensation value determining way corresponding to the target performance requirement based on a correspondence between a performance requirement and a loudness compensation value determining way corresponding to peak limiting; and
determining the second loudness compensation value based on the second loudness compensation value determining way and the audio feature of the first media data.

### Claim 3 (depends on 2)

The method according to claim 2, wherein a loudness equalization effect in the performance requirement is positively correlated with processing complexity of the loudness compensation value determining way for peak limiting, and loudness equalization processing performance in the performance requirement is negatively correlated with the processing complexity of the loudness compensation value determining way for peak limiting.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the peak loudness compensation value determining way comprises a determining way based on a mapping relationship between a peak loudness compensation value and an audio feature, and a determining way based on a peak loudness compensation model, wherein the peak loudness compensation model comprises the audio feature as an input and comprises the loudness compensation value as an output, wherein processing complexity of the determining way based on the mapping relationship between the peak loudness compensation value and the audio feature is less than that of the determining way based on the peak loudness compensation model.

### Claim 5 (depends on 4)

The method according to claim 4, wherein in response to the peak loudness compensation value determining way being the determining way based on the mapping relationship between the peak loudness compensation value and the audio feature, determining the second loudness compensation value based on the second loudness compensation value determining way and the audio feature of the first media data comprises:
obtaining a target peak for the peak limiting and a current audio peak in the audio feature to obtain a difference between the current audio peak and the target peak; and
determining the second loudness compensation value based on the difference and the mapping relationship.

### Claim 6 (depends on 4)

The method according to claim 4, wherein in response to the peak loudness compensation value determining way being the determining way based on the peak loudness compensation model, determining the second loudness compensation value based on the second loudness compensation value determining way and the audio feature of the first media data comprises:
determining a target submodel in the peak loudness compensation model based on a loudness equalization effect in the target performance requirement, wherein the peak loudness compensation model comprises a plurality of submodels, and the submodels have different processing complexity; and
determining the second loudness compensation value based on the target submodel and the audio feature of the first media data.

### Claim 7 (depends on 1)

The method according to claim 1, wherein performing first loudness compensation on the media data to be processed based on the audio metadata to obtain first media data comprises:
obtaining a target performance requirement;
determining a target loudness compensation value determining way for dynamic range control corresponding to the target performance requirement based on a correspondence between a performance requirement and a loudness compensation value determining way for dynamic range control;
determining a first loudness compensation value for dynamic range control based on the target loudness compensation value determining way and the audio metadata; and
performing first loudness compensation on the media data to be processed based on the first loudness compensation value to obtain the first media data.

### Claim 8 (depends on 7)

The method according to claim 7, wherein a loudness equalization effect in the performance requirement is positively correlated with processing complexity of the loudness compensation value determining way for dynamic range control, and loudness equalization processing performance in the performance requirement is negatively correlated with the processing complexity of the loudness compensation value determining way for dynamic range control.

### Claim 9 (depends on 8)

The method according to claim 8, wherein the performance requirement comprises a loudness equalization effect of a first level and a loudness equalization effect of a second level, the first level is lower than the second level, and in response to the target performance requirement comprising the loudness equalization effect of the first level, determining the first loudness compensation value for dynamic range control based on the target loudness compensation value determining way and the audio metadata comprises:
obtaining a slope in dynamic range control parameters and a starting point of a dynamic range in the audio metadata in response to a length of the media data to be processed being greater than a preset length;
performing loudness estimation based on a target loudness, the slope, and the starting point to determine an estimated loudness; and
determining the first loudness compensation value based on a difference between the target loudness and the estimated loudness.

### Claim 10 (depends on 9)

The method according to claim 9, wherein determining the first loudness compensation value for dynamic range control based on the target loudness compensation value determining way and the audio metadata further comprises:
obtaining a maximum short-term loudness in the audio metadata in response to the length of the media data to be processed being less than or equal to the preset length; and
determining the first loudness compensation value based on a difference between the maximum short-term loudness and the target loudness.

### Claim 11 (depends on 8)

The method according to claim 8, wherein the performance requirement comprises a loudness equalization effect of a first level and a loudness equalization effect of a second level, the first level is lower than the second level, and in response to the target performance requirement comprising the loudness equalization effect of the second level, determining the first loudness compensation value for dynamic range control based on the target loudness compensation value determining way and the audio metadata comprises:
determining the first loudness compensation value based on a first loudness compensation model for dynamic range control and the audio metadata in response to a length of the media data to be processed being greater than a preset length.

### Claim 12 (depends on 11)

The method according to claim 11, wherein determining the first loudness compensation value for dynamic range control based on the target loudness compensation value determining way and the audio metadata further comprises:
determining the first loudness compensation value based on a second loudness compensation model for dynamic range control and the audio metadata in response to the length of the media data to be processed being less than or equal to the preset length.

### Claim 13 (depends on 2)

The method according to claim 2, wherein the target performance requirement is determined based on a loudness processing mode of a current playback device or an error range of loudness compensation.

### Claim 14 (depends on 1)

The method according to claim 1, wherein obtaining the audio metadata of the media data to be processed comprises:
obtaining a frequency response curve of a target playback device, wherein the frequency response curve is used to determine a target loudness;
and/or
obtaining a cutoff frequency of the target playback device, wherein the cutoff frequency is used to determine a filtered loudness compensation value corresponding to signal energy of data to be filtered in the media data to be processed, the data to be filtered is media data with a frequency lower than the cutoff frequency in the media data to be processed, the target playback device is configured to perform loudness processing on the media data to be processed based on the filtered loudness compensation value after filtering the data to be filtered from the media data to be processed, and the audio metadata comprises the target loudness and the filtered loudness compensation value.

### Claim 15

An electronic device, comprising:
a memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the computer instructions, when executed by the processor, cause the processor to:
obtain media data to be processed and audio metadata of the media data to be processed;
perform first loudness compensation on the media data to be processed based on the audio metadata to obtain first media data, wherein the first loudness compensation comprises loudness compensation for dynamic range control;
determine a second loudness compensation value corresponding to peak limiting based on an audio feature of the first media data; and
perform second loudness compensation and peak limiting on the first media data based on the second loudness compensation value to determine target media data for playback.

### Claim 16 (depends on 15)

The electronic device of claim 15, wherein the computer instructions for determining the second loudness compensation value corresponding to peak limiting based on the audio feature of the first media data further cause the processor to:
obtain a target performance requirement;
determine a second loudness compensation value determining way corresponding to the target performance requirement based on a correspondence between a performance requirement and a loudness compensation value determining way corresponding to peak limiting; and
determine the second loudness compensation value based on the second loudness compensation value determining way and the audio feature of the first media data.

### Claim 17 (depends on 16)

The electronic device of claim 16, wherein a loudness equalization effect in the performance requirement is positively correlated with processing complexity of the loudness compensation value determining way for peak limiting, and loudness equalization processing performance in the performance requirement is negatively correlated with the processing complexity of the loudness compensation value determining way for peak limiting.

### Claim 18 (depends on 17)

The electronic device of claim 17, wherein the second loudness compensation value determining way comprises a determining way based on a mapping relationship between a peak loudness compensation value and an audio feature, and a determining way based on a peak loudness compensation model, wherein the peak loudness compensation model comprises the audio feature as an input and comprises the loudness compensation value as an output, wherein processing complexity of the determining way based on the mapping relationship between the peak loudness compensation value and the audio feature is less than that of the determining way based on the peak loudness compensation model.

### Claim 19 (depends on 18)

The electronic device of claim 18, wherein in response to the peak loudness compensation value determining way being the determining way based on the mapping relationship between the peak loudness compensation value and the audio feature, the computer instructions for determining the second loudness compensation value based on the second loudness compensation value determining way and the audio feature of the first media data further cause the processor to:
obtain a target peak for the peak limiting and a current audio peak in the audio feature to obtain a difference between the current audio peak and the target peak; and
determine the second loudness compensation value based on the difference and the mapping relationship.

### Claim 20

A non-transitory computer-readable storage medium, having stored thereon computer instructions that are used to cause a computer to:
obtain media data to be processed and audio metadata of the media data to be processed;
perform first loudness compensation on the media data to be processed based on the audio metadata to obtain first media data, wherein the first loudness compensation comprises loudness compensation for dynamic range control;
determine a second loudness compensation value corresponding to peak limiting based on an audio feature of the first media data; and
perform second loudness compensation and peak limiting on the first media data based on the second loudness compensation value to determine target media data for playback.
