# US 2026/0099296 A1 · Audio processing method and related apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0099296 A1
- Document ID: US20260099296A1
- Status: Published application
- Kind: A1
- Application number: 19/416,042
- Filed: 2025-12-11
- Published: 2026-04-09
- Earliest claimed: 2023-06-12
- Applicants: Huawei Technologies Co., Ltd.
- Inventors: Mengyao Zhu; Xiukun Wu; Chaoyu Shi; Yunyin Chen
- Web page: https://patentgrep.com/patent/US20260099296A1

## CPC

- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04855: Interaction with scrollbars
- G06F 3/162: {Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure}
- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- H04S 7/00: Indicating arrangements; Control arrangements, e.g. balance control
- H04S 7/30: {Control circuits for electronic adaptation of the sound field}
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2400/13: Aspects of volume control, not necessarily automatic, in stereophonic sound systems
- H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04S: STEREOPHONIC SYSTEMS

## Abstract

An electronic device including a camera configured to shoot an image, a microphone array configured to capture audio, wherein the electronic device is configured for displaying a first video image in a first video, where the first video image comprises a first audio object, and wherein the first video comprises first audio, displaying a first audio object control on a screen, where the first audio object control is associated with adjusting a sound feature of the first audio object, and where adjusting the sound feature of the first audio object includes one or more of adjusting volume of the first audio object, adjusting a timbre of the first audio object, or adjusting a spatial position of the first audio object, and adjusting, in response to a first operation on the first audio object control, the sound feature of the first audio object in the first audio.

## Claims

### Claim 1

An electronic device, comprising:
a camera, configured to shoot an image;
a microphone array, configured to capture audio;
a processor; and
a non-transitory computer readable memory storing a computer program for execution by the processor, wherein the processor and the computer program are configured to cause the electronic device to perform:
displaying a first video image in a first video, wherein the first video image comprises a first audio object, and wherein the first video comprises first audio;
displaying a first audio object control on a screen, wherein the first audio object control is associated with adjusting a sound feature of the first audio object, and wherein adjusting the sound feature of the first audio object comprises one or more of adjusting volume of the first audio object, adjusting a timbre of the first audio object, or adjusting a spatial position of the first audio object; and
adjusting, in response to a first operation on the first audio object control, the sound feature of the first audio object in the first audio.

### Claim 2 (depends on 1)

The electronic device according to claim 1, wherein the first video image further comprises a second audio object; and
wherein the processor and the computer program are further configured to cause the electronic device to perform:
displaying a second audio object control on the screen, wherein the second audio object control is associated with adjusting a sound feature of the second audio object, and wherein adjusting the sound feature of the second audio object comprises one or more of adjusting volume of the second audio object, adjusting a timbre of the second audio object, or adjusting a spatial position of the second audio object; and
adjusting, in response to a second operation on the second audio object control, the sound feature of the second audio object in second audio.

### Claim 3 (depends on 2)

The electronic device according to claim 2, wherein the processor and the computer program are further configured to cause the electronic device to perform:
receiving a fifth operation on the first audio object and the second audio object, wherein the fifth operation is associated with combining the first audio object and the second audio object; and
displaying a third audio object control on the screen in response to the fifth operation, wherein the third audio object control is associated with adjusting one or more sound features of the first audio object and the second audio object.

### Claim 4 (depends on 2)

The electronic device according to claim 2, wherein the sound feature of the first audio object is a first sound feature, and wherein a sound feature of the second sound is a second sound feature; and
wherein the processor and the computer program are further configured to cause the electronic device to perform:
receiving a sixth operation on the first audio object and the second audio object, wherein the sixth operation is associated with the sound features of the first audio object and the second audio object;
determining, in response to the sixth operation, the sound feature of the first audio object in the first audio as the second sound feature, and determining the sound feature of the second audio object in the first audio as the first sound feature;
adjusting the second sound feature in response to receiving an operation on the first audio object control; and
adjusting the first sound feature in response to receiving an operation on the second audio object control.

### Claim 5 (depends on 1)

The electronic device according to claim 1, wherein the processor and the computer program are further configured to cause the electronic device to perform:
displaying a first sound field control on the screen, wherein the first sound field control is associated with adjusting a first sound field in the first audio, and wherein adjusting the first sound field comprises one or more of adjusting a type of a room in which the first sound field is located, adjusting a size of the room in which the first sound field is located, or adjusting a reflection material of the room in which the first sound field is located; and
adjusting the first sound field in response to a third operation on the first sound field control.

### Claim 6 (depends on 1)

The electronic device according to claim 1, wherein the processor and the computer program are further configured to cause the electronic device to perform:
displaying a first audio mixing control on the screen, wherein the first audio mixing control is associated with adjusting an audio mixing parameter of the first audio, and wherein the audio mixing parameter comprises one or more of an audio mixing template, reverberation time, an equalizer parameter, a size of a room in which a sound field is located, or a reflection material of the room in which the sound field is located;
determining a first audio mixing parameter based on a fourth operation on the first audio mixing control; and
performing audio mixing on an audio signal of the sound field and an audio signal of one or more audio objects in the first audio based on the first audio mixing parameter.

### Claim 7 (depends on 1)

The electronic device according to claim 1, wherein the first audio further comprises an audio signal corresponding to a third audio object, and wherein the third audio object is omitted from being in the first video image; and
wherein the processor and the computer program are further configured to cause the electronic device to perform:
displaying a fourth audio object control on the screen, wherein the fourth audio object control is used to adjust a sound feature of the third audio object.

### Claim 8 (depends on 7)

The electronic device according to claim 7, wherein a display position of the fourth audio object control on the screen is related to a spatial position of the third audio object.

### Claim 9 (depends on 1)

The electronic device according to claim 1, wherein the processor and the computer program are further configured to cause the electronic device to perform:
receiving a seventh operation;
recognizing a primary object in the first video image in response to the seventh operation; and
removing, in response to recognizing that the primary object in the first video image is the first audio object, an audio signal of an audio object other than the first audio object from the first audio.

### Claim 10 (depends on 1)

The electronic device according to claim 1, wherein a display position of the first audio object control on the screen is related to a display position of the first audio object in a video image in the first video.

### Claim 11 (depends on 1)

The electronic device according to claim 1, wherein the processor and the computer program are further configured to cause the electronic device to perform, before displaying the first video image in the first video:
obtaining the first video from a memory of the electronic device; and
receiving an operation of playing the first video, wherein the first video image is an image displayed during video playing.

### Claim 12 (depends on 1)

The electronic device according to claim 1, wherein the processor and the computer program are further configured to cause the electronic device to perform, before displaying the first video image in the first video:
receiving an operation of starting a camera application or starting video recording;
capturing an image through an image capturing apparatus;
capturing an audio through an audio capturing apparatus, wherein the image captured by the image capturing apparatus comprises the video image in the first video, and wherein the audio captured by the audio capturing apparatus comprises the first audio; and
displaying, in real time, the image captured by the image capturing apparatus, wherein the first video image is an image displayed in real time during image shooting.

### Claim 13 (depends on 12)

The electronic device according to claim 12, wherein a communication connection is established between the electronic device and a listening device; and
wherein the processor and the computer program are further configured to cause the electronic device to perform:
sending second audio to the listening device for playing, wherein the second audio is an audio obtained through one or more of the following adjustments on the first audio selected from adjusting a sound feature of the one or more audio objects in the first audio, adjusting a first sound field in the first audio, or adjusting the audio mixing parameter of the first audio.

### Claim 14 (depends on 12)

The electronic device according to claim 12, wherein a communication connection is established between the electronic device and a listening device; and
wherein the processor and the computer program are further configured to cause the electronic device to perform, after adjusting the sound feature of the first audio object in the first audio:
sending, to the listening device for playing, an audio signal of the first audio object whose sound feature is adjusted.

### Claim 15 (depends on 1)

The electronic device according to claim 1, wherein the electronic device and a second electronic device access a first video call; and
wherein the processor and the computer program are further configured to cause the electronic device to perform:
sending the video image in the first video and second audio to the second electronic device, wherein the second audio is an audio obtained through one or more of the following adjustments on the first audio selected from adjusting a sound feature of the one or more audio objects in the first audio, adjusting a first sound field in the first audio, or adjusting the audio mixing parameter of the first audio, wherein the first video image is an image shot by the electronic device during the first video call.

### Claim 16 (depends on 15)

The electronic device according to claim 15, wherein the processor and the computer program are further configured to cause the electronic device to perform:
receiving a second video from the second electronic device;
displaying a second video image in the second video, wherein the second video image comprises a fourth audio object; and
displaying a fifth audio object control on the screen, wherein the fifth audio object control is used to adjust a sound feature of the fourth audio object, and adjusting the sound feature of the fourth audio object comprises one or more of adjusting volume of the fourth audio object, adjusting a timbre of the fourth audio object, or adjusting a spatial position of the fourth audio object.

### Claim 17 (depends on 16)

The electronic device according to claim 16, wherein the processor and the computer program are further configured to cause the electronic device to perform:
determining a first editing parameter based on an operation on the fifth audio object control;
sending a first editing instruction to the second electronic device, wherein the first editing instruction comprises the first editing parameter; and
receiving a third video from the second electronic device, wherein the third video comprises a third audio, and wherein the sound feature of the fourth audio object in the third audio is adjusted based on the first editing parameter.

### Claim 18 (depends on 17)

The electronic device according to claim 17, wherein a third electronic device also accesses the first video call, and wherein the third video is also sent to the third electronic device for playing.

### Claim 19 (depends on 15)

The electronic device according to claim 15, wherein the processor and the computer program are further configured to cause the electronic device to perform:
displaying a second sound field control on the screen, wherein the second sound field control is associated with adjusting a second sound field in an audio comprised in a video sent by the second electronic device; and
wherein adjusting the second sound field comprises one or more of adjusting a type of a room in which the second sound field is located, adjusting a size of the room in which the second sound field is located, or adjusting a reflection material of the room in which the second sound field is located.

### Claim 20 (depends on 15)

The electronic device according to claim 15, wherein the processor and the computer program are further configured to cause the electronic device to perform:
displaying a second audio mixing control on the screen, wherein the second audio mixing control is associated with adjusting an audio mixing parameter of the audio comprised in the video sent by the second electronic device; and
wherein the audio mixing parameter comprises one or more of an audio mixing template, reverberation time, an equalizer parameter, a size of a room in which a sound field is located, or a reflection material of the room in which the sound field is located.
