# US 2023/0067271 A1 · Information processing method and electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0067271 A1
- Document ID: US20230067271A1
- Status: Published application
- Kind: A1
- Application number: 17/686,251
- Filed: 2022-03-03
- Published: 2023-03-02
- Earliest claimed: 2021-08-30
- Assignees: Lenovo (Beijing) Limited
- Applicants: Lenovo (Beijing) Limited
- Inventors: Hongcheng XIA
- Web page: https://patentgrep.com/patent/US20230067271A1

## CPC

- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G06T 11/00: Two-dimensional [2D] image generation
- H04R 1/406: {microphones}
- H04R 29/008: {Visual indication of individual signal levels (visual indication of stereophonic sound image H04S7/40)}
- H04S 7/40: {Visual indication of stereophonic sound image}
- G08B 13/19695: {Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves}
- H04N 5/45: Picture in picture {, e.g. displaying simultaneously another television channel in a region of the screen}
- H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure}
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- H04R 2410/01: Noise reduction using microphones having different directional characteristics
- H04R 2430/01: Aspects of volume control, not necessarily automatic, in sound systems
- H04R 2499/11: Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
- H04S 7/30: {Control circuits for electronic adaptation of the sound field}
- H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04S: STEREOPHONIC SYSTEMS
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An information processing method includes, in response to determining that an application is in a video mode, acquiring a video image in real time through a camera group of an electronic device and acquiring a video sound in real time through a microphone group of the electronic device; displaying the video image; mapping an audio manipulation area that includes an operation response area of a sound source in an acquisition area of the camera group; obtaining an input operation for the operation response area; and, in response to the input operation, adjusting a sound collection effect of the sound source corresponding to the operation response area.

## Claims

### Claim 1

An information processing method comprising:
in response to determining that an application is in a video mode, acquiring a video image in real time through a camera group of an electronic device and acquiring a video sound in real time through a microphone group of the electronic device;
displaying the video image;
mapping an audio manipulation area, the audio manipulation area including an operation response area of a sound source in an acquisition area of the camera group;
obtaining an input operation for the operation response area; and
in response to the input operation, adjusting a sound collection effect of the sound source corresponding to the operation response area.

### Claim 2 (depends on 1)

The method according to claim 1, wherein acquiring the video sound includes:
determining a suppression area based on an acquisition area of a camera called by the application in the video mode; and
based on the suppression area, suppressing sound in the suppression area collected by the microphone group to obtain the video sound.

### Claim 3 (depends on 1)

The method according to claim 1, further comprising:
obtaining positions of a plurality of candidate sound sources in an environment where the electronic device is located; and
determining the sound source in the acquisition area of the camera group from the plurality of candidate sound sources.

### Claim 4 (depends on 3)

The method according to claim 3, wherein mapping the audio manipulation area includes:
superimposing and displaying a position of the sound source in the acquisition area based on the video image, the position of the sound source in the acquisition area corresponding to the operation response area.

### Claim 5 (depends on 4)

The method according to claim 4, wherein adjusting the sound collection effect of the sound source corresponding to the operation response area includes:
increasing a gain of the sound source based on the video sound.

### Claim 6 (depends on 4)

The method according to claim 4, further comprising:
displaying a sound parameter of the sound source in real time at a position where the position of the sound source is superimposed and displayed based on the video image.

### Claim 7

An electronic device comprising:
a camera group;
a microphone group;
a display screen; and
a processor configured to:
in response to determining that an application is in a video mode, control the camera group to acquire a video image in real time and control the microphone group to acquire a video sound in real time;
control the display screen to display the video image;
map an audio manipulation area, the audio manipulation area including an operation response area of a sound source in an acquisition area of the camera group;
obtain an input operation for the operation response area; and
in response to the input operation, adjust a sound collection effect of the sound source corresponding to the operation response area.

### Claim 8 (depends on 7)

The electronic device according to claim 7, wherein the processor is further configured to:
determine a suppression area based on an acquisition area of a camera called by the application in the video mode; and
based on the suppression area, suppress sound in the suppression area collected by the microphone group to obtain the video sound.

### Claim 9 (depends on 7)

The electronic device according to claim 7, wherein the processor is further configured to:
obtain positions of a plurality of candidate sound sources in an environment where the electronic device is located; and
determine the sound source in the acquisition area of the camera group from the plurality of candidate sound sources.

### Claim 10 (depends on 9)

The electronic device according to claim 9, wherein the processor is further configured to:
control the display screen to superimpose and display a position of the sound source in the acquisition area based on the video image, the position of the sound source in the acquisition area corresponding to the operation response area.

### Claim 11 (depends on 10)

The electronic device according to claim 10, wherein the processor is further configured to:
increase a gain of the sound source based on the video sound.

### Claim 12 (depends on 10)

The electronic device according to claim 10, wherein the processor is further configured to:
control the display screen to display a sound parameter of the sound source in real time at a position where the position of the sound source is superimposed and displayed based on the video image.
