# US 2022/0044699 A1 · Call method, apparatus, and system, server, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044699 A1
- Document ID: US20220044699A1
- Status: Published application
- Kind: A1
- Application number: 17/507,761
- Filed: 2021-10-21
- Published: 2022-02-10
- Earliest claimed: 2019-12-23
- Assignees: Tencent Technology (Shenzhen) Company Limited
- Applicants: Tencent Technology (Shenzhen) Company Limited
- Inventors: Yi GAO
- Web page: https://patentgrep.com/patent/US20220044699A1

## CPC

- G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10)
- G10L 25/21: the extracted parameters being power information
- G10L 25/51: for comparison or discrimination
- H04L 65/1069: Session establishment or de-establishment
- H04L 65/4038: with floor control
- H04L 65/765: {intermediate}
- H04L 65/80: Responding to QoS
- H04M 3/568: {audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants (echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30)}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A call method is provided. The method includes: obtaining at least three paths of voice data transmitted by at least three first terminals, the voice data carrying indication information; selecting at least two paths of target voice data from the at least three paths of voice data according to the indication information of the at least three paths of voice data as obtained; and transmitting the at least two paths of target voice data to a second terminal, the second terminal being configured to decode the at least two paths of target voice data, mix decoded at least two paths of target voice data, and play mixed voice data.

## Claims

### Claim 1

A call method, performed by a server, and comprising:
obtaining at least three paths of voice data transmitted by at least three first terminals, the at least three paths of voice data each carrying a piece of indication information, the piece of indication information including at least a piece of voice activity detection (VAD) information, the piece of VAD information being configured for indicating whether the corresponding path of voice data includes a voice segment;
selecting at least two paths of target voice data from the at least three paths of voice data according to the pieces of indication information of the at least three paths of voice data as obtained, a number of paths of the at least two paths of target voice data being less than a number of paths of the at least three paths of voice data; and
transmitting the at least two paths of target voice data to a second terminal, the second terminal being configured to decode the at least two paths of target voice data, mix decoded at least two paths of target voice data, and play mixed voice data, wherein the second terminal is any terminal in a call group, and the at least three first terminals are terminals in the call group that are different from the second terminal.

### Claim 2 (depends on 1)

The call method according to claim 1, wherein selecting the at least two paths of target voice data from the at least three paths of voice data comprises:
selecting at least two paths of target voice data that include voice segments from the at least three paths of voice data, according to the pieces of VAD information of the at least three paths of voice data as obtained.

### Claim 3 (depends on 1)

The call method according to claim 1, wherein the piece of indication information further includes a voice energy, and selecting the at least two paths of target voice data from the at least three paths of voice data comprises:
selecting a preset number of paths of voice data that include voice segments and have largest voice energies from the at least three paths of voice data as a preset number of paths of target voice data, according to the pieces of VAD information and the voices energies of the at least three paths of voice data as obtained, the preset number being less than a number of paths of the at least three paths of voice data.

### Claim 4 (depends on 1)

The call method according to claim 1, wherein the piece of indication information further includes a voice energy, and selecting the at least two paths of target voice data from the at least three paths of voice data comprises:
obtaining an arrangement order of the at least three paths of voice data according to the pieces of VAD information and the voice energies of the at least three paths of voice data as obtained, a path of voice data that includes a voice segment being ranked ahead of a path of voice data that does not include a voice segment, and in the paths of voice data that include voice segments, a path of voice data with a larger voice energy being ranked ahead of a path of voice data with a smaller voice energy; and
selecting a preset number of paths of voice data that are ranked highest according to the arrangement order of the at least three paths of voice data as a preset number of paths of target voice data, the preset number being less than a number of paths of the at least three paths of voice data.

### Claim 5 (depends on 1)

The call method according to claim 1, wherein selecting the at least two paths of target voice data from the at least three paths of voice data comprises:
adding first voice data to a target voice data list, in response to determining that the first voice data in the at least three paths of voice data includes a voice segment, and a number of paths of voice data in the target voice data list has not reached a preset number, the target voice data list being configured for storing a selected path of target voice data, and the preset number being less than a number of paths of the at least three paths of voice data.

### Claim 6 (depends on 5)

The call method according to claim 5, further comprising:
comparing the voice energy of the first voice data with the voice energy of second voice data that has a smallest voice energy in the target voice data list, in response to determining that the first voice data includes a voice segment, and the number of the paths of voice data in the target voice data list has reached the preset number; and
adding the first voice data to the target voice data list, in response to determining that the voice energy of the first voice data is greater than the voice energy of the second voice data, and removing the second voice data from the target voice data list.

### Claim 7 (depends on 5)

The call method according to claim 5, further comprising:
adding the first voice data to a candidate voice data list, in response to determining that the first voice data does not include a voice segment.

### Claim 8 (depends on 7)

The call method according to claim 7, wherein the candidate voice data list includes a first candidate voice data list and a second candidate voice data list, and adding the first voice data to the candidate voice data list comprises:
adding the first voice data to the first candidate voice data list, in response to determining that the first voice data does not include a voice segment, and the first terminal corresponding to the first voice data is a designated terminal, the designated terminal being a terminal whose previously transmitted path of voice data is selected as a path of target voice data.

### Claim 9 (depends on 7)

The call method according to claim 7, wherein adding the first voice data to the candidate voice data list comprises:
adding the first voice data to a second candidate voice data list, in response to determining that the first voice data does not include a voice segment, and the first terminal corresponding to the first voice data is not a designated terminal.

### Claim 10 (depends on 1)

The call method according to claim 1, wherein selecting the at least two paths of target voice data from the at least three paths of voice data comprises:
traversing the at least three paths of voice data as obtained, and determining a target voice data list and a candidate voice data list according to the pieces of indication information of the at least three paths of voice data, the target voice data list being configured for storing a currently selected path of voice data, and the candidate voice data list being configured for storing a currently unselected path of voice data; and
after traversing the at least three paths of voice data, selecting at least one path of voice data from the candidate voice data list, in response to determining that a number of paths of voice data in the target voice data list is less than a preset number, and adding the one path of voice data to the target voice data list, so that the number of the paths of voice data in the target voice data list is equal to the preset number, the preset number being less than a number of paths of the at least three paths of voice data.

### Claim 11 (depends on 10)

The call method according to claim 10, wherein the candidate voice data list includes a first candidate voice data list and a second candidate voice data list, the first candidate voice data list is configured for storing a path of voice data that does not include a voice segment and the corresponding first terminal is a designated terminal, the second candidate voice data list is configured for storing a path of voice data that does not include a voice segment and the corresponding first terminal is not a designated terminal, and the designated terminal is a terminal whose previously transmitted path of voice data is selected as a path of target voice data.

### Claim 12 (depends on 10)

The call method according to claim 10, wherein selecting the at least one path of voice data from the candidate voice data list and adding the one path of voice data to the target voice data list comprises:
selecting at least one path of voice data from the first candidate voice data list, in response to determining that the number of the paths of voice data in the target voice data list is less than the preset number, and adding the at least one path of voice data to the target voice data list, so that the number of the paths of voice data in the target voice data list is equal to the preset number.

### Claim 13 (depends on 10)

The call method according to claim 10, wherein selecting the at least one path of voice data from the candidate voice data list and adding the one path of voice data to the target voice data list comprises:
adding all of paths of voice data in the first candidate voice data list to the target voice data list, in response to determining that the number of the paths of voice data in the target voice data list is less than the preset number, the number of paths of voice data in the target voice data list after adding the paths of voice data being not greater than the preset number; and selecting at least one path of voice data from the second candidate voice data list, and adding the at least one path of voice data to the target voice data list, so that the number of the paths of voice data in the target voice data list is equal to the preset number.

### Claim 14

A call apparatus, comprising: a memory storing computer program instructions; and a processor coupled to the memory and configured to execute the computer program instructions and perform:
obtaining at least three paths of voice data transmitted by at least three first terminals, the at least three paths of voice data each carrying a piece of indication information, the piece of indication information including at least a piece of voice activity detection (VAD) information, the piece of VAD information being configured for indicating whether the corresponding path of voice data includes a voice segment;
selecting at least two paths of target voice data from the at least three paths of voice data according to the pieces of indication information of the at least three paths of voice data as obtained, a number of paths of the at least two paths of target voice data being less than a number of paths of the at least three paths of voice data; and
transmitting the at least two paths of target voice data to a second terminal, the second terminal being configured to decode the at least two paths of target voice data, mix decoded at least two paths of target voice data, and play mixed voice data, wherein the second terminal is any terminal in a call group, and the at least three first terminals are terminals in the call group that are different from the second terminal.

### Claim 15 (depends on 14)

The call apparatus according to claim 14, wherein selecting the at least two paths of target voice data from the at least three paths of voice data includes:
selecting at least two paths of target voice data that include voice segments from the at least three paths of voice data, according to the pieces of VAD information of the at least three paths of voice data as obtained.

### Claim 16 (depends on 14)

The call apparatus according to claim 14, wherein the piece of indication information further includes a voice energy, and selecting the at least two paths of target voice data from the at least three paths of voice data includes:
selecting a preset number of paths of voice data that include voice segments and have largest voice energies from the at least three paths of voice data as a preset number of paths of target voice data, according to the pieces of VAD information and the voices energies of the at least three paths of voice data as obtained, the preset number being less than a number of paths of the at least three paths of voice data.

### Claim 17 (depends on 14)

The call apparatus according to claim 14, wherein the piece of indication information further includes a voice energy, and selecting the at least two paths of target voice data from the at least three paths of voice data includes:
obtaining an arrangement order of the at least three paths of voice data according to the pieces of VAD information and the voice energies of the at least three paths of voice data as obtained, a path of voice data that includes a voice segment being ranked ahead of a path of voice data that does not include a voice segment, and in the paths of voice data that include voice segments, a path of voice data with a larger voice energy being ranked ahead of a path of voice data with a smaller voice energy; and
selecting a preset number of paths of voice data that are ranked highest according to the arrangement order of the at least three paths of voice data as a preset number of paths of target voice data, the preset number being less than a number of paths of the at least three paths of voice data.

### Claim 18 (depends on 14)

The call apparatus according to claim 14, wherein selecting the at least two paths of target voice data from the at least three paths of voice data includes:
adding first voice data to a target voice data list, in response to determining that the first voice data in the at least three paths of voice data includes a voice segment, and a number of paths of voice data in the target voice data list has not reached a preset number, the target voice data list being configured for storing a selected path of target voice data, and the preset number being less than a number of paths of the at least three paths of voice data.

### Claim 19 (depends on 18)

The call apparatus according to claim 18, wherein the processor is further configured to execute the computer program instructions and perform:
comparing the voice energy of the first voice data with the voice energy of second voice data that has a smallest voice energy in the target voice data list, in response to determining that the first voice data includes a voice segment, and the number of the paths of voice data in the target voice data list has reached the preset number; and
adding the first voice data to the target voice data list, in response to determining that the voice energy of the first voice data is greater than the voice energy of the second voice data, and removing the second voice data from the target voice data list.

### Claim 20

A non-transitory computer-readable storage medium storing computer program instructions executable by at least one processor to perform:
obtaining at least three paths of voice data transmitted by at least three first terminals, the at least three paths of voice data each carrying a piece of indication information, the piece of indication information including at least a piece of voice activity detection (VAD) information, the piece of VAD information being configured for indicating whether the corresponding path of voice data includes a voice segment;
selecting at least two paths of target voice data from the at least three paths of voice data according to the pieces of indication information of the at least three paths of voice data as obtained, a number of paths of the at least two paths of target voice data being less than a number of paths of the at least three paths of voice data; and
transmitting the at least two paths of target voice data to a second terminal, the second terminal being configured to decode the at least two paths of target voice data, mix decoded at least two paths of target voice data, and play mixed voice data, wherein the second terminal is any terminal in a call group, and the at least three first terminals are terminals in the call group that are different from the second terminal.
