# US 2024/0163397 A1 · Mobile Terminal And Hub Apparatus For Use In A Video Communication System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0163397 A1
- Document ID: US20240163397A1
- Status: Published application
- Kind: A1
- Application number: 18/424,706
- Filed: 2024-01-26
- Published: 2024-05-16
- Earliest claimed: 2017-12-20
- Assignees: Huddle Room Technology S.R.L.
- Applicants: Huddle Room Technology S.R.L.
- Inventors: Mario Ferrari
- Web page: https://patentgrep.com/patent/US20240163397A1

## CPC

- H04N 7/15: Conference systems
- H04N 7/152: {Multipoint control units therefor}
- G10L 17/04: Training, enrolment or model building
- G10L 17/06: Decision making techniques; Pattern matching strategies
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04W 76/10: Connection setup
- G10L 17/00: Speaker identification or verification techniques
- H04N 1/42: Systems for two-way working {, e.g. conference systems (H04N1/32 takes precedence)}
- H04N 2007/145: {Handheld terminals}
- H04W 88/02: Terminal devices
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A hub apparatus (20) is designated to be used in a video communication system comprising the hub apparatus (20) and a plurality of mobile terminals (10a-10d) configured to be wirelessly connectable to the hub apparatus (20). The hub apparatus (20) comprises: a receiving unit (24) configured to receive from each mobile terminal (10) of the plurality of mobile terminals (10a-10d) a video stream, a current speaker indicator to indicate whether the user of the mobile terminal is speaking and an association information which associates the current speaker indicator transmitted by the mobile terminal with the video stream transmitted from such mobile terminal (10), and a generation unit (40) operatively connected to said receiving unit (24) and configured to generate an output video communication stream (6) based on the plurality of video streams received from each mobile terminal (10) of the plurality of mobile terminals (10a-10d), on the plurality of current speaker indicators received from each mobile terminal (10) of the plurality of mobile terminals (10a-10d) and on the plurality of association information received from each mobile terminal (10) of the plurality of mobile terminals (10a-10d).

## Claims

### Claim 1

An apparatus comprising:
a receiving unit configured to receive from each mobile terminal of a plurality of mobile terminals, a video stream, and a current speaker indicator, a processing unit configured to extract a voice timbre pattern model from an input audio signal to generate the current speaker indicator based on similarity between the extracted voice timbre pattern model and the voice timbre pattern model of a user of the mobile terminal;
wherein the processing unit repetitively generates the current speaker indicator with a fixed period of repetition over time to provide up-to date information according to a pace corresponding to the apparatus and an ability to track a current speaker during a conversation and to avoid an excessive processing during voice timbre pattern extraction; and
wherein the apparatus controls the pace at which the current speaker indicator is generated and sent by transmission of a timing signal to each mobile terminal of the plurality of mobile terminals comprising the pace at which the current speaker indicator must be generated by the mobile terminal and subsequently sent to the apparatus.

### Claim 2 (depends on 1)

The apparatus according to claim 1, further comprising:
a generation unit operatively connected to the receiving unit and configured to generate an output video communication stream based on a plurality of video streams received from the plurality of mobile terminals.

### Claim 3 (depends on 1)

The apparatus according to claim 1, further comprising:
a storage configured to store the voice timbre pattern model.

### Claim 4 (depends on 1)

The apparatus according to claim 1, wherein the processing unit calculates a correlation parameter percentage value based on a probability of the similarity.

### Claim 5 (depends on 4)

The apparatus according to claim 4, wherein the current speaker indicator is generated based on the correlation parameter.

### Claim 6 (depends on 1)

The apparatus according to claim 1, further comprising:
a timing unit configured to transmit the timing signal to each of the plurality of mobile terminals providing information on a time span within which a transmission unit of each of the plurality of mobile terminals to transmit the current speaker indicator to the apparatus.

### Claim 7 (depends on 2)

The apparatus according to claim 2, wherein the generation unit is configured to generate the output video communication stream based on current speaker indicators received from each of the plurality of mobile terminals within a time window related to timing information included in the timing signal.

### Claim 8 (depends on 1)

The apparatus according to claim 1, wherein the current speaker indicator expresses a probability that the user of the mobile terminal is speaking.

### Claim 9 (depends on 1)

The apparatus according to claim 1, wherein the apparatus is configured to establish a wireless connection with each mobile terminal of the plurality of mobile terminals.

### Claim 10 (depends on 9)

The apparatus according to claim 9, wherein the apparatus is configured to receive the video stream and the current speaker indicator of another mobile terminal via the wireless connection with the mobile terminal, and association information which associates the current speaker indicator transmitted by each mobile terminal of the plurality of mobile terminals to the video stream based on identifiers of the wireless connection.

### Claim 11 (depends on 10)

The apparatus according to claim 10, wherein the generation unit is configured to generate an output video communication stream based on the current speaker indicator of the mobile terminal and on the association information.

### Claim 12

A method comprising:
receiving, by a receiving unit, from each mobile terminal of a plurality of mobile terminals, a video stream, and a current speaker indicator, a processing unit configured to extract a voice timbre pattern model from an input audio signal to generate the current speaker indicator based on similarity between the extracted voice timbre pattern model and the voice timbre pattern model of a user of the mobile terminal;
wherein the processing unit repetitively generates the current speaker indicator with a fixed period of repetition over time to provide up-to date information according to a pace corresponding to the apparatus and an ability to track a current speaker during a conversation and to avoid an excessive processing during voice timbre pattern extraction; and
wherein the apparatus controls the pace at which the current speaker indicator is generated and sent by transmission of a timing signal to each mobile terminal of the plurality of mobile terminals comprising the pace at which the current speaker indicator must be generated by the mobile terminal and subsequently sent to the apparatus.

### Claim 13 (depends on 12)

The method according to claim 12, further comprising:
generating, by a generation unit operatively connected to the receiving unit, an output video communication stream based on a plurality of video streams received from the plurality of mobile terminals.

### Claim 14 (depends on 12)

The method according to claim 12, further comprising:
storing, by a storage, the voice timbre pattern model.

### Claim 15 (depends on 12)

The method according to claim 12, further comprising:
calculating a correlation parameter percentage value based on a probability of the similarity.

### Claim 16 (depends on 15)

The method according to claim 15, wherein the current speaker indicator is generated based on the correlation parameter.

### Claim 17 (depends on 12)

The method according to claim 12, further comprising:
transmitting, by a timing unit, the timing signal to each of the plurality of mobile terminals providing information on a time span within which a transmission unit of each of the plurality of mobile terminals to transmit the current speaker indicator to the apparatus.

### Claim 18 (depends on 13)

The method according to claim 13, wherein the generation unit is configured to generate the output video communication stream based on current speaker indicators received from each of the plurality of mobile terminals within a time window related to timing information included in the timing signal.

### Claim 19 (depends on 12)

The method according to claim 12, wherein the current speaker indicator expresses a probability that the user of the mobile terminal is speaking.

### Claim 20 (depends on 12)

The method according to claim 12, wherein the apparatus is configured to establish a wireless connection with each mobile terminal of the plurality of mobile terminals.
