# US 10,771,694 B1 · Conference terminal and conference system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,771,694 B1
- Document ID: US10771694B1
- Status: Granted
- Kind: B1
- Application number: 16/561,976
- Filed: 2019-09-05
- Granted: 2020-09-08
- Earliest claimed: 2019-04-02
- Assignees: Boe Technology Group Co., Ltd.
- Applicants: Boe Technology Group Co., Ltd.
- Inventors: Lihua Geng; Qingguo Yang
- Web page: https://patentgrep.com/patent/US10771694B1

## CPC

- H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display}
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/172: {Classification, e.g. identification}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 21/0208: Noise filtering
- G10L 25/51: for comparison or discrimination
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 7/15: Conference systems
- H04R 1/02: Casings; Cabinets {; Supports therefor;} Mountings therein (H04R1/28 takes precedence {; attachments for microphones H04R1/08; mounting of transducers in earpieces H04R1/1075})
- H04R 1/08: Mouthpieces; {Microphones;} Attachments therefor
- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- H04R 27/00: Public address systems (circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; {monitoring or testing arrangements for public address systems H04R29/007}; amplifiers H03F)
- G10L 25/57: for processing of video signals
- H04R 2201/401: 2D or 3D arrays of transducers
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

Provided are a conference terminal and a conference system are proposed for providing integral conference image in video conference scenes. The conference terminal includes: a plurality of image acquisition devices, each of the image acquisition devices being configured to acquire a partial conference image; and an image processing device configured to receive a plurality of partial conference images from the plurality of image acquisition devices, convert the plurality of partial conference images into one integral conference image, and output the integral conference image.

## Claims

### Claim 1

A conference terminal, comprising:
a plurality of image acquisition devices, each of the image acquisition devices being configured to acquire a partial conference image;
an image processing device configured to receive a plurality of partial conference images from the plurality of image acquisition devices, convert the plurality of partial conference images into one integral conference image, and output the integral conference image;
a plurality of voice acquisition devices, each of the voice acquisition devices being configured to acquire a partial conference voice; and
a voice processing device configured to receive a plurality of partial conference voices from the plurality of voice acquisition devices, obtain speech data based on the plurality of partial conference voices, convert the speech data into speech voices, and output the speech voices, wherein
the voice processing device includes a voice source orientation determining module configured to determine location information of a speaker according to the speech data, wherein
the image processing device includes a person recognizing module and a person marking module;
the person recognizing module is configured to receive the integral conference image, and identify persons and person locations in the integral conference image to obtain person information and person location information in the integral conference image;
the person marking module is configured to receive the location information of the speaker, and form the integral conference image having a person tag of the speaker based on the location information of the speaker, the person information, and the person location information.

### Claim 2 (depends on 1)

The conference terminal according to claim 1, wherein
the image processing device includes a correcting module, an image stitching module, and an image outputting module;
the correcting module is configured to receive the plurality of partial conference images, and correct the plurality of partial conference images into a plurality of planar images respectively;
the image stitching module is configured to receive the plurality of planar images outputted by the correcting module, and perform smooth docking on the plurality of planar images to form the integral conference image;
the image outputting module is configured to output the integral conference image.

### Claim 3 (depends on 2)

The conference terminal according to claim 2, wherein
the image processing device further includes a face recognizing module;
the face recognizing module is configured to receive the integral conference image, and identify person names in the integral conference image and determine marking locations of the person names to obtain person name information and marking location information of person names in the integral conference image;
the person marking module is further configured to receive the person information, the person location information, the person name information, and the marking location information of person names in the integral conference image, and mark the person names in the integral conference image according to the person information, the person location information, the person name information, and the marking location information of person names in the integral conference image, so as to form the integral conference image having person name tags.

### Claim 4 (depends on 3)

The conference terminal according to claim 3, wherein
the voice processing device includes a denoising module and a voice outputting module;
the denoising module is configured to receive a plurality of partial voice data, and perform denoising processing on the plurality of partial voice data to obtain speech data;
the voice outputting module is configured to receive the speech data, and perform digital-to-analog conversion on the speech data to form speech voices.

### Claim 5 (depends on 4)

The conference terminal according to claim 4, wherein
the voice processing device further includes a voice source orientation determining module, the voice source orientation determining module is configured to receive the speech data, and determine location information of a speaker according to the speech data;
the image processing device further includes a demarking module,
wherein the marking module forms the integral conference image having person tags of all persons and person name tags of all persons, and the demarking module causes, according to the location information of the speaker, only the speaker to have a person tag in the integral conference image having person tags of all persons and person name tags of all persons, so as to form the integral conference image with person tags of only the speaker and person name tags of all persons.

### Claim 6 (depends on 1)

The conference terminal according to claim 1, wherein
the voice processing device further includes a voice recognizing module;
the voice recognizing module is configured to receive the speech data, and convert the speech data into text information;
the image processing device further includes a subtitle adding module; the subtitle adding module adds the text information to the integral conference image so as to form the integral conference image having subtitles.

### Claim 7 (depends on 1)

The conference terminal according to claim 1, further comprising:
a fixing frame,
wherein the plurality of image acquisition devices are circumferentially disposed on an outer surface of the fixing frame, and the plurality of voice acquisition devices are circumferentially disposed on the outer surface of the fixing frame.

### Claim 8 (depends on 7)

The conference terminal according to claim 7, further comprising:
a lifting bracket connected to the fixing frame and configured to drive lifting and lowering of the fixing frame.

### Claim 9 (depends on 7)

The conference terminal according to claim 7, wherein
the voice acquisition device is a microphone;
the image acquisition device is a wide-angle camera;
the fixing frame is an annular fixing frame, a top of an outer surface of the annular fixing frame is uniformly provided with four wide-angle cameras circumferentially, and a central portion of the outer surface of the annular fixing frame is uniformly provided with eight microphones circumferentially.

### Claim 10 (depends on 1)

A conference system comprising:
a conference terminal according to claim 1, which is located at a first location;
a display device located at a second location and configured to receive and display an integral conference image outputted by the image outputting module of the conference terminal located at the first location; and
an acoustic device located at the second location and configured to receive and play speech voices outputted by the voice outputting module of the conference terminal located at the first location.

### Claim 11 (depends on 10)

The conferencing system according to claim 10, further comprising:
a conference terminal located at the second location;
a display device and an acoustic device located at the first location,
wherein the display device at the first location is configured to receive and display the integral conference image outputted by the image outputting module of the conference terminal located at the second location;
the acoustic device located at the first location is configured to receive and display speech voices outputted by the voice outputting module of the conference terminal located at the second location.
