# US 2021/0084084 A1 · Video control method, video conference terminal and multi-point control unit (mcu) > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0084084 A1 - Document ID: US20210084084A1 - Status: Published application - Kind: A1 - Application number: 17/105,348 - Filed: 2020-11-25 - Published: 2021-03-18 - Earliest claimed: 2018-05-25 - Assignees: Zte Corporation - Applicants: Zte Corporation - Inventors: Yunzheng CHEN; Dalin WANG - Web page: https://patentgrep.com/patent/US20210084084A1 ## CPC - H04N 7/152: {Multipoint control units therefor} - G06V 40/161: {Detection; Localisation; Normalisation} - G06V 40/166: {using acquisition arrangements} - G06V 40/172: {Classification, e.g. identification} - G06V 40/173: {face re-identification, e.g. recognising unknown faces across different face tracks} - H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) - H04L 65/4038: with floor control - H04L 65/611: for multicast or broadcast (systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06) - H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)} - H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)} - H04N 7/15: Conference systems - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Embodiments of the present application provide a video control method, a video conference terminal and a multi-point control unit (MCU). The method comprises: performing human facial recognition on a video code stream and determining a motion quantity of the video code stream; sorting identifiers P and motion quantities R respectively corresponding to a plurality of video code streams; and selecting video code streams corresponding to video conference terminals ranked top M for synthesis and output and/or selecting a video conference terminal corresponding to a video code stream ranked first as a broadcast source. ## Claims ### Claim 1 A video control method applied to a video conference terminal, comprising: uploading a video code stream to a multi-point control unit (MCU); performing human facial recognition on the video code stream and determining a motion quantity R of the video code stream, and using an identifier P to indicate whether there is a person in the video code stream or not; and sending the identifier P and the motion quantity R of the video code stream to the MCU, such that the MCU performs video synthesis and output, and/or selects a broadcast source. ### Claim 2 (depends on 1) The video control method of claim 1, wherein performing the human facial recognition on the video code stream and determining the motion quantity R of the video code stream comprises: extracting N frames of images from the video code stream and saving them in a buffer; performing the human facial recognition on the N frames of images, and using the identifier P to indicate whether there is a person in the N frames of images or not; determining, according to the N frames of images, the motion quantity R of the video code stream corresponding thereto. ### Claim 3 (depends on 2) The video control method of claim 2, wherein extracting the N frames of images from the video code stream comprises: extracting y frames from every x seconds of video in the video code stream for z times continuously, wherein y*z=N, and x, y and z are all natural numbers greater than or equal to 1. ### Claim 4 (depends on 2) The video control method of claim 2, wherein performing the human facial recognition on the N frames of images comprises: performing the human facial recognition on one or more of the N frames of images, and if there is a person in any one of the one or more of the frames of images, determining that there is a person in the N frames of images; and if there is no person in any one of the one or more of the frames of images, determining that there is no person in the N frames of images. ### Claim 5 (depends on 4) The video control method of claim 4, wherein using the identifier P to indicate whether there is a person in the N frames of images or not comprises: if there is a person in the N frames of images, assigning a value of 1 to the identifier P of the video code stream, and if there is no person in the N frames of images, assigning a value of 0 to the identifier P. ### Claim 6 (depends on 2) The video control method of claim 2, wherein determining, according to the N frames of images, the motion quantity R of the video code stream corresponding thereto comprises: analyzing the N frames of images buffered in the buffer to obtain x*z seconds of the motion quantity of the video code stream, as the motion quantity R of the video code stream. ### Claim 7 (depends on 2) The video control method of claim 2, wherein, before extracting the N frames of images from the video code stream and saving them in the buffer, the method further comprises: applying for a buffer that is capable of saving N frames of images. ### Claim 8 A video control method applied to a multi-point control unit (MCU), comprising: receiving video code streams respectively sent by a plurality of video conference terminals; receiving identifiers P and motion quantities R respectively corresponding to the video code streams sent by the plurality of video conference terminals, the identifier P indicating whether there is a person in the corresponding video code stream or not; and sorting the video code streams according to the identifiers P and the motion quantities R respectively corresponding to the video code streams, and selecting video code streams corresponding to the video conference terminals ranked top M for synthesis and output, and/or selecting a video conference terminal corresponding to a video code stream ranked first as a broadcast source. ### Claim 9 (depends on 8) The video control method of claim 8, wherein rules for the sorting include: ranking a video code stream having a person therein higher than a video code stream having no person therein; and ranking a first video code stream higher than a second video code stream if each of the first and second video code streams has a person therein and the first video code stream has a higher value of motion quantity R than that of the second video code stream. ### Claim 10 A video control method applied to a multi-point control unit (MCU), comprising: receiving video code streams respectively uploaded by a plurality of video conference terminals; performing human facial recognition on each of the uploaded video code streams and determining a motion quantity R for each of the video code streams, wherein each of the video code streams uses its own identifier P to indicate whether there is a person in the video code stream or not; and sorting the video code streams according to the identifiers P and the motion quantities R respectively corresponding to the video code streams, and selecting video code streams ranked top M for synthesis and output, and/or selecting a video conference terminal corresponding to a video code stream ranked first as a broadcast source. ### Claim 11 (depends on 10) The video control method of claim 10, wherein performing the human facial recognition on each of the uploaded video code streams and determining the motion quantity R for each of the video code streams comprises: extracting N frames of images from each of the video code streams and saving them in a buffer: performing the human facial recognition on the N frames of images, and using the identifier P to indicate whether there is a person in the N frames of images or not; determining, according to the N frames of images, the motion quantity R of the video code stream corresponding thereto. ### Claim 12 (depends on 11) The video control method of claim 11, wherein extracting the N frames of images from each of the video code streams comprises: extracting y frames from every x seconds of video in each of the video code streams for z times continuously, wherein y*z=N, and x, y and z are all positive integers. ### Claim 13 (depends on 11) The video control method of claim 11, wherein, before extracting the N frames of images from each of the video code streams and saving them in the buffer, the method further comprises: applying for a buffer that is capable of saving the N frames of images for each of the video conference terminals. ### Claim 14 (depends on 11) The video control method of claim 11, wherein performing the human facial recognition on the N frames of images comprises: performing the human facial recognition on one or more of the N frames of images, and if there is a person in any one of the one or more of the frames of images, determining that there is a person in the N frames of images; and if there is no person in any one of the one or more of the frames of images, determining that there is no person in the N frames of images. ### Claim 15 (depends on 14) The video control method of claim 14, wherein using the identifier P to indicate whether there is a person in the N frames of images or not comprises: if there is a person in the N frames of images, assigning a value of 1 to the identifier P of the video code stream, and if there is no person in the N frames of images, assigning a value of 0 to the identifier P. ### Claim 16 (depends on 11) The video control method of claim 11, wherein determining, according to the N frames of images, the motion quantity R of the video code stream corresponding thereto comprises: analyzing buffered N frames of images to obtain x*z seconds of the motion quantity of the corresponding video code stream, as the motion quantity R of the corresponding video code stream. ### Claim 17 (depends on 10) The video control method of claim 10, wherein rules for the sorting include: ranking a video code stream having a person therein higher than a video code stream having no person therein; and ranking a first video code stream higher than a second video code stream if each of the first and second video code streams has a person therein and the first video code stream has a higher value of motion quantity R than that of the second video code stream. ### Claim 18 (depends on 15) The video control method of claim 15, wherein rules for the sorting include: ranking a video code stream in which P=1 higher than a video code stream in which P=0; and ranking a first video code stream higher than a second video code stream if P=1 for each of the first and second video code streams and the first video code stream has a higher value of R than that of the second video code stream.