Joint upper-body and face detection using multi-task cascaded convolutional networks
AssigneePolycom, Inc.
InventorsHai Xu, Xi Lu, Yongkang Fan, Wenxue He
Life of this patent
Estimating the term…
Abstract
A videoconferencing endpoint is described that uses a cascading sequence of convolutional neural networks to perform face detection and upper body detection of participants in a videoconference at the endpoint, where at least one member of the sequence of neural networks performs upper body detection, and where the final member of the sequence of neural networks performs face detection based on the results of the upper body detection. The models of the neural networks are trained on both large datasets of faces well as images that have been distorted by a wide-angle camera of the videoconferencing endpoint.
Claims21
A method of detecting faces and upper bodies of participants in a videoconference, comprising:
- receiving video data from a camera of a videoconferencing endpoint;
- performing upper body detection in the video data using a first neural network;
- and
- performing face detection by a second neural network in areas of the video data identified by the upper body detection of the first neural network.
A video conferencing endpoint, comprising:
- a housing;
- a camera, disposed in the housing;
- a processing unit, disposed in the housing and coupled to the camera;
- a memory, disposed in the housing and coupled to the processing unit and the camera, in which are stored instructions for performing face detection and upper body detection, comprising instructions that when executed cause the processing unit to:
- receive video data from the camera;
- perform upper body detection in the video data using a first neural network;
- and
- perform face detection by a second neural network in areas of the video data identified by the upper body detection of the first neural network.
A non-transitory machine readable medium including instructions, that when executed cause a processing unit of a videoconferencing endpoint to perform the methods of:
- receiving video data from a camera of a videoconferencing endpoint;
- performing upper body detection in the video data using a first neural network;
- and
- performing face detection by a second neural network in areas of the video data identified by the upper body detection of the first neural network.
Dependencies are inferred from the claim text.