US 9,317,762 B2 · Face recognition using depth based tracking

Abstract

Face recognition training database generation technique embodiments are presented that generally involve collecting characterizations of a person's face that are captured over time and as the person moves through an environment, to create a training database of facial characterizations for that person. As the facial characterizations are captured over time, they are will represent the person's face as viewed from various angles and distances, different resolutions, and under different environmental conditions (e.g., lighting and haze conditions). Further, over a long period of time where facial characterizations of a person are collected periodically, these characterizations can represent an evolution in the appearance of the person. This produces a rich training resource for use in face recognition systems. In addition, since a person's face recognition training database can be established before it is needed by a face recognition system, once employed, the training will be quicker.

Claims19

Dependent claims

A computer-implemented process for locating one or more persons in an environment, comprising:

using a computer to perform the following process actions:
inputting a sequence of contemporaneously-captured frame pairs, each frame pair comprising a frame output from a color video camera and a frame output from a depth video camera;
using a face detection method and the color video camera frames to detect potential persons in a environment;
using a motion detection method and the depth video camera frames to detect potential persons in the environment;
and
using detection results generated via the face detection method and motion detection method to determine the location of one or more persons in the environment.

3 more elements

A system for locating one or more persons in an environment, comprising:

a color video camera;
a depth video camera;
and
a computing device which executes program modules of a computer program, the computing device being directed by the program modules of the computer program to,
input a sequence of contemporaneously-captured frame pairs, each frame pair comprising a frame output from a color video camera and a frame output from a depth video camera,
use a face detection method and the color video camera frames to detect potential persons in a environment,
use a motion detection method and the depth video camera frames to detect potential persons in the environment, and
use detection results generated via the face detection method and motion detection method to determine the location of one or more persons in the environment.

5 more elements

A computer-implemented process for locating one or more persons in an environment, comprising:

using a computer to perform the following process actions:
inputting a sequence of contemporaneously-captured frame pairs, each frame pair comprising a frame output from a color video camera and a frame output from an infrared-based depth video camera, wherein the color video camera and depth video camera are disposed on a mobile robotic device which is capable of moving about the environment;
using a face detection method and the color video camera frames to detect potential persons in a environment;
using a motion detection method and the depth video camera frames to detect potential persons in the environment;
and
using detection results generated via the face detection method and motion detection method to determine the location of one or more persons in the environment.

3 more elements

Dependencies are inferred from the claim text.

Face recognition using depth based tracking

Life of this patent

Face recognition using depth based tracking

Life of this patent

Abstract

Claims19