US 2024/0265731 A1 · Systems and Methods for On-Device Person Recognition and Provision of Intelligent Alerts

Abstract

The present document describes systems and methods for on-device person recognition and provision of intelligent alerts. The system includes a decentralized multi-camera system for on-device facial recognition. A device (e.g., security camera, video doorbell) captures images/video of a person, processes input image frames, detects face images, filters static faces, and aligns a rotation of the face to be upright and frontal. The device then filters low-quality face images and/or images having a large portion of the face occluded. The device computes a face embedding, compares it against a set of locally stored reference embeddings, and sends matching results to cloud services, which, based on the matching result, notifies the device owner whether the observed person is a known person or a stranger. Face detection and recognition computations are performed on device, not at the cloud. No sensitive information is transmitted off device and privacy is thus preserved.

Claims20

Dependent claims

A method for on-device facial recognition, the method comprising:

storing a library of reference embeddings in a local memory on a wireless network device having a camera, a facial recognition system, and an on-device machine-learning framework, the reference embeddings being grouped in clusters;
capturing, by the camera on the wireless network device, an image of a person;
detecting, by the wireless network device, a face of the person in the image to provide a face detection;
generating, responsive to the detecting and by the on-device machine-learning framework on the wireless network device, a face embedding representing the face of the person in the image;
verifying, by the facial recognition system on the wireless network device, the face embedding against the clusters stored in the local memory of the wireless network device;
and
transmitting a result of the verifying to another device to notify a user of whether the face is a familiar face or an unfamiliar face.

4 more elements

An electronic device comprising:

a camera configured to capture images or video of a scene;
one or more processors;
and
local memory storing:
a local library of reference embeddings organized into clusters, each cluster having a subset of the reference embeddings and being associated with a human face;
an on-device machine-learning framework configured to, based on a face detection of a face of a person in an image captured by the camera, generate a face embedding representing the face of the person in the image;
a facial recognition system configured to verify the face embedding against the clusters stored in the local memory;
and
executable instructions that, when executed by the one or more processors, cause the one or more processors to:
transmit a result of a verification of the face embedding to another device to notify a user of whether the face is a familiar face or an unfamiliar face.

7 more elements

Dependencies are inferred from the claim text.

Systems and Methods for On-Device Person Recognition and Provision of Intelligent Alerts

Life of this patent

Systems and Methods for On-Device Person Recognition and Provision of Intelligent Alerts

Life of this patent

Abstract

Claims20