# US 2025/0159330 A1 · Detecting Facial Expressions in Digital Images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0159330 A1
- Document ID: US20250159330A1
- Status: Published application
- Kind: A1
- Application number: 19/026,286
- Filed: 2025-01-16
- Published: 2025-05-15
- Earliest claimed: 2008-01-27
- Assignees: Adeia Imaging LLC
- Applicants: Adeia Imaging LLC
- Inventors: Catalina Neghina; Mihnea Gangea; Stefan Petrescu; Emilian David; Petronel Bigioi; Eric Zarakov; Eran Steinberg
- Web page: https://patentgrep.com/patent/US20250159330A1

## CPC

- H04N 23/611: where the recognised objects include parts of the human body
- G06V 40/161: {Detection; Localisation; Normalisation}
- G06V 40/166: {using acquisition arrangements}
- G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships}
- G06V 40/172: {Classification, e.g. identification}
- G06V 40/174: {Facial expression recognition}
- G06V 40/175: {Static expression}
- H04N 23/61: based on recognised objects
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method and system for detecting facial expressions in digital images and applications therefore are disclosed. Analysis of a digital image determines whether or not a smile and/or blink is present on a person's face. Face recognition, and/or a pose or illumination condition determination, permits application of a specific, relatively small classifier cascade.

## Claims

### Claim 1

An imaging device, comprising:
at least one imager;
a processor; and
a memory storing instructions that, when read by the processor, cause the imaging device to:
acquire, using the at least one imager, a plurality of images, each image of the plurality of images comprising a group of pixels corresponding to a face;
track the face within the plurality of images;
detect a transition in facial state of the face from eyes of the face open to eyes of the face closed within the plurality of images; and
trigger a warning signal to a user based on the detected transition of facial state.

### Claim 2 (depends on 1)

The imaging device of claim 1, wherein the instructions, when read by the processor, further cause the imaging device to:
detect a transition in pose of the face from looking straight ahead to looking down, and
trigger the warning signal based on the detected transition in pose.

### Claim 3 (depends on 1)

The imaging device of claim 1, wherein the warning signal is an auditory signal.

### Claim 4 (depends on 1)

The imaging device of claim 1, wherein the transition in facial state is associated with sleeping.

### Claim 5 (depends on 4)

The imaging device of claim 4, wherein the instructions, when read by the processor, further cause the imaging device to determine whether an orientation of the face is in plane, or out of plane.

### Claim 6 (depends on 1)

The imaging device of claim 1, wherein the plurality of images comprises a stream of images in a plurality of intervals, and wherein to detect a transition in facial state, the instructions, when read by the processor, further cause the imaging device to:
determine a facial expression state for each given interval of the plurality of intervals by accumulating facial expression state information over multiple images of the given interval; and
classify a facial expression state for the interval based on the accumulated facial expression state information.

### Claim 7 (depends on 6)

The imaging device of claim 6, wherein the accumulated facial expression state information comprises a confidence parameter updated based on a classification of facial expression state in each image of a given interval.

### Claim 8 (depends on 1)

The imaging device of claim 1, wherein the instructions, when read by the processor, further cause the imaging device to apply face recognition to the face.

### Claim 9 (depends on 8)

The imaging device of claim 8, wherein the memory further stores a recognition profile associated with the face.

### Claim 10 (depends on 8)

The imaging device of claim 8, wherein the instructions, when read by the processor, further cause the imaging device to:
obtain a user input requesting a new recognition profile; and
generate the new recognition profile using the face and the applied face recognition.

### Claim 11

A method of facial state tracking, comprising:
acquiring, using at least one imager, a plurality of images, each image of the plurality of images comprising a group of pixels corresponding to a face;
tracking the face within the plurality of images;
detecting a transition in facial state of the face from eyes of the face open to eyes of the face closed within the plurality of images; and
triggering a warning signal to a user based on the detected transition of facial state.

### Claim 12 (depends on 11)

The method of facial state tracking of claim 11, further comprising:
detecting a transition in pose of the face from looking straight ahead to looking down, and
triggering the warning signal based on the detected transition in pose.

### Claim 13 (depends on 11)

The method of facial state tracking of claim 11, wherein the warning signal is an auditory signal.

### Claim 14 (depends on 11)

The method of facial state tracking of claim 11, wherein the transition in facial state is associated with sleeping.

### Claim 15 (depends on 14)

The method of facial state tracking of claim 14, further comprising determining whether an orientation of the face is in plane or out of plane, in order to determine association with sleeping.

### Claim 16 (depends on 11)

The method of facial state tracking of claim 11, wherein the plurality of images comprises a stream of images in a plurality of intervals, and detecting a transition in facial state comprises:
Determining a facial expression state for each given interval of the plurality of intervals by accumulating facial expression state information over multiple images of the given interval; and
classifying a facial expression state for the interval based on the accumulated facial expression state information and logic that spans over several images, wherein each interval of the plurality of intervals includes one or more previously acquired images from the stream of images.

### Claim 17 (depends on 16)

The method of facial state tracking of claim 16, wherein the accumulated facial expression state information comprises a confidence parameter updated based on a classification of facial expression state in each image of a given interval.

### Claim 18 (depends on 11)

The method of facial state tracking of claim 11, further comprising applying face recognition to the face.

### Claim 19 (depends on 18)

The method of facial state tracking of claim 18, further comprising storing a recognition profile associated with the face.

### Claim 20 (depends on 18)

The method of facial state tracking of claim 18. further comprising:
obtaining a user input requesting a new recognition profile; and
generating the new recognition profile using the face and the applied face recognition.
