# US 2023/0274582 A1 · Deception detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274582 A1
- Document ID: US20230274582A1
- Status: Published application
- Kind: A1
- Application number: 18/115,414
- Filed: 2023-02-28
- Published: 2023-08-31
- Earliest claimed: 2022-02-28
- Assignees: Securiport LLC; Department of Computer Science and Engineering University of Notre Dame
- Applicants: Securiport LLC; Department of Computer Science and Engineering University of Notre Dame
- Inventors: Nathan Vance; Jeremy Speth; Siamul Karim Khan; Adam Czajka; Kevin W. Bowyer; Diane Wright; Patrick Flynn; Nathan Carpenter; Leandro Olie
- Web page: https://patentgrep.com/patent/US20230274582A1

## CPC

- G06V 40/70: Multimodal biometrics, e.g. combining information from different biometric modalities
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/015: {By temperature mapping of body part}
- A61B 5/024: Measuring pulse rate or heart rate
- A61B 5/02416: {using photoplethysmograph signals, e.g. generated by infrared radiation (A61B5/14552 takes precedence)}
- A61B 5/164: {Lie detection}
- A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety}
- A61B 5/7267: {involving training the classification device}
- G06V 10/10: Image acquisition (document image scanning and transmission H04N1/00; control of digital cameras H04N23/60)
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- G06V 40/161: {Detection; Localisation; Normalisation}
- G06V 40/174: {Facial expression recognition}
- G06V 40/45: {Detection of the body part being alive}
- G06V 40/15: {Biometric patterns based on physiological signals, e.g. heartbeat, blood flow}
- G06V 40/176: {Dynamic expression}
- G06V 40/193: {Preprocessing; Feature extraction}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

Systems, devices, methods, and non-transitory computer-readable instructions for detecting deception of a subject from a media stream that capture a media stream of the subject including, the media stream including a sequence of frames, process each frame of the media stream to track a plurality of biometrics, and determine whether the subject in the media stream is deceptive based upon changes to respective biometrics.

## Claims

### Claim 1

A computer-implemented method for detecting deception of a subject from a media stream, the computer-implemented method comprising:
capturing a media stream of the subject including, the media stream including a sequence of frames;
processing each frame of the media stream to track a plurality of biometrics; and
determining whether the subject in the media stream is deceptive based upon changes to respective biometrics.

### Claim 2 (depends on 1)

The computer-implemented method according to claim 1, wherein the media stream includes one or more of a visible-light video stream, a near-infrared video stream, a longwave-infrared video stream, a thermal video stream, and an audio stream of the subject.

### Claim 3 (depends on 1)

The computer-implemented method according to claim 1, wherein the plurality of biometrics includes two or more of pulse rate, eye gaze, eye blink rate, pupil diameter, face temperature, speech, and micro-expressions.

### Claim 4 (depends on 1)

The computer-implemented method according to claim 1, wherein the plurality of biometrics includes pulse rate, pupil diameter, and face temperature.

### Claim 5 (depends on 1)

The computer-implemented method according to claim 1, further comprising cropping each frame of the media stream to encapsulate a region of interest that includes one or more of a face, cheek, forehead, or an eye.

### Claim 6 (depends on 5)

The computer-implemented method according to claim 5, wherein the region of interest includes two or more body parts.

### Claim 7 (depends on 1)

The computer-implemented method according to claim 1, further comprising:
combining at least two of a visible-light video stream, a near-infrared video stream, and a thermal video stream into a fused video stream.

### Claim 8 (depends on 7)

The computer-implemented method according to claim 7, wherein the visible-light video stream, the near-infrared video stream, and/or the thermal video stream are combined according to a synchronization device.

### Claim 9

A system for detecting deception of a subject from a media stream, the system comprising:
a processor; and
a memory storing one or more programs for execution by the processor, the one or more programs including instructions for:
capturing a media stream of the subject, the media stream including a sequence of frames;
processing each frame of the media stream to track a plurality of biometrics; and
determining whether the subject in the media stream is deceptive based upon changes to respective biometrics.

### Claim 10 (depends on 9)

The system according to claim 9, wherein the media stream includes one or more of a visible-light video stream, a near-infrared video stream, a longwave-infrared video stream, a thermal video stream, and an audio stream of the subject.

### Claim 11 (depends on 9)

The system according to claim 9, wherein the plurality of biometrics includes two or more of pulse rate, eye gaze, eye blink rate, pupil diameter, face temperature, speech, and micro-expressions.

### Claim 12 (depends on 9)

The system according to claim 9, wherein the plurality of biometrics includes pulse rate, pupil diameter, and face temperature.

### Claim 13 (depends on 9)

The system according to claim 9, further comprising cropping each frame of the media stream to encapsulate a region of interest that includes one or more of a face, cheek, forehead, or an eye.

### Claim 14 (depends on 13)

The system according to claim 13, wherein the region of interest includes two or more body parts.

### Claim 15 (depends on 9)

The system according to claim 9, further comprising:
combining at least two of a visible-light video stream, a near-infrared video stream, and a thermal video stream into a fused video stream.

### Claim 16 (depends on 15)

The system according to claim 15, wherein the visible-light video stream, the near-infrared video stream, and/or the thermal video stream are combined according to a synchronization device.
