# US 2025/0152029 A1 · Promoting generalization in cross-dataset remote photoplethysmography

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0152029 A1
- Document ID: US20250152029A1
- Status: Published application
- Kind: A1
- Application number: 18/744,824
- Filed: 2024-06-17
- Published: 2025-05-15
- Earliest claimed: 2023-06-16
- Assignees: Securiport LLC; University of Notre Dame du Lac
- Applicants: Securiport LLC; University of Notre Dame du Lac
- Inventors: Nathan Vance; Jeremy Speth; Benjamin Sporrer; Patrick Flynn; Nathan Carpenter; Juan Manuel SEGURA
- Web page: https://patentgrep.com/patent/US20250152029A1

## CPC

- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/02433: {for infrared radiation}
- A61B 5/14552: {Details of sensors specially adapted therefor}
- A61B 5/7267: {involving training the classification device}
- A61B 5/7485: {Automatic selection of region of interest}
- G06T 7/0012: {Biomedical image inspection}
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06V 10/803: {of input or preprocessed data}
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06V 40/15: {Biometric patterns based on physiological signals, e.g. heartbeat, blood flow}
- G06V 40/168: {Feature extraction; Face representation}
- G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships}
- G16H 30/40: for processing medical images, e.g. editing
- G16H 40/63: for local operation
- G16H 40/67: for remote operation
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/30: for calculating health indices; for individual health risk assessment
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10048: Infrared image
- G06T 2207/30004: Biomedical image processing
- G06T 2207/30201: Face
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

Systems, devices, methods, and non-transitory computer-readable instructions for determining a physiological signal from a video stream, comprising capturing the video stream of a subject, the video stream including a sequence of frames, processing each frame of the video stream to identify a facial portion of the subject in each frame, determining a periodic physiological signal of the subject from the video stream using a plurality of datasets in which one or more augmentations were applied to the plurality of datasets.

## Claims

### Claim 1

A computer-implemented method for determining a physiological signal from a video stream, the computer-implemented method comprising:
capturing the video stream of a subject, the video stream including a sequence of frames;
processing each frame of the video stream to identify a facial portion of the subject in each frame;
determining a periodic physiological signal of the subject from the video stream using a plurality of datasets in which one or more augmentations were applied to the plurality of datasets.

### Claim 2 (depends on 1)

The computer-implemented method according to claim 1, wherein the plurality of datasets includes ground truth data and previously captured video data.

### Claim 3 (depends on 2)

The computer-implemented method according to claim 2, wherein the ground truth data is captured using pulse oximeter.

### Claim 4 (depends on 2)

The computer-implemented method according to claim 2, wherein the one or more augmentations is applied to the ground truth data and the previously captured video data.

### Claim 5 (depends on 1)

The computer-implemented method according to claim 1, wherein the one or more augmentation include at least one of horizontal flip, illumination, and Gaussian noise.

### Claim 6 (depends on 1)

The computer-implemented method according to claim 1, wherein the periodic physiological signal is heart rate.

### Claim 7 (depends on 1)

The computer-implemented method according to claim 1, wherein the facial portion is cropped to 64×64 pixels.

### Claim 8 (depends on 1)

The computer-implemented method according to claim 1, wherein the video stream includes one or more of a visible-light video stream, a near-infrared video stream, a longwave-infrared video stream, a thermal video stream, and an audio stream of the subject.

### Claim 9 (depends on 1)

The computer-implemented method according to claim 1, further comprising cropping each frame of the media stream to encapsulate a region of interest that includes one or more of a face, cheek, forehead, or an eye.

### Claim 10 (depends on 1)

The computer-implemented method according to claim 1, further comprising instructions for:
combining at least two of a visible-light video stream, a near-infrared video stream, and a thermal video stream into a fused video stream.

### Claim 11

A system for determining a physiological signal from a video stream, the system comprising:
a processor; and
a memory storing one or more programs for execution by the processor, the one or more programs including instructions for:
capturing the video stream of a subject, the video stream including a sequence of frames;
processing each frame of the video stream to identify a facial portion of the subject in each frame;
determining a periodic physiological signal of the subject from the video stream using a plurality of datasets in which one or more augmentations were applied to the plurality of datasets.

### Claim 12 (depends on 11)

The system according to claim 11, wherein the plurality of datasets includes ground truth data and previously captured video data.

### Claim 13 (depends on 12)

The system according to claim 12, wherein the ground truth data is captured using pulse oximeter.

### Claim 14 (depends on 12)

The system according to claim 12, wherein the one or more augmentations is applied to the ground truth data and the previously captured video data.

### Claim 15 (depends on 11)

The system according to claim 11, wherein the one or more augmentation include at least one of horizontal flip, illumination, and Gaussian noise.

### Claim 16 (depends on 11)

The system according to claim 11, wherein the periodic physiological signal is heart rate.

### Claim 17 (depends on 11)

The system according to claim 11, wherein the facial portion is cropped to 64×64 pixels.

### Claim 18 (depends on 11)

The system according to claim 11, wherein the video stream includes one or more of a visible-light video stream, a near-infrared video stream, a longwave-infrared video stream, a thermal video stream, and an audio stream of the subject.

### Claim 19 (depends on 11)

The system according to claim 11, further comprising cropping each frame of the media stream to encapsulate a region of interest that includes one or more of a face, cheek, forehead, or an eye.

### Claim 20 (depends on 11)

The system according to claim 11, further comprising instructions for:
combining at least two of a visible-light video stream, a near-infrared video stream, and a thermal video stream into a fused video stream.
