# US 11,432,727 B2 · SpO2 miniprogram: AI SpO2 measurement app

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,432,727 B2
- Document ID: US11432727B2
- Status: Granted
- Kind: B2
- Application number: 16/869,740
- Filed: 2020-05-08
- Published: 2021-11-11
- Granted: 2022-09-06
- Earliest claimed: 2020-05-08
- Assignees: Tencent America LLC
- Applicants: Tencent America LLC
- Inventors: Lianyi Han; Chao Huang; Xiaozhong Chen; Zhimin Huo; Shih-Yao Lin; Hui Tang; Tao Yang; Kun Wang; Wei Fan
- Web page: https://patentgrep.com/patent/US11432727B2

## CPC

- G06Q 10/40: Business processes related to social networking or social networking services
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/0205: Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
- A61B 5/02416: {using photoplethysmograph signals, e.g. generated by infrared radiation (A61B5/14552 takes precedence)}
- A61B 5/0261: {using optical means, e.g. infrared light}
- A61B 5/14551: {for measuring blood gases}
- A61B 5/14552: {Details of sensors specially adapted therefor}
- A61B 5/6826: {Finger}
- A61B 5/6898: {Portable consumer electronic devices, e.g. music players, telephones, tablet computers}
- A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems}
- A61B 5/742: {using visual displays (displays for heart-related electrical signals, e.g. ECG, A61B5/339)}
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06F 17/18: for evaluating statistical data {, e.g. average values, frequency distributions, probability functions, regression analysis (forecasting specially adapted for a specific administrative, business or logistic context G06Q10/04)}
- G06K 7/10722: {Photodetector array or CCD scanning}
- G06K 7/1413: {1D bar codes}
- G06K 7/1417: {2D bar codes}
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices
- A61B 2560/0431: Portable apparatus, e.g. comprising a handle or case
- G09G 2380/08: Biomedical applications
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

There is included an apparatus and system including video capture code configured to control a camera of a mobile phone to capture a video of at least a portion of skin, extraction code configured to extract at least one photoplethysmogram (PPG) signal from the video, determination code configured to determine a peripheral oxygen saturation (SpO2) value based on the PPG signal with respect to a blood flow at the portion of skin, and display code configured to control a display of the mobile phone to display the SpO2 value.

## Claims

### Claim 1

An apparatus comprising:
at least one memory configured to store computer program code; and
at least one hardware processor configured to access said computer program code and operate as instructed by said computer program code, said computer program code including:
video capture code configured to cause the at least one hardware processor to control a camera of a mobile phone to capture a video of at least a portion of skin;
extraction code configured to cause the at least one hardware processor to extract at least one photoplethysmogram (PPG) signal from the video;
analysis code configured to cause the at least one hardware processor to implement a statistical processing of the PPG signal and to remove a portion of the PPG signal based on determining the portion to be noisy data by comparing a result of the statistical processing to at least one predetermined threshold;
determination code configured to cause the at least one hardware processor to determine a peripheral oxygen saturation (SpO2) value based on the PPG signal, after the portion is removed from the PPG signal, with respect to a blood flow at the portion of skin; and
display code configured to cause the at least one hardware processor to control a display of the mobile phone to display the SpO2 value.

### Claim 2 (depends on 1)

The apparatus according to claim 1,
wherein the computer program code further comprises social media app code configured to cause the at least one hardware processor to request a miniprogram from an external server,
wherein the miniprogram comprises the video capture code, the extraction code, the determination code, and the display code.

### Claim 3 (depends on 2)

The apparatus according to claim 2, wherein computer program code further comprises scanning code configured to cause the at least one hardware process to control the camera to scan a code and to implement, in response to scanning the code, the social media app code configured to cause the at least one hardware processor to request the miniprogram from an external server.

### Claim 4 (depends on 2)

The apparatus according to claim 2, wherein the miniprogram comprises a model-view-viewmodel (MVVM).

### Claim 5 (depends on 1)

The apparatus according to claim 1, wherein the statistical processing of the PPG signal further comprises altering, other than removing the portion, the PPG signal based on the result of the statistical processing.

### Claim 6 (depends on 1)

The apparatus according to claim 1, wherein the statistical processing comprises determining a number of at least one of peaks and valleys of the PPG signal within a predetermined time among a plurality of frames of the video.

### Claim 7 (depends on 1)

The apparatus according to claim 1, wherein the statistical processing comprises determining a variance of at least one of a peak and a valley of the PPG signal among a plurality of peaks and valleys of the PPG signal within a predetermined time among the plurality of frames of the video.

### Claim 8 (depends on 1)

The apparatus according to claim 1, wherein the statistical processing comprises implementing a moving average along the PPG signal.

### Claim 9 (depends on 1)

The apparatus according to claim 1, wherein the PPG signal indicates amounts of red light captured by the video.

### Claim 10 (depends on 1)

The apparatus according to claim 1, wherein the portion of the skin is located at a finger of a user of the mobile phone.

### Claim 11

A method performed by at least one computer processor comprising:
controlling a camera of a mobile phone to capture a video of at least a portion of skin;
extracting at least one photoplethysmogram (PPG) signal from the video;
statistically processing the PPG signal and removing a portion of the PPG signal based on determining the portion to be noisy data by comparing a result of the statistical processing to at least one predetermined threshold; determining a peripheral oxygen saturation (SpO2) value based on the PPG signal, after the portion is removed from the PPG signal, with respect to a blood flow at the portion of skin; and
controlling a display of the mobile phone to display the SpO2 value.

### Claim 12 (depends on 11)

The method according to claim 11, further comprising requesting a miniprogram from an external server.

### Claim 13 (depends on 11)

The method according to claim 11, further comprising:
controlling the camera to scan a code; and
to request, in response to scanning the code, the miniprogram from an external server.

### Claim 14 (depends on 12)

The method according to claim 12, wherein the miniprogram comprises a model-view-viewmodel (MVVM).

### Claim 15 (depends on 11)

The method according to claim 11,
wherein the statistical processing of the PPG signal further comprises altering, other than removing the portion, the PPG signal based on the result of the statistical processing.

### Claim 16 (depends on 11)

The method according to claim 11, wherein the statistical processing comprises determining a number of at least one of peaks and valleys of the PPG signal within a predetermined time among a plurality of frames of the video.

### Claim 17 (depends on 11)

The method according to claim 11, wherein the statistical processing comprises determining a variance of at least one of a peak and a valley of the PPG signal among a plurality of peaks and valleys of the PPG signal within a predetermined time among the plurality of frames of the video.

### Claim 18 (depends on 11)

The method according to claim 11, wherein the statistical processing comprises implementing a moving average along the PPG signal.

### Claim 19 (depends on 11)

The method according to claim 11, wherein the PPG signal indicates amounts of red light captured by the video.

### Claim 20

A non-transitory computer readable medium storing a program causing a computer to execute a process, the process comprising:
controlling a camera of a mobile phone to capture a video of at least a portion of skin;
extracting at least one photoplethysmogram (PPG) signal from the video;
statistically processing the PPG signal and removing a portion of the PPG signal based on determining the portion to be noisy data by comparing a result of the statistical processing to at least one predetermined threshold;
determining a peripheral oxygen saturation (SpO2) value based on the PPG signal, after the portion is removed from the PPG signal, with respect to a blood flow at the portion of skin; and
controlling a display of the mobile phone to display the SpO2 value.
