# US 11,077,017 B2 · Cameras for emergency rescue

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,077,017 B2
- Document ID: US11077017B2
- Status: Granted
- Kind: B2
- Application number: 16/856,590
- Filed: 2020-04-23
- Published: 2020-08-06
- Granted: 2021-08-03
- Earliest claimed: 2012-05-17
- Assignees: ZOLL Medical Corporation
- Applicants: ZOLL Medical Corporation
- Inventors: Gary A. Freeman
- Web page: https://patentgrep.com/patent/US11077017B2

## CPC

- A61H 31/005: {with feedback for the user}
- A61N 1/3993: {User interfaces for automatic external defibrillators}
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/50: Depth or shape recovery
- G06T 15/205: {Image-based rendering}
- G06V 40/161: {Detection; Localisation; Normalisation}
- G09B 23/288: {for artificial respiration or heart massage}
- H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T 2207/10052: Images from lightfield camera
- G06T 2207/30196: Human being; Person
- A61H: PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY (electrotherapy, magnetotherapy, radiation therapy or ultrasound therapy A61N)
- A61N: ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY (measurement of bioelectric currents A61B; surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body A61B18/00; anaesthetic apparatus in general A61M; incandescent lamps H01K; infrared radiators for heating H05B)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system for managing treatment of a person in need of emergency assistance is provided. The system includes at least one camera configured to be mounted to a person in need of medical assistance. The system also includes an image processing device, which can be configured to receive images captured by the at least one camera and to process the images to generate a representation of a rescue scene surrounding the person. The system further includes an analysis device. The analysis device can be configured to determine a characteristic associated with a resuscitation activity based on analysis of the representation of the rescue scene generated by the image processing device. A computer-implemented method for managing treatment of a person in need of emergency assistance is also provided.

## Claims

### Claim 1

A medical system for assisting resuscitation treatment of a patient in need of emergency assistance, the system comprising:
at least one camera configured to obtain images of at least one rescuer administering chest compressions to the patient;
a feedback device for providing guidance for the at least one rescuer to improve performance in administering chest compressions; and
at least one processor in communication with the at least one camera and the feedback device, the at least one processor configured to:
receive, from the at least one camera, the obtained images of the at least one rescuer,
analyze the received images to track motion of the at least one rescuer while administering chest compressions,
determine at least one chest compression parameter based on the tracked motion of the at least one rescuer,
compare the determined at least one chest compression parameter to a desired target for the at least one chest compression parameter, and
provide feedback information, via the feedback device, for the at least one rescuer to improve overall quality of chest compression performance.

### Claim 2 (depends on 1)

The system of claim 1, wherein the feedback information is based, at least in part, on the comparison of the determined at least one chest compression parameter and the desired target for the at least one chest compression parameter.

### Claim 3 (depends on 1)

The system of claim 1, wherein the at least one processor is configured to track motion of the at least one rescuer while administering chest compressions based on one or more of shape, color, size, or location of at least one object identified in the received images.

### Claim 4 (depends on 1)

The system of claim 1, wherein the at least one processor is configured to analyze the received images to track motion of a hand of the at least one rescuer while the at least one rescuer is administering the chest compressions.

### Claim 5 (depends on 1)

The system of claim 1, wherein the at least one processor is configured to track motion of the at least one rescuer during administration of the chest compressions by tracking motion of at least one object positioned on the patient's chest during the administration of the chest compressions.

### Claim 6 (depends on 5)

The system of claim 5, wherein the at least one object positioned on the patient's chest comprises a chest compression sensor device, a chest compression puck, an electrode assembly comprising defibrillation electrodes, or defibrillator pads.

### Claim 7 (depends on 1)

The system of claim 1, wherein the at least one chest compression parameter determined based on the tracked motion comprises chest compression depth.

### Claim 8 (depends on 7)

The system of claim 7, wherein the desired target for the chest compression depth is approximately 2.0 inches.

### Claim 9 (depends on 7)

The system of claim 7, wherein the at least one processor is further configured to analyze the received images to determine whether the at least one rescuer releases the patient's chest between chest compressions.

### Claim 10 (depends on 1)

The system of claim 1, wherein the at least one chest compression parameter determined based on the tracked motion comprises chest compression rate.

### Claim 11 (depends on 10)

The system of claim 10, wherein the desired target for chest compression rate is at least 100 compressions per minute.

### Claim 12 (depends on 1)

The system of claim 1, wherein the at least one processor is further configured to analyze the received images to determine a size of the patient's chest.

### Claim 13 (depends on 12)

The system of claim 12, wherein the at least one processor is further configured to adjust the desired target for the at least one chest compression parameter based on the determined size of the patient's chest.

### Claim 14 (depends on 1)

The system of claim 1, wherein the at least one processor is further configured to analyze the received images by combining the received images to generate a visual representation of a rescue scene.

### Claim 15 (depends on 14)

The system of claim 14, wherein the at least one camera comprises a light field camera configured to capture images that permit post-capture identification of a focus distance, and wherein the at least one processor is further configured to apply a focus distance to the generated visual representation of the rescue scene, such that the generated visual representation focuses on portions of the at least one rescuer administering the chest compressions.

### Claim 16 (depends on 14)

The system of claim 14, wherein the at least one processor is further configured to remove information sufficient to identify the patient and/or the at least one rescuer from the generated visual representation.

### Claim 17 (depends on 16)

The system of claim 16, wherein the at least one processor is configured to remove the information sufficient to identify the patient and/or the at least one rescuer by: analyzing the visual representation to detect a face of the patient and/or the at least one rescuer in the visual representation; and at least one of blurring facial features associated with the detected face, removing facial features associated with the detected face, or replacing a portion of the detected face with an anonymous representation of the patient or the at least one rescuer.

### Claim 18 (depends on 1)

The system of claim 1, wherein the at least one camera is mounted on and/or worn by the at least one rescuer.

### Claim 19 (depends on 1)

The system of claim 1, wherein the at least one camera is mounted on the patient.

### Claim 20 (depends on 1)

The system of claim 1, comprising a tablet computer or mobile computing device comprising the feedback device and the at least one processor.

### Claim 21 (depends on 1)

The system of claim 1, wherein the feedback information provided via the feedback device comprises at least one of instructions to adjust a rate of the chest compressions, instructions to adjust a depth of the chest compressions, and instructions to release the chest between the chest compressions.

### Claim 22 (depends on 1)

The system of claim 1, wherein the feedback information provided via the feedback device comprises information for chest compressions administered by the at least one rescuer provided after completion of treatment of the patient.

### Claim 23 (depends on 1)

The system of claim 1, wherein the feedback information provided via the feedback device comprises a visual indicator comprising a shape, and wherein an amount of fill of the shape represents the overall quality of the chest compressions.

### Claim 24 (depends on 23)

The system of claim 23, wherein the chest compression parameter comprises chest compression depth and chest compression rate, and wherein the shape of the visual indicator is filled when compression depth and the compression rate substantially match the desired targets for depth and rate.

### Claim 25 (depends on 1)

The system of claim 1, wherein the feedback information provided via the feedback device comprises an instruction to the at least one rescuer to switch positions with another rescuer, so that the other rescuer can administer chest compressions to the patient.

### Claim 26 (depends on 25)

The system of claim 25, wherein the at least one processor is configured to provide the instruction to switch positions when the at least one chest compression parameter for chest compressions administered by the at least one rescuer does not substantially match the desired target.

### Claim 27 (depends on 25)

The system of claim 25, wherein the instruction to switch positions comprises an instruction to perform a resuscitation activity other than chest compressions for the patient.
