# US 12,108,931 B2 · Medical device imaging systems and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,108,931 B2
- Document ID: US12108931B2
- Status: Granted
- Kind: B2
- Application number: 17/476,744
- Filed: 2021-09-16
- Published: 2022-04-14
- Granted: 2024-10-08
- Earliest claimed: 2020-10-14
- Assignees: Covidien LP
- Applicants: Covidien LP
- Inventors: Peter Douglas Colin Inglis
- Web page: https://patentgrep.com/patent/US12108931B2

## CPC

- A61B 1/0005: {combining images e.g. side-by-side, superimposed or tiled}
- A61B 1/00006: {of control signals}
- A61B 1/00009: {of image signals during a use of endoscope}
- A61B 1/00016: {using wireless means}
- A61B 1/267: for the respiratory tract, e.g. laryngoscopes or bronchoscopes
- A61B 90/361: {Image-producing devices, e.g. surgical cameras}
- A61B 90/37: {Surgical systems with images on a monitor during operation}
- G06V 10/803: {of input or preprocessed data}
- G06V 20/64: Three-dimensional [3D] objects
- H04N 5/265: Mixing
- H04N 23/51: Housings
- H04N 23/53: of electronic viewfinders, e.g. rotatable or detachable
- A61B 90/96: using barcodes
- A61B 2090/364: {Correlation of different images or relation of image positions in respect to the body}
- A61B 2090/371: {with simultaneous use of two cameras}
- A61B 2090/372: {Details of monitor hardware}
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A time-synchronized video imaging system includes an environmental camera that acquires environmental images of a patient while a video laryngoscope acquires airway images of the patient. A monitor receives the airway images from the video laryngoscope and the environmental images from the environmental camera. The monitor time-synchronizes the airway images and the environmental images to each other to generate a combined view video file of the time-synchronized airway images and environmental images to permit review of macro or environmental effects on a patient intubation.

## Claims

### Claim 1

A video imaging system, comprising:
a monitor comprising a display screen;
a video laryngoscope comprising a camera that acquires airway images of a patient; and
an environmental camera that acquires environmental images of a patient environment;
wherein the monitor operates to:
receive the airway images from the video laryngoscope and the environmental images from the environmental camera;
receive a video laryngoscope clock time from the video laryngoscope;
determine a first difference between the video laryngoscope clock time and a monitor clock time;
synchronize the airway images and the environmental images based on the first difference; and
combine the synchronized airway and environmental images into a combined video file.

### Claim 2 (depends on 1)

The video imaging system of claim 1, wherein the combined video file comprises a side-by-side view of the synchronized airway images and environmental images.

### Claim 3 (depends on 1)

The video imaging system of claim 1, wherein the monitor operates to use the first difference to synchronize the airway images to the monitor clock time.

### Claim 4 (depends on 1)

The video imaging system of claim 1, wherein the monitor operates to receive an environmental camera clock time from the environmental camera and determine a second difference between the environmental camera clock time and the monitor clock time.

### Claim 5 (depends on 4)

The video imaging system of claim 4, wherein the monitor operates to use the second difference to synchronize the environmental images to the monitor clock time.

### Claim 6 (depends on 1)

The video imaging system of claim 1, wherein the environmental camera is housed in or on the monitor.

### Claim 7 (depends on 1)

The video imaging system of claim 1, wherein the monitor comprises a portable tablet.

### Claim 8 (depends on 7)

The video imaging system of claim 7, wherein the environmental camera is coupled to the portable tablet on a side opposite the display screen.

### Claim 9 (depends on 1)

The video imaging system of claim 1, wherein one or both of the monitor or the environmental camera is coupled to a portable stand.

### Claim 10 (depends on 1)

The video imaging system of claim 1, wherein the monitor operates to:
identify the video laryngoscope in the environmental images; and
adjust a field of view of the environmental camera to retain the video laryngoscope in the field of view.

### Claim 11

A medical device system comprising:
a video laryngoscope that acquires airway images of a patient;
an environmental camera that acquires environmental images;
a monitor that operates to:
receive the airway images from the video laryngoscope;
receive the environmental images from the environmental camera;
determine a first time difference between a monitor clock and a video laryngoscope clock, and a second time difference between the monitor clock and an environmental camera clock;
shift the airway images relative to the environmental images based on the first and second differences, to time-synchronize the airway images and the environmental images to each other; and
generate a video file comprising the time-synchronized airway images and environmental images.

### Claim 12 (depends on 11)

The medical device system of claim 11, wherein the environmental camera is mounted to a portable stand.

### Claim 13 (depends on 11)

The medical device system of claim 11, wherein the monitor receives the airway images wirelessly and in real time.

### Claim 14

A method, comprising:
receiving, at a monitor, airway images and laryngoscope clock information from a video laryngoscope;
acquiring, by the monitor, environmental images from a room-facing environmental camera on the monitor, wherein the environmental images are acquired simultaneously with the airway images;
determining a relative time difference between the laryngoscope clock information and a monitor clock information;
time-synchronizing the airway images and the environmental images based on the relative time difference; and
generating a composite video file with a combined view of the time-synchronized airway images and environmental images.

### Claim 15 (depends on 14)

The method of claim 14, wherein the composite video file includes a picture-in-picture or a side-by-side view.

### Claim 16 (depends on 14)

The method of claim 14, wherein the environmental images are time-stamped with monitor clock information.

### Claim 17 (depends on 14)

The method of claim 14, further comprising:
receiving, at the monitor, endoscopic images and endoscope clock information from an endoscope;
determining a second relative time difference between the endoscope clock information and the monitor clock information; and
time-synchronizing the endoscopic images with the environmental images based on the second relative time difference,
wherein the combined view in the composite video file further includes the time- synchronized endoscopic images.

### Claim 18 (depends on 14)

The method of claim 14, further comprising:
receiving patient vital sign data from a patient monitor;
identifying a patient event and an associated time of the patient event in the patient vital sign data; and
overlaying information indicative of the patient event onto the composite video file at the associated time.

### Claim 19 (depends on 14)

The method of claim 14, further comprising displaying the composite video file on a display screen of the monitor.

### Claim 20 (depends on 14)

The method of claim 14, further comprising storing the combined video file with a patient record.
