# US 12,343,219 B2 · Environment capture management techniques

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,343,219 B2
- Document ID: US12343219B2
- Status: Granted
- Kind: B2
- Application number: 17/585,176
- Filed: 2022-01-26
- Published: 2022-07-28
- Granted: 2025-07-01
- Earliest claimed: 2021-01-28
- Assignees: Gyrus ACMI, Inc.
- Applicants: Gyrus Acmi, Inc.
- Inventors: Kurt B. Landfors; Thomas Michael Thornton; Geophrey J. McComis
- Web page: https://patentgrep.com/patent/US12343219B2

## CPC

- A61B 90/37: {Surgical systems with images on a monitor during operation}
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- A61B 90/361: {Image-producing devices, e.g. surgical cameras}
- G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
- G16H 40/67: for remote operation
- H04N 5/77: between a recording apparatus and a television camera
- H04N 7/181: {for receiving images from a plurality of remote sources}
- A61B 2560/0493: controlled by voice
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system can perform image capture during a medical procedure. The system can record video from one or more video sources. The system can store the recorded video in a cached memory as stored video. The system can receive a triggering event, such as receiving a signal, operation of an actuator, or issuance of a voice command. In response to the triggering event, the system can capture a video segment from the stored video. Because the video segment is captured from stored video, the video segment can optionally include video and/or frames that occurred before the triggering event is received.

## Claims

### Claim 1

A system for image capture during an internal medical procedure performed within a body of a patient, the system comprising:
at least one processor; and
memory coupled to the at least one processor, the memory configured to store instructions that, when executed by the at least one processor, cause the at least one processor to execute operations, the operations comprising:
recording video from one or more video sources, the recording occurring during the internal medical procedure performed within the body of the patient;
storing the recorded video in a cached memory as stored video;
performing an analysis of the stored video to detect a specific event, occurring during the internal medical procedure performed within the body of the patient, as a triggering event; and
in response to detecting the triggering event, capturing a video segment from the stored video based on an onset and cessation of the triggering event.

### Claim 2 (depends on 1)

The system of claim 1, wherein the operations further comprise:
prior to receiving the triggering event, buffering one or more segments of the stored video; and
storing a modified video that includes the captured video segment prepended with the one or more buffered segments.

### Claim 3 (depends on 2)

The system of claim 2, wherein the operations further comprise:
continuously recording a cached video stream from the one or more video sources; and
prepending one or more video frames of the cached video stream having a time code occurring prior to the triggering event.

### Claim 4 (depends on 2)

The system of claim 2, wherein the operations further comprise:
storing a video capture window of time of the recorded video, the video capture window of time including at least a portion of the one or more buffered segments.

### Claim 5 (depends on 2)

The system of claim 2, wherein the one or more buffered segments includes a fixed length of the stored video.

### Claim 6 (depends on 2)

The system of claim 2, wherein the one or more buffered segments includes a user-modifiable length of the stored video.

### Claim 7 (depends on 2)

The system of claim 2, wherein the one or more buffered segments has a length that depends on a recognized event of the medical procedure.

### Claim 8 (depends on 1)

The system of claim 1, wherein the specific event is determined based at least in part on information stored in one or more profiles, wherein the analysis of the stored video is performed in real-time to compare the stored video with the information in the one or more profiles, and wherein the triggering event includes an activation by a user, and wherein the internal medical procedure is an endoscopic medical procedure.

### Claim 9 (depends on 8)

The system of claim 8, wherein the triggering event includes at least one of: operation of an actuator, or a voice activation.

### Claim 10 (depends on 1)

The system of claim 1, wherein the operations further comprise:
capturing a plurality of frames of the stored video, the plurality of frames extending over a time window that includes the triggering event, with one or more frames of the plurality of frames occurring before the triggering event and one or more frames of the plurality of frames occurring after the triggering event; and
storing one or more still images from the plurality of frames of the stored video.

### Claim 11 (depends on 10)

The system of claim 10, wherein capturing the plurality of frames includes selecting the time window based on at least one of: a value controlling a number of active content streams from which images are to be captured, a desired temporal distribution of captured images, a temporal spacing between captured frames of video, a number of captured frames before and after a current frame at time of a valid capture and record request, desired spatial characteristics of captured frames, or combinations thereof.

### Claim 12 (depends on 1)

The system of claim 1, wherein the at least one processor is configured to detect the specific medical event based on one or more visual cues in the recorded video, and wherein the one or more visual cues include at least one of smoke, bubbles, a near-lens obstruction, or motion in a field of view of an imaging sensor.

### Claim 13

A system for image capture during an internal medical procedure performed within a body of a patient, the system comprising:
at least one processor; and
memory coupled to the at least one processor, the memory configured to store instructions that, when executed by the at least one processor, cause the at least one processor to execute operations, the operations comprising:
capturing, during the internal medical procedure, video of the internal medical procedure from one or more video sources;
displaying a video stream of the internal medical procedure captured by the one or more video sources in substantially real-time;
storing, concurrently with the displaying, the captured video of the internal medical procedure in a cached memory as stored video;
performing an analysis of the stored video to detect a specific event occurring during the internal medical procedure as a triggering event;
receiving one or more predetermined parameters for capturing a video segment;
in response to detecting the triggering event, capturing the video segment;
prior to receiving the triggering event, buffering one or more segments of the stored video based on the one or more predetermined parameters;
storing a modified video that includes the captured video segment prepended with the one or more buffered video segments based on the one or more predetermined parameters;
capturing a plurality of frames of the stored video based on the one or more predetermined parameters and based on an onset and cessation of the triggering event, the plurality of frames extending over a time window that includes the triggering event, with one or more frames of the plurality of frames occurring before the triggering event and one or more frames of the plurality of frames occurring after the triggering event; and
storing one or more still images from the plurality of frames of the stored video.

### Claim 14 (depends on 13)

The system of claim 13, wherein the operations further comprise:
adjusting, based on real-time assessment of the captured video of the internal medical procedure from the one or more video sources, at least one of the one or more buffered segments or the captured plurality of frames of the stored video.

### Claim 15 (depends on 14)

The system of claim 14, wherein the adjustment is made by a trained learning model and based on one or more of: low frame-to-frame difference, high frame-to-frame difference, an amount of motion, an amount of frame exposure, an amount of image contrast, a type of clinical procedure, or a combination thereof.

### Claim 16 (depends on 13)

The system of claim 13, wherein the operations further comprise:
capturing a plurality of frames of the stored video, the plurality of frames extending over a time window that includes the triggering event, wherein capturing the plurality of frames includes selecting the time window based at least one of: a value controlling a number of active content streams from which images are to be captured, a desired temporal distribution of captured images, a temporal spacing between captured frames of video, a number of captured frames before and after a current frame at time of a valid capture and record request, a desired spatial characteristics of captured frames, or combinations thereof; and
storing one or more still images from the plurality of frames of the stored video.

### Claim 17

A method for image capture during an internal medical procedure performed within a body of a patient, the method comprising:
recording video from one or more video sources, the recording occurring during the internal medical procedure performed within the body of the patient;
storing the recorded video in a cached memory as stored video;
performing an analysis of the stored video to detect a specific event occurring during the internal medical procedure performed within the body of the patient as a triggering event; and
in response to detecting the triggering event, capturing a video segment from the stored video based on an onset and cessation of the triggering event.

### Claim 18 (depends on 17)

The method of claim 17, further comprising:
prior to receiving the triggering event, buffering one or more segments of the stored video; and
storing a modified video that includes the captured video segment prepended with the one or more buffered segments.

### Claim 19 (depends on 18)

The method of claim 18, further comprising:
continuously recording a cached video stream from the one or more video sources; and
prepending one or more video frames of the cached video stream having a time code occurring prior to triggering event.

### Claim 20 (depends on 17)

The method of claim 17, further comprising:
capturing a plurality of frames of the stored video, the plurality of frames extending over a time window that includes the triggering event; and
storing one or more still images from the plurality of frames of the stored video.

### Claim 21 (depends on 20)

The method of claim 20, wherein capturing the plurality of frames includes selecting the time window based on at least one of: a value controlling a number of active content streams from which images are to be captured, a desired temporal distribution of captured images, a temporal spacing between captured frames of video, a number of captured frames before and after a current frame at time of a valid capture and record request, a desired spatial characteristics of captured frames, or combinations thereof.
