# US 2022/0031394 A1 · Method and System for Providing Real Time Surgical Site Measurements

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0031394 A1
- Document ID: US20220031394A1
- Status: Published application
- Kind: A1
- Application number: 17/035,534
- Filed: 2020-09-28
- Published: 2022-02-03
- Earliest claimed: 2019-09-27
- Assignees: Asensus Surgical US, Inc.
- Applicants: Asensus Surgical US, Inc.
- Inventors: Kevin Andrew Hufford; Tal Nir; Mohan Nathan
- Web page: https://patentgrep.com/patent/US20220031394A1

## CPC

- A61B 34/10: Computer-aided planning, simulation or modelling of surgical operations
- G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
- A61B 5/0084: {for introduction into the body, e.g. by catheters (A61B5/1459 takes precedence)}
- A61B 34/25: {User interfaces for surgical systems}
- A61B 90/361: {Image-producing devices, e.g. surgical cameras}
- A61B 90/37: {Surgical systems with images on a monitor during operation}
- A61F 2/0063: {Implantable repair or support meshes, e.g. hernia meshes}
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/12: Edge-based segmentation
- G06T 7/50: Depth or shape recovery
- G06T 7/62: of area, perimeter, diameter or volume
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- A61B 2017/00216: {with eye tracking or head position tracking control}
- A61B 2034/108: {Computer aided selection or customisation of medical implants or cutting guides}
- A61B 2034/2065: {Tracking using image or pattern recognition}
- A61B 2090/364: {Correlation of different images or relation of image positions in respect to the body}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10021: Stereoscopic video; Stereoscopic image sequence
- G06T 2207/10024: Color image
- G06T 2207/10068: Endoscopic image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/20104: Interactive definition of region of interest [ROI]
- G06T 2207/20116: Active contour; Active surface; Snakes
- G06T 2207/30052: Implant; Prosthesis
- G06T 2207/30096: Tumor; Lesion
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61F: FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS (dental prosthetics A61C)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A system and method for measuring an area of interest such as a hernia defect within a body cavity, in which real time image data is captured at a treatment site that includes the area of interest. Computer vision is applied to identify the extents of the area of interest within images captured using the camera, and dimensions of the area of interest are measured using the image data. The user is given output, which may include recommendations of hernia mesh shape/size and or positioning, based on the measured dimensions.

## Claims

### Claim 1

A system for aiding selection of a hernia mesh for treating a hernia defect, comprising:
a camera positionable to capture image data corresponding to a treatment site that includes a hernia defect;
at least one processor and at least one memory, the at least one memory storing instructions executable by said at least one processor to:
identify at least a portion of the hernia defect within images captured using the camera;
measure a dimension relating to the hernia defect based on the image data; and
provide output to a user based on the measured dimension.

### Claim 2 (depends on 1)

The system of claim 1, wherein the instructions are further executable by said at least one processor to determine dimensions of a recommended mesh implant for covering the defect, and wherein the output includes signals to generate a display of the dimensions on an image display.

### Claim 3 (depends on 2)

The system of claim 2, wherein the output includes text describing measured dimension.

### Claim 4 (depends on 2)

The system of claim 2, wherein the output includes a display of an overlay indicating the boundaries of the determined dimensions overlaying the hernia defect on the display.

### Claim 5 (depends on 4)

The system of claim 4, wherein the instructions are further executable by said at least one processor to determine variations in topography of tissue at the treatment site, and to display the overlay to conform to the variations in topography.

### Claim 6 (depends on 5)

The system of claim 5, wherein the instructions are further executable by said at least one processor to display the overlay to maintain tension across depth disparities exceeding a predetermined change in depth.

### Claim 7 (depends on 1)

The system of claim 1, further including a user input, wherein the instructions are further executable by said at least one processor to move or rotate the position of the overlay relative to the displayed image in response to input from the user input.

### Claim 8 (depends on 1)

The system of claim 1, wherein the instructions are executable by said at least one processor to:
display a plurality of overlays on an image display, each representing a different mesh implant of a predetermined size and shape;
in response to user input, positioning a select one of the overlays over the hernia defect displayed on the image display;
determine variations in topography of tissue at the treatment site, and to display the select one of the overlays to conform to the variations in topography.

### Claim 9

A method for aiding selection of a hernia mesh for treating a hernia defect, comprising the steps of:
capturing image data corresponding to a treatment site that includes a hernia defect;
using computer vision to identify at least a portion of the hernia defect within images captured using the camera;
measuring a dimension relating to the hernia defect based on the image data; and
providing output to a user based on the measured dimension.

### Claim 10 (depends on 9)

The method of claim 9, further including determining dimensions of a recommended mesh implant for covering the defect, and wherein the output includes signals to generate a display of the dimensions on an image display.

### Claim 11 (depends on 10)

The method of claim 10, wherein the determining steps includes determining dimensions that will cover the defect with a predetermined margin width.

### Claim 12 (depends on 11)

The method of claim 11, wherein the method includes receiving user input selecting the predetermined margin width.

### Claim 13 (depends on 10)

The method of claim 10 wherein the output includes a display of an overlay indicating the boundaries of the determined dimensions overlaying the hernia defect on the display.

### Claim 14 (depends on 10)

The method of claim 10, further including using the image data to determine variations in topography of tissue at the treatment site, and to display the overlay to conform to the variations in topography.

### Claim 15 (depends on 14)

The method of claim 14, further including displaying the overlay to maintain tension across depth disparities exceeding a predetermined change in depth.

### Claim 16 (depends on 1)

The method of claim 1, further including changing the position or orientation of the overlay relative to the displayed image in response to user input.

### Claim 17 (depends on 1)

The method of claim 1, further including:
displaying a plurality of overlays on an image display, each representing a different mesh implant of a predetermined size and shape;
in response to user input, positioning a select one of the overlays over the hernia defect displayed on the image display;
determining variations in topography of tissue at the treatment site using the image data, and
displaying the select one of the overlays to conform to the variations in topography.

### Claim 18

A method of measuring an area of interest within a body cavity, comprising the steps of:
capturing image data corresponding to a treatment site that includes the area of interest;
using computer vision to identify the extents of the area of interest within images captured using the camera;
measuring a dimension relating to the area of interest based on the image data; and
providing output to a user based on the measured dimension.

### Claim 19 (depends on 18)

The method of claim 18, further including:
receiving user input defining a boundary encircling the area of interest as displayed on the image display; and
applying computer vision within the encircled area to identify the extends of the area of interest within the images.

### Claim 20 (depends on 18)

The method of claim 18, wherein the measured dimension is at least one of length, width, depth, or area.
