# US 12,181,269 B2 · Method of size measurement in mono-vision scope image

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,181,269 B2
- Document ID: US12181269B2
- Status: Granted
- Kind: B2
- Application number: 16/642,921
- Filed: 2018-08-28
- Published: 2021-12-30
- Granted: 2024-12-31
- Earliest claimed: 2017-08-28
- Assignees: The Johns Hopkins University
- Applicants: The Johns Hopkins University
- Inventors: Dan Stoianovici; Brian Matlaga; Sunghwan Lim; Wesley Warren Ludwig
- Web page: https://patentgrep.com/patent/US12181269B2

## CPC

- G01B 11/22: for measuring depth
- A61B 1/00004: {characterised by electronic signal processing}
- A61B 1/307: for the urinary organs, e.g. urethroscopes or cystoscopes
- G01B 11/02: for measuring length, width or thickness (G01B11/08 takes precedence)
- G01B 21/042: {Calibration or calibration artifacts (G01B3/30, G01B9/02072 take precedence)}
- G06T 5/80: Geometric correction
- G06T 7/60: Analysis of geometric attributes
- A61B 5/02156: {Calibration means}
- A61B 5/1079: {using optical or photographic means}
- G06T 2207/10068: Endoscopic image
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An embodiment in accordance with the present invention provides a method for accurate and objective quantification of stone fragment size. The method includes intraoperative measurement of objects during URS. The method analyzes URS procedures for ureteral and renal stones during basket extraction of fragments. An instrument is passed through an instrument channel of the ureteroscope and advanced until it is adjacent to the stone fragment to be measured. The measurement of stone fragment size is based on the known distance of a tip of the instrument in the ureteroscope's visual field.

## Claims

### Claim 1

A method for determining an actual size of an object in an image obtained by a scope comprising:
receiving image data for the image with a processor, wherein the image data is obtained with the scope in real-time;
receiving data related to a distance between an instrument and the object, wherein the instrument is advanceable to the object after the scope is stationary;
determining the distance between the object and the scope from the data related to the distance between the instrument and the object;
determining from the image data and the distance between the object and the scope, using the processor, a calibration coefficient for measuring the actual size of the object in the image;
measuring a perceived size of the object and a depth of the object in the image;
dewarping the image to create dewarped image data and a dewarped image;
calculating the actual size of the object in the dewarped image using the dewarped image data and the calibration coefficient; and
providing and displaying, in real-time, the actual size of the object and feedback regarding manipulation of and/or removal of the object.

### Claim 2 (depends on 1)

The method of claim 1 further comprising:
calibrating the scope with a checkerboard of squares of a known size;
measuring warping of the checkerboard in the scope image; and
applying a reverse transformation to dewarp the scope image.

### Claim 3 (depends on 1)

The method of claim 1 further comprising determining a scale of the object to be measured as inversely related to a depth of the instrument.

### Claim 4 (depends on 1)

The method of claim 1, further comprising measuring the depth of the object based on distance from an instrument.

### Claim 5 (depends on 1)

The method of claim 1 further comprising using a non-transitory computer readable medium programmed for executing steps of the method.

### Claim 6

A system for determining an actual size of an object in an image comprising:
a scope, wherein the scope is configured to transmit image data;
an instrument configured to be advanced to the object, such that a distance between the object and the scope can be determined, and wherein the instrument is advanceable to the object even after the scope is stationary;
a processing device configured with processor executable instructions to perform operation comprising:
receiving data from the scope wherein the data comprises the image;
receiving data related to a distance between the instrument and the object;
determining the distance between the object and the scope from the data related to the distance between the instrument and the object;
determining a calibration coefficient for measuring the actual size of the object in the image from the image data and the distance between the object and the scope;
measuring a perceived size of the object and a depth of the object in the image;
dewarping the image to create dewarped image data and a dewarped image;
calculating the actual size of the object in the dewarped image using the calibration coefficient; and
providing and displaying, in real-time, the actual size of the object and feedback regarding manipulation of and/or removal of the object.

### Claim 7 (depends on 6)

The system of claim 6 further comprising the scope taking the form of a uteroscope.

### Claim 8 (depends on 6)

The system of claim 6 further comprising a checkerboard of squares of a known size for calibrating the uteroscope.

### Claim 9 (depends on 6)

The system of claim 6 wherein the instrument comprises one selected from a group consisting of a wire or a basket.