# US 2016/0353970 A1 · Endoscope system and the method of controlling the endoscope

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0353970 A1
- Document ID: US20160353970A1
- Status: Published application
- Kind: A1
- Application number: 15/238,913
- Filed: 2016-08-17
- Published: 2016-12-08
- Earliest claimed: 2014-02-20
- Assignees: Olympus Corporation
- Applicants: Olympus Corporation
- Inventors: Shintaro INOUE
- Web page: https://patentgrep.com/patent/US20160353970A1

## CPC

- A61B 1/00006: {of control signals}
- A61B 1/00009: {of image signals during a use of endoscope}
- A61B 1/00042: {for mechanical operation}
- A61B 1/00045: {Display arrangement}
- A61B 1/00149: {using articulated arms}
- A61B 1/00154: {using guiding arrangements for insertion}
- A61B 1/0016: {using motor drive units}
- A61B 1/00172: {with means for scanning}
- A61B 1/00183: {for variable viewing angles}
- A61B 1/045: Control thereof
- A61B 1/3132: {for laparoscopy}
- A61B 5/065: {Determining position of the probe employing exclusively positioning means located on or in the probe, e.g. using position sensors arranged on the probe}
- A61B 17/00234: {for minimally invasive surgery (A61B17/0218, A61B17/0469, A61B17/12013, A61B17/1285, A61B17/29, A61B17/320016 take precedence)}
- G02B 23/2476: {Non-optical details, e.g. housings, mountings, supports}
- G02B 23/2484: {Arrangements in relation to a camera or imaging device (processing or control of video signals generated by an endoscope H04N23/60, H04N23/70)}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/60: Analysis of geometric attributes
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- A61B 1/0002: {provided with data storages}
- G06T 2207/30004: Biomedical image processing
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An endoscope system computes a distal end position of the endoscope or a position of the desired imaging target. An image taken of the desired imaging target is recorded. A position of the desired imaging target is computed and recorded. A current image taken by the imaging unit is compared with the image of the desired imaging target already recorded. A first driving amount for driving the field-of-view adjustment mechanism is computed such that the desired imaging target is positioned on an axis of sighting of the imaging unit. A second driving amount for driving the field-of-view adjustment mechanism is computed in such a way as to include a center of the image of the desired imaging target. The field-of-view adjustment mechanism is driven from either one of the first driving amount or the second driving amount.

## Claims

### Claim 1

An endoscope system comprising:
an endoscope including an imaging unit that is capable of taking an image of a imaging target, a field-of-view adjustment mechanism for varying an orientation of the imaging unit and a driver unit for driving the field-of-view adjustment mechanism;
an endoscopic position sensor for detecting a position of the endoscope in the body cavity,
a distance measurement unit for measuring a distance from a distal end of the endoscope to the imaging target;
a position computation unit for computing positions of the distal end of the endoscope and the imaging target on the basis of information from the endoscopic position sensor and the distance measurement unit;
a position storage unit for storing a position of the imaging target computed by the position computation unit;
a first driving-amount computation unit for computing a driving amount for the field-of-view adjustment mechanism using the position stored in the position storage unit and the position of the distal end of the endoscope;
an image storage unit for storing the image of the imaging target taken by the imaging unit;
a comparison unit for comparing the image of the imaging target stored in the image storage unit with a newly taken image of the imaging target;
a second driving-amount computation unit for computing a driving amount for the field-of-view adjustment mechanism depending on a result of comparison by the comparison unit;
and
a determination unit for determining which is used, a first driving amount computed by the first driving-amount computation unit or a second driving amount computed by the second driving-amount computation unit, to drive the driver unit.

### Claim 2 (depends on 1)

An endoscope system according to claim 1,
wherein the comparison unit includes a similarity computation unit for computing a degree of similarity between the image of the imaging target stored in the image storage unit and the newly taken image of the imaging target,
and
the determination unit makes a determination depending on the degree of similarity computed by the similarity computation unit.

### Claim 3 (depends on 2)

An endoscope system according to claim 2,
wherein after the degree of similarity computed by the similarity computation unit is determined as being higher than a predetermined value, the image of the imaging target stored in the image storage unit is erased and rewritten as the newly taken image of the imaging target, which is then again stored.

### Claim 4 (depends on 2)

An endoscope system according to claim 2,
wherein when a change with time in the degree of similarity is less than a predetermined value after the degree of similarity computed by the similarity computation unit is determined as being lower than the predetermined value, the image of the imaging target stored in the image storage unit is erased and rewritten as the newly taken image of the imaging target, which is then again stored.

### Claim 5 (depends on 1)

An endoscope system according to claim 1, further comprising
a feature point extraction unit for extracting feature points in the image of the imaging target stored in the image storage unit or the newly taken image of the imaging target,
wherein when an amount of feature points extracted by the feature point extraction unit is less than a predetermined amount, the driver unit is driven according to the first driving amount.

### Claim 6 (depends on 1)

An endoscope system according to claim 1, further comprising
an endoscopic trocar through which the endoscope is inserted into the body cavity,
wherein the endoscopic position sensor includes an endoscopic trocar sensor attached to the endoscopic trocar for measuring a distal end position of the imaging unit, and a distance sensor attached to the imaging unit for measuring a distance to the imaging target.

### Claim 7 (depends on 1)

An endoscopic system according to claim 1, further comprising
a display unit for displaying which is determined by the determination unit, the first driving amount or the second driving amount.

### Claim 8 (depends on 1)

An endoscopic system according to claim 1, further comprising:
a correction unit for correcting an input signal from the endoscopic position sensor
and
a correction parameter update unit for comparing values computed by the first driving-amount computation unit and the second driving-amount computation unit to acquire an detection error for the endoscopic position sensor thereby updating a correction parameter of the correction unit.

### Claim 9 (depends on 1)

An endoscope system according to claim 1, further comprising:
a treatment tool for applying treatments to the body cavity;
a treatment tool trocar through which the treatment tool is inserted;
and
a treatment tool position sensor attached to the treatment tool trocar for measuring a distal end position of the treatment tool,
wherein:
the field-of-view adjustment mechanism is driven according to a driving amount computed by the first or the second driving-amount computation unit from measurements of the endoscopic position sensor and the treatment tool position sensor to allow the treatment tool to track the endoscope.

### Claim 10

A method of controlling the endoscope including an imaging unit and a field-of-view adjustment mechanism for varying an orientation of the imaging unit, the method comprising the step of:
computing a distal end position of the endoscope or a position of the desired imaging target;
recording an image taken of the desired imaging target;
computing and recording a position of the desired imaging target;
comparing a current image taken by the imaging unit with the image of the desired imaging target already recorded;
computing a first driving amount for driving the field-of-view adjustment mechanism such that the desired imaging target is positioned on an axis of sighting of the imaging unit;
computing a second driving amount for driving the field-of-view adjustment mechanism in such a way as to include a center of the image of the desired imaging target; and
driving the field-of-view adjustment mechanism from either one of the first driving amount or the second driving amount.

### Claim 11 (depends on 10)

The method of controlling the endoscope according to claim 10,
wherein
the first driving amount is computed at a time when the degree of similarity between the current image and the recorded image is determined as being low,
and
the second driving amount is computed at a time when the degree of similarity between the current image and the recorded image is determined as being high.

### Claim 12 (depends on 10)

The method of controlling the endoscope according to claim 10, further comprising the step of:
rewriting the recorded image as a current image being taken by the imaging unit at a time when the degree of similarity between the current image and the recorded image is determined as being high.

### Claim 13 (depends on 10)

The method of controlling the endoscope according to claim 10,
wherein the first driving amount is computed at a time when the degree of similarity between the current image and the recorded image is determined as being low and an amount of change-with-time in the degree of similarity is greater than a given value.

### Claim 14 (depends on 13)

The method of controlling the endoscope according to claim 13, further comprising the step of
rewriting the recorded image as a current image being taken by the imaging unit at a time when the degree of similarity between the current image and the recorded image is determined as being low and an amount of change-with-time in the degree of similarity is less than a given value.

### Claim 15 (depends on 10)

The method of controlling the endoscope according to claim 10, further comprising the step of
extracting feature points in a current image being taken by the imaging unit,
wherein
when an amount of feature points is less than a given amount, the driving amount is computed,
and
when an amount of feature points is greater than a given amount, the current image and the recorded image are compared.
