# US 12,213,641 B2 · Image processing apparatus and image processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,213,641 B2
- Document ID: US12213641B2
- Status: Granted
- Kind: B2
- Application number: 17/200,914
- Filed: 2021-03-15
- Published: 2021-07-01
- Granted: 2025-02-04
- Earliest claimed: 2018-09-21
- Assignees: FUJIFILM Corporation
- Applicants: FUJIFILM Corporation
- Inventors: Toshihiro Usuda
- Web page: https://patentgrep.com/patent/US12213641B2

## CPC

- A61B 1/00006: {of control signals}
- A61B 1/000094: {extracting biological structures}
- A61B 1/000095: {for image enhancement}
- A61B 1/00045: {Display arrangement}
- A61B 1/0005: {combining images e.g. side-by-side, superimposed or tiled}
- A61B 1/045: Control thereof
- A61B 1/0655: {Control therefor}
- G06T 7/00: Image analysis
- G06T 11/60: Creating or editing images; Combining images with text
- G06V 10/143: Sensing or illuminating at different wavelengths
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/454: {Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]}
- G06V 10/764: using classification, e.g. of video objects
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- A61B 1/05: characterised by the image sensor, e.g. camera, being in the distal end portion
- A61B 1/0638: {providing two or more wavelengths}
- A61B 1/07: using light-conductive means, e.g. optical fibres
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present invention is directed to providing an image processing apparatus and an image processing method that assist an observer of a time-series image in performing smooth observation while attracting attention of the observer. An image processing apparatus according to a first aspect of the present invention includes an image input unit that inputs a time-series image; an information acquiring unit that acquires information on a region of interest in the time-series image; a figure calculating unit that calculates a polygon or an ellipse surrounding the region of interest and having an area smaller than or equal to an area of a circumscribed rectangle, the circumscribed rectangle being a rectangle circumscribing the region of interest and formed of two sides parallel to a horizontal axis of the time-series image and other two sides parallel to a vertical axis of the time-series image; and a display control unit that causes a display apparatus to display a figure such that the figure is superimposed on the time-series image, the figure being based on the polygon or the ellipse and being disposed at sides or vertexes of the polygon or disposed on a circumference of the ellipse or at a plurality of positions on the circumference.

## Claims

### Claim 1

An image processing apparatus comprising one or more processors configured to:
acquire a plurality of images captured in time-series;
acquire information on a region of interest in each image;
generate a circumscribed rectangle, the circumscribed rectangle being a rectangle circumscribing the region of interest and formed of two sides parallel to a horizontal axis of each image and other two sides parallel to a vertical axis of each image;
calculate a polygon or an ellipse surrounding the region of interest and having an area smaller than or equal to an area of the circumscribed rectangle; and
cause a display apparatus to display a figure such that the figure surrounds the region of interest, the figure being based on the polygon or the ellipse and being disposed at sides or vertexes of the polygon or disposed on a circumference of the ellipse or at a plurality of positions on the circumference.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein the one or more processors configured to cause the display apparatus to display, as the figure, a figure disposed at the vertexes of the polygon and having a shape that varies according to interior angles of the vertexes.

### Claim 3 (depends on 1)

The image processing apparatus according to claim 1, wherein one or more processors configured to cause the display apparatus to display, as the figure, a figure disposed at the vertexes of the polygon and having a size and/or a shape that is independent of interior angles of the vertexes.

### Claim 4 (depends on 1)

The image processing apparatus according to claim 1, wherein one or more processors configured to cause_the display apparatus to display, as the figure, a figure formed of the sides of the polygon or a part of the sides, or a figure formed of the circumference of the ellipse or a part of the circumference.

### Claim 5 (depends on 1)

The image processing apparatus according to claim 1, wherein the one or more processors configured to set, to the region of interest, a first axis and a second axis intersecting the first axis, and calculate, as the polygon, a quadrangle formed of two sides parallel to the first axis and two sides parallel to the second axis.

### Claim 6 (depends on 5)

The image processing apparatus according to claim 5, wherein the one or more processors configured to perform ellipse approximation on the region of interest and calculate a major axis and a minor axis of the ellipse, to calculate the polygon or the ellipse.

### Claim 7 (depends on 5)

The image processing apparatus according to claim 5, wherein the one or more processors configured to calculate a rectangle as the quadrangle.

### Claim 8 (depends on 1)

The image processing apparatus according to claim 1, wherein the one or more processors configured to acquire, as the plurality of images captured in time-series, an image of a subject acquired by an endoscope apparatus.

### Claim 9 (depends on 1)

The image processing apparatus according to claim 1, wherein the one or more processors configured to analyze each image to acquire the information on the region of interest.

### Claim 10 (depends on 1)

The image processing apparatus according to claim 1, wherein the one or more processors further configured to set, based on an instruction input by a user, the polygon or the ellipse to be calculated and/or the figure to be displayed.

### Claim 11

An image processing method comprising:
an image input step of inputting a plurality of images captured in time-series;
an information acquisition step of acquiring information on a region of interest in each image;
a generation step of generating a circumscribed rectangle, the circumscribed rectangle being a rectangle circumscribing the region of interest and formed of two sides parallel to a horizontal axis of each image and other two sides parallel to a vertical axis of each image;
a figure calculation step of calculating a polygon or an ellipse surrounding the region of interest and having an area smaller than or equal to an area of the circumscribed rectangle; and
a display control step of causing a display apparatus to display a figure such that the figure surrounds the region of interest, the figure being based on the polygon or the ellipse and being disposed at sides or vertexes of the polygon or disposed on a circumference of the ellipse or at a plurality of positions on the circumference.