# US 2022/0284588 A1 · Multi-phase object contour refinement

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284588 A1
- Document ID: US20220284588A1
- Status: Published application
- Kind: A1
- Application number: 17/191,158
- Filed: 2021-03-03
- Published: 2022-09-08
- Earliest claimed: 2021-03-03
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Yi-Qing Wang; Moshe Raboh; Dana Levanony; Giovanni John Jacques Palma
- Web page: https://patentgrep.com/patent/US20220284588A1

## CPC

- G06T 7/11: Region-based segmentation
- G06T 7/149: involving deformable models, e.g. active contour models
- G06T 2207/10081: Computed x-ray tomography [CT]
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/20104: Interactive definition of region of interest [ROI]
- G06T 2207/20116: Active contour; Active surface; Snakes
- G06T 2207/20132: Image cropping
- G06T 2207/30096: Tumor; Lesion
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method and system perform single phase and multi-phase contour refinement of lesions. The method includes receiving a three dimensional input mask; receiving input slices from the medical images including a lesion; cropping the input slices with the input mask; performing lesion contour refinement for the cropped input slices and the input mask to obtain a predicted mask; and storing the predicted mask that includes 3D lesion contour refinement. A multiphase method includes deforming the 3D input mask from the reference phase to a target phase or warping the input slices from the target phase to the reference phase before contour refinement. The warped images generate an output mask in the reference phase coordinate system that is then deformed to the target phase coordinate system for display.

## Claims

### Claim 1

A system for providing lesion contour refinement for medical images, the system comprising:
a display device;
at least one memory for storing medical images; and
an electronic processor configured to:
receive a 3D input mask and input slices;
crop the input slices to remove a sub-portion of the input slices;
perform lesion contour refinement for the cropped input slices and the 3D input mask to obtain a 3D predicted mask; and
store the 3D predicted mask that includes lesion contour refinement to obtain a 3D lesion contour.

### Claim 2 (depends on 1)

The system of claim 1, wherein the electronic processor is configured to determine whether the 3D predicted mask meets a minimal overlap requirement; and only storing the 3D predicted mask when the 3D predicted mask meets the minimal overlap requirement.

### Claim 3 (depends on 1)

The system of claim 1, wherein the input slices are from computer tomography images that include a lesion.

### Claim 4 (depends on 1)

The system of claim 1, wherein the lesion contour refinement is performed by a neural network that is executed by the electronic processor.

### Claim 5 (depends on 4)

The system of claim 4, wherein the electronic processor is configured to determine whether the 3D input mask is too large for the neural network, and the 3D input mask is not processed when the 3D input mask is too large for the neural network.

### Claim 6 (depends on 4)

The system of claim 4, wherein the electronic processor is a node for implementing operations of the neural network.

### Claim 7 (depends on 6)

The system of claim 6, wherein the electronic processor is configured to determine whether the 3D input mask is too large, wherein the 3D input mask is not processed when the 3D input mask is too large.

### Claim 8 (depends on 1)

The system of claim 1, wherein the medical images are single phase medical images.

### Claim 9

A method for providing lesion contour refinement for medical images, the method comprising:
receiving a 3D input mask;
receiving input slices from the medical images including a lesion;
cropping the input slices to remove a sub-portion of the input slices;
performing lesion contour refinement for the cropped input slices and the 3D input mask to obtain a 3D predicted mask; and
storing the 3D predicted mask that includes lesion contour refinement to obtain a 3D lesion contour.

### Claim 10 (depends on 9)

The method of claim 9, including determining whether the 3D predicted mask meets a minimal overlap requirement; and only storing the 3D predicted mask when the 3D predicted mask meets the minimal overlap requirements.

### Claim 11 (depends on 9)

The method of claim 9, wherein the input slices are from computer tomography images that includes a lesion.

### Claim 12 (depends on 9)

The method of claim 9, including determining whether the 3D input mask is too large, wherein the 3D input mask is not processed when the 3D input mask is too large.

### Claim 13 (depends on 9)

The method according to claim 9, wherein cropping of the input image slices reduces the amount of analysis required for a lesion.

### Claim 14 (depends on 9)

The method according to claim 9, wherein the medical images are single phase medical images.

### Claim 15

A non-transitory computer medium including instructions that, when executed as a set of instructions by an electronic processor perform a set of operations comprising:
receiving a 3D input mask;
receiving input slices from medical images including a lesion;
cropping the input slices to remove a sub-portion of the input slices;
performing lesion contour refinement for the cropped input slices and the 3D input mask to obtain a 3D predicted mask; and
storing the 3D predicted mask that includes lesion contour refinement to obtain a 3D lesion contour.

### Claim 16 (depends on 15)

The non-transitory computer medium of claim 15, wherein the instructions executed by the electronic processor determine whether the 3D predicted mask meets a minimal overlap requirement; and only store he 3D predicted mask when the 3D predicted mask meets the minimal overlap requirement.

### Claim 17 (depends on 15)

The non-transitory computer medium of claim 15, wherein the input slices are from computer tomography images that include a lesion.

### Claim 18 (depends on 15)

The non-transitory computer medium of claim 15, wherein the lesion contour refinement is performed by a neural network that is executed by the electronic processor.

### Claim 19 (depends on 18)

The non-transitory computer medium of claim 18, wherein the instructions executed by the electronic processor determine whether the 3D input mask is too large for the neural network, and the 3D input mask is not processed when the 3D input mask is too large for the neural network.

### Claim 20 (depends on 19)

The non-transitory computer medium of claim 19, wherein the instructions executed by the electronic processor determine whether the 3D predicted mask meets a minimal overlap requirement; and only store the 3D predicted mask when the 3D predicted mask meets the minimal overlap requirement.
