# US 2020/0005945 A1 · 3d web-based annotation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0005945 A1
- Document ID: US20200005945A1
- Status: Published application
- Kind: A1
- Application number: 16/567,553
- Filed: 2019-09-11
- Published: 2020-01-02
- Earliest claimed: 2017-11-08
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Shafiqul Abedin; Hakan Bulu
- Web page: https://patentgrep.com/patent/US20200005945A1

## CPC

- G16H 50/50: for simulation or modelling of medical disorders
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 30/40: for processing medical images, e.g. editing
- G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
- G06T 2210/41: Medical
- G06T 2219/008: Cut plane or projection plane definition
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Web-based annotation of three dimensional medical imagery is provided. In various embodiments, a plurality of two dimensional medical images is read from a data store. The plurality of two dimensional images is a subset of a three dimensional medical imaging study. The plurality of two dimensional medical images is provided to a remote user. Regional annotations for each of the plurality of medical images are received from the remote user. A volumetric description of the three dimensional imaging study is generated by interpolation of the regional annotations. The volumetric description of the three dimensional imaging is provided for rendering and display to the remote user.

## Claims

### Claim 1

A method comprising:
reading a three dimensional medical imaging study from a data store, the three dimensional medical imaging study comprising a first plurality of two dimensional medical images;
selecting a second plurality of two dimensional medical images from the first plurality of two dimensional medical images;
providing the second plurality of two dimensional medical images to a remote user;
receiving from the remote user regional annotations for each of the second plurality of medical images;
generating a volumetric description of the three dimensional imaging study by interpolation of the regional annotations;
providing the volumetric description of the three dimensional imaging for rendering and display to the remote user, wherein
said selecting of the second plurality of images minimizes an estimated error rate of the interpolation, and
the estimated error rate is based on differences in intensity between a plurality of pairs of two dimensional images of the first plurality of two dimensional images.

### Claim 2 (depends on 1)

The method of claim 1, wherein the data store comprises a PACS.

### Claim 3 (depends on 1)

The method of claim 1, wherein selecting the second plurality of two dimensional medical images comprises applying k-means clustering to the first plurality of two dimensional medical images.

### Claim 4 (depends on 3)

The method of claim 3, wherein applying k-means clustering comprises clustering the first plurality of two dimensional medical images based on a minimization of the error rate.

### Claim 5 (depends on 3)

The method of claim 3, wherein applying k-means clustering comprises iteratively initializing centers of a plurality of clusters of the first plurality of two dimensional medical images and selecting a clustering having a minimum error rate.

### Claim 6 (depends on 1)

The method of claim 1, wherein the second plurality of two dimensional medical images corresponds to centers of clusters obtained by applying k-means clustering to the first plurality of two dimensional medical images.

### Claim 7 (depends on 1)

The method of claim 1, wherein the estimated error rate corresponds to a matching between manually segmented images and warped manually segmented images.

### Claim 8 (depends on 1)

The method of claim 1, wherein the error rate is based on a predetermined region of the first plurality of two dimensional images.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
providing a web application to the remote user, the web application being adapted to receive input of the regional annotations from the remote user.

### Claim 10 (depends on 1)

The method of claim 1, wherein the second plurality of two dimensional medical images is provided to the remote user via the internet.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
providing a web application to the remote user, the web application being adapted to render the volumetric description and display the rendering to the remote user.

### Claim 12

A system comprising:
a data store;
a computing node comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor of the computing node to cause the processor to perform a method comprising:
reading a three dimensional medical imaging study from the data store, the three dimensional medical imaging study comprising a first plurality of two dimensional medical images;
selecting a second plurality of two dimensional medical images from the first plurality of two dimensional medical images providing the second plurality of two dimensional medical images to a remote user;
receiving from the remote user regional annotations for each of the second plurality of medical images;
generating a volumetric description of the three dimensional imaging study by interpolation of the regional annotations;
providing the volumetric description of the three dimensional imaging for rendering and display to the remote user, wherein
said selecting of the second plurality of images minimizes an estimated error rate of the interpolation, and
the estimated error rate is based on differences in intensity between a plurality of pairs of two dimensional images of the first plurality of two dimensional images.

### Claim 13 (depends on 12)

The system of claim 12, wherein selecting the second plurality of two dimensional medical images comprises applying k-means clustering to the first plurality of two dimensional medical images.

### Claim 14 (depends on 13)

The system of claim 13, wherein applying k-means clustering comprises clustering the first plurality of two dimensional medical images based on a minimization of the error rate.

### Claim 15 (depends on 13)

The system of claim 13, wherein applying k-means clustering comprises iteratively initializing centers of a plurality of clusters of the first plurality of two dimensional medical images and selecting a clustering having a minimum error rate.

### Claim 16 (depends on 12)

The system of claim 12, wherein the second plurality of two dimensional medical images corresponds to centers of clusters obtained by applying k-means clustering to the first plurality of two dimensional medical images.

### Claim 17 (depends on 12)

The system of claim 12, wherein the estimated error rate corresponds to a matching between manually segmented images and warped manually segmented images.

### Claim 18 (depends on 12)

The system of claim 12, wherein the error rate is based on a predetermined region of the first plurality of two dimensional images.

### Claim 19

A computer program product for medical imagery annotation, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method comprising:
reading a three dimensional medical imaging study from a data store, the three dimensional medical imaging study comprising a first plurality of two dimensional medical images;
selecting a second plurality of two dimensional medical images from the first plurality of two dimensional medical images;
providing the second plurality of two dimensional medical images to a remote user;
receiving from the remote user regional annotations for each of the second plurality of medical images;
generating a volumetric description of the three dimensional imaging study by interpolation of the regional annotations;
providing the volumetric description of the three dimensional imaging for rendering and display to the remote user, wherein
said selecting of the second plurality of images minimizes an estimated error rate of the interpolation, and
the estimated error rate is based on differences in intensity between a plurality of pairs of two dimensional images of the first plurality of two dimensional images.

### Claim 20 (depends on 19)

The computer program product of claim 19, wherein selecting the second plurality of two dimensional medical images comprises applying k-means clustering to the first plurality of two dimensional medical images.
