# US 10,769,467 B2 · Information processing apparatus, information processing system, and computer program product

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,769,467 B2
- Document ID: US10769467B2
- Status: Granted
- Kind: B2
- Application number: 15/894,271
- Filed: 2018-02-12
- Published: 2019-01-24
- Granted: 2020-09-08
- Earliest claimed: 2017-07-20
- Assignees: Kabushiki Kaisha Toshiba
- Applicants: Kabushiki Kaisha Toshiba
- Inventors: Ryusuke Hirai; Yasunori Taguchi; Wataru Watanabe
- Web page: https://patentgrep.com/patent/US10769467B2

## CPC

- A61N 5/1049: {for verifying the position of the patient with respect to the radiation beam}
- A61N 5/1067: {in real time, i.e. during treatment}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06V 10/235: {based on user input or interaction}
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 20/647: {by matching two-dimensional images to three-dimensional objects}
- A61N 2005/1061: {using an x-ray imaging system having a separate imaging source}
- A61N 2005/1074: {Details of the control system, e.g. user interfaces}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06V 10/62: relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
- A61N: ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY (measurement of bioelectric currents A61B; surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body A61B18/00; anaesthetic apparatus in general A61M; incandescent lamps H01K; infrared radiators for heating H05B)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

According to one embodiment, an information processing apparatus includes an input receiver, a template selector, and a tracker. The input receiver receives an input operation of a user. The template selector specifies at least one template out of a plurality of templates that are related to a shape of an object based on the input operation received by the input receiver. The tracker tracks the object in an image including the object by using the at least one template specified by the template selector.

## Claims

### Claim 1

An information processing apparatus comprising:
a processor configured to:
control to display, on a display, two or more templates included in a plurality of templates that are related to a shape of a marker inside a subject;
control to receive an input operation of a user which is a user's selection operation of selecting one or more templates out of the two or more templates displayed on the display;
control to specify at least one template out of the plurality of templates based on the input operation; and
control to track the marker in an image including the marker by using the at least one template.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein
the processor is configured to control to display the image on the display.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein
the processor is configured to control to display the two or more templates superimposed on the image on the display.

### Claim 4 (depends on 2)

The information processing apparatus according to claim 2, wherein the processor is configured to:
control to receive a designation operation for designating one point in the image or a partial area of the image displayed on the display as the input operation of the user, and
control to select the at least one template based on the designation operation of the user.

### Claim 5 (depends on 4)

The information processing apparatus according to claim 4, wherein
the processor is configured to control to select the at least one template based on a degree of similarity with an area of the image including the one point in the image or the partial area of the image.

### Claim 6 (depends on 5)

The information processing apparatus according to claim 5, wherein
the processor is configured to control to select the at least one template based on a threshold of the degree of similarity.

### Claim 7 (depends on 1)

The information processing apparatus according to claim 1, wherein the processor is configured to:
control to display at least a first template and a second template out of the plurality of templates on the display, and
control to display a third template and a fourth template that have a greater similarity to the first template than to the second template on the display out of the plurality of templates in a case in which the first template is specified based on the user's selection operation without specifying the second template.

### Claim 8 (depends on 1)

The information processing apparatus according to claim 1, wherein the processor is configured to:
control to output information representing a similar template having a similarity to the at least one template, and
control to track the marker by using the at least one template and the similar template.

### Claim 9 (depends on 1)

The information processing apparatus according to claim 1, wherein
the processor is configured to control to display a position of the marker, the position of the marker being superimposed on an acquired image of a subject on the display.

### Claim 10 (depends on 1)

The information processing apparatus according to claim 1, wherein the processor is configured to:
control to output information representing a similar template having a similarity to the at least one template, and
control to track the marker by using the similar template in a case in which the similar template has greater similarity to the marker in the image than the at least one template.

### Claim 11 (depends on 1)

The information processing apparatus according to claim 1, wherein
the marker is a metal marker.

### Claim 12 (depends on 1)

The information processing apparatus according to claim 1, wherein
the processor is configured to generate the plurality of templates based on a three-dimensional shape of the marker.

### Claim 13 (depends on 1)

The information processing apparatus according to claim 1, wherein the subject is a patient.

### Claim 14 (depends on 13)

The information processing apparatus according to claim 13, wherein the marker is a marker implanted to a body of the patient.

### Claim 15 (depends on 13)

The information processing apparatus according to claim 13, wherein the marker is not part of a body of the patient.

### Claim 16 (depends on 1)

The information processing apparatus according to claim 1, wherein the marker is an artificial marker.

### Claim 17 (depends on 1)

The information processing apparatus according to claim 1, wherein the plurality of templates are generated based on a plurality of postures of images of the marker from directions different from one another.

### Claim 18

An information processing system comprising:
a processor configured to:
control to display, on a display, two or more templates included in a plurality of templates that are related to a shape of a marker inside a subject;
control to receive an input operation of a user which is a user's selection operation of selecting one or more templates out of the two or more templates displayed on the display;
control to specify at least one template out of the plurality of templates based on the input operation;
control to track the marker in an image including the marker by using the at least one template; and
control to cause an emitter that emits energy based on a position of the marker.

### Claim 19

A computer program product comprising a software program embodied on a non-transitory computer-readable storage medium, the software program being executable by a computer of an information processing system to cause the information processing system to perform:
displaying, on a display, two or more templates included in a plurality of templates that are related to a shape of a marker inside a subject;
receiving an input operation of a user which is a user's selection operation of selecting one or more templates out of the two or more templates displayed on the display;
specifying at least one template out of the plurality of templates based on the input operation; and
tracking the marker in an image including the marker by using the at least one template.
