# US 2015/0149883 A1 · Image processing device, image processing device control method, program, and information storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0149883 A1
- Document ID: US20150149883A1
- Status: Published application
- Kind: A1
- Application number: 14/401,117
- Filed: 2012-05-16
- Published: 2015-05-28
- Earliest claimed: 2012-05-16
- Assignees: Rakuten, Inc.
- Inventors: Soh Masuko
- Web page: https://patentgrep.com/patent/US20150149883A1

## CPC

- G06F 40/169: Annotation, e.g. comment data or footnotes
- G06T 11/00: Two-dimensional [2D] image generation
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Provided is an image processing device capable of displaying an annotation in an appropriate position. An image obtaining unit obtains an image. An annotation target information obtaining unit obtains annotation target information for indicating an annotation target to which to add an annotation, the annotation target being including in the image. An annotation information obtaining unit obtains annotation information indicating an annotation. A display position determination unit determines a display position of the annotation based on the position or the area of the annotation target. A data output unit outputs data on the image with the annotation displayed in the display position determined by the display position determination unit.

## Claims

### Claim 1

An image processing device, comprising:
an image obtaining unit that obtains an image;
an annotation target information obtaining unit that obtains annotation target information for indicating an annotation target to which to add an annotation, the annotation target being including in the image;
an annotation information obtaining unit that obtains annotation information indicating an annotation;
a display position determination unit that determines a display position of the annotation based on a position or an area of the annotation target; and
a data output unit that outputs data on the image with the annotation displayed in the display position determined by the display position determination unit.

### Claim 2 (depends on 1)

The image processing device according to claim 1, wherein another annotation is already added to the image, and
the display position determination unit comprises a unit that determines the display position of the annotation based on the position or the area of the annotation target and a display position of the other annotation.

### Claim 3 (depends on 1)

The image processing device according to claim 1, wherein
another annotation is already added to the image, and
the display position determination unit comprises a unit that determines the display position of the annotation based on the position or the area of the annotation target and a position or an area of an annotation target corresponding to the other annotation.

### Claim 4 (depends on 1)

The image processing device according to claim 1, wherein annotation is already added to the image, and
the display position determination unit comprises a unit that determines the display position of the annotation and a new display position of the other annotation based on the position or the area of the annotation target and a position or an area of an annotation target corresponding to the other annotation.

### Claim 5 (depends on 1)

The image processing device according to claim 1, wherein the display position determination unit comprises:
a unit that determines, as to each of a plurality of kinds of annotation types, a display position of an annotation belonging to the type in a case where it is assumed that the annotation is added to the annotation target, based on the position or the area of the annotation target, and obtains the determined display position as a display position candidate corresponding to the type, and
a unit that determines, when the annotation information is obtained by the annotation obtaining unit, a display position of an annotation indicated by the annotation information based on a display position candidate corresponding to a type to which the annotation belongs.

### Claim 6 (depends on 5)

The image processing device according to claim 5, wherein
the plurality of kinds of annotation types are set based on at least one of a length, a display color, a display size, and a writing direction of an annotation.

### Claim 7 (depends on 5)

The image processing device according to claim 5, wherein
the display position determination unit, comprises:
a unit that determines, as to each of a plurality of kinds of length information concerning a length of an annotation, a display position of an annotation having a length indicated by the length information in a case where it is assumed that the annotation is added to the annotation target, based on the position or the area of the annotation target, and obtains the determined display position as a display position candidate corresponding to the length information, and
a unit that determines, when the annotation information is obtained by the annotation obtaining unit, the display position of the annotation indicated by the annotation information based on a display position candidate corresponding to a length of the annotation.

### Claim 8 (depends on 5)

The image processing device according to claim 5, wherein
the display position determination unit comprises:
a unit that determines, as to each of a plurality of kinds of display color information concerning a display color of an annotation, a display position of an annotation having a display color indicated by the display color information in a case where it is assumed that the annotation is added to the annotation target, based on the position or the area of the annotation target, and obtains the determined display position as a display position candidate corresponding to the display color information, and
a unit that determines, when the annotation information is obtained by the annotation obtaining unit, the display position of the annotation indicated by the annotation information based on a display position candidate corresponding to a display color of the annotation.

### Claim 9 (depends on 5)

The image processing device according to claim 5, wherein
the display position determination unit comprises:
a unit that determines, as to each of a plurality of kinds of display size information concerning a display size of an annotation, a display position of an annotation having a display size indicated by the display size information in a case where it is assumed that the annotation is added to the annotation target, based on the position or the area of the annotation target, and obtains the determined display position as a display position candidate corresponding to the display size information, and
a unit that determines, when the annotation information is obtained by the annotation obtaining unit, the display position of the annotation indicated by the annotation information based on a display position candidate corresponding to a display size of the annotation.

### Claim 10 (depends on 5)

The image processing device according to claim 5, wherein
the display position determination unit comprises:
a unit that determines, as to each of a plurality of kinds of writing direction information concerning a writing direction of an annotation, a display position of an annotation having a writing direction indicated by the writing direction information in a case where it is assumed that the annotation is added to the annotation target, based on the position or the area of the annotation target, and obtains the determined display position as a display position candidate corresponding to the writing direction information, and
a unit that determines, when the annotation information is obtained by the annotation obtaining unit, the display position of the annotation indicated by the annotation information based on a display position candidate corresponding to a writing direction of the annotation.

### Claim 11 (depends on 5)

The image processing device according to claim 5, wherein
another annotation is already added to the image, and
the display position determination unit comprises:
a unit that determines, as to each of a plurality of kinds of annotation types, the display position of the annotation and a new display position of the other annotation assuming a case where the annotation belongs to the type, based on the position or the area of the annotation target and a position or an area of an annotation target corresponding to the other annotation, and obtains the determined display position as a display position candidate corresponding to the type, and
a unit that determines, when the annotation information is obtained by the annotation obtaining unit, a display position of an annotation indicated by the annotation information and the new display position of the other annotation based on a display position candidate corresponding to a type to which the annotation belongs.

### Claim 12 (depends on 1)

The image processing device according to claim 1, wherein
the display position determination unit comprises a unit that determines the display position of the annotation based on at least one of a size and a shape of the area of the annotation target.

### Claim 13 (depends on 1)

The image processing device according to claim 1, wherein
the display position determination unit comprises a unit that determines the display position of the annotation based on the position or the area of the annotation target and at least one of a length, a display color, a display size, and a writing direction of the annotation.

### Claim 14 (depends on 1)

The image processing device according to claim 1, further comprising:
a unit that obtains an edge amount of a pixel of the image, wherein
the display position determination unit comprises a unit that determines the display position of the annotation based on the edge amount of the pixel of the image and the position or the area of the annotation target.

### Claim 15 (depends on 1)

The image processing device according to claim 1, further comprising:
a unit that obtains a saliency map of the image, wherein
the display position determination unit comprises a unit that determines the display position of the annotation based on the saliency map and the position or the area of the annotation target.

### Claim 16 (depends on 1)

The image processing device according to claim 1, further comprising:
a unit that specifies an annotation target candidate included in the image; and
a unit that determines the display position of the annotation in a case where it is assumed that the annotation is added to the annotation target candidate, based on a position or an area of the annotation target candidate, and obtains the determined display position as the display position candidate, wherein
the display position determination unit comprises a unit that determines the display position of the annotation based on the display position candidate, when the annotation target indicated by the annotation target information corresponds to the annotation target candidate.

### Claim 17

An image processing device control method, comprising:
obtaining an image;
obtaining annotation target information for indicating an annotation target to which to add an annotation, the annotation target being including in the image;
obtaining annotation information indicating an annotation;
determining a display position of the annotation based on a position or an area of the annotation target; and
outputting data on the image with the annotation displayed in the determined display position.

### Claim 18

(canceled)

### Claim 19

A non-transitory computer readable information storage medium storing a program for causing a computer to:
obtain an image;
obtain annotation target information for indicating an annotation target to which to add an annotation, the annotation target being including in the image;
obtain annotation information indicating an annotation;
determine a display position of the annotation based on a position or an area of the annotation target; and
output data on the image with the annotation displayed in the determined display position.
