# US 2010/0073543 A1 · Instruction system, instruction apparatus, and computer readable medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0073543 A1
- Document ID: US20100073543A1
- Status: Published application
- Kind: A1
- Application number: 12/496,718
- Filed: 2009-07-02
- Published: 2010-03-25
- Earliest claimed: 2008-09-25
- Assignees: Fuji Xerox Co., Ltd.
- Inventors: Kentaro TAKANO
- Web page: https://patentgrep.com/patent/US20100073543A1

## CPC

- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display}
- H04N 9/3194: {including sensor feedback}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An instruction system including: a capture device; a projection device; a control device including: a judgment portion that judges visibility of an annotation image; a specifying portion that specifies a projection mode of the annotation image from projection modes of the annotation image stored into a storage portion, based on a result of the judgment; a notification portion that notifies the projection mode specified by the specifying portion; and a projection control portion that causes the projection device to project the annotation image corresponding to an instruction on the basis of the projection mode notified from the notification portion; and a terminal including: a reception portion receiving the captured image, and the projection mode notified from the notification portion; and a transmission portion transmitting the instruction on the basis of the received captured image, and the instruction on the basis of the notified projection mode, to the control device.

## Claims

### Claim 1

An instruction system comprising:
a capture device that captures a target area including an object;
a projection device that projects an annotation image corresponding to an instruction on the basis of a captured image by the capture device, in the target area;
a control device including:
a judgment portion that judges visibility of the annotation image;
a specifying portion that specifies a projection mode of the annotation image from projection modes of the annotation image stored into a storage portion, based on a result of the judgment by the judgment portion;
a notification portion that notifies the projection mode specified by the specifying portion; and
a projection control portion that causes the projection device to project the annotation image corresponding to an instruction on the basis of the projection mode notified from the notification portion; and
a terminal including:
a reception portion that receives the captured image, and the projection mode notified from the notification portion; and
a transmission portion that transmits the instruction on the basis of the captured image received by reception portion, and the instruction on the basis of the notified projection mode, to the control device.

### Claim 2 (depends on 1)

The instruction system according to claim 1, wherein the judgment portion judges the visibility of the annotation image included in the captured image, by comparing an image characteristic amount of the annotation image corresponding to the instruction on the basis of the captured image with an image characteristic amount of the annotation image included in the captured image.

### Claim 3 (depends on 1)

The instruction system according to claim 1, wherein the judgment portion judges the visibility of the annotation image included in the captured image, by comparing image characteristic amounts of the annotation image corresponding to the instruction on the basis of the captured image and an object included in the captured image indicated by the annotation image corresponding to the instruction, with image characteristic amounts of the annotation image included in the captured image and an object included in the captured image indicated by the annotation image included in the captured image.

### Claim 4 (depends on 1)

The instruction system according to claim 1, wherein when the judgment portion judges that the visibility of the annotation image included in the captured image is not secured, the projection control portion enlarges a size of the annotation image corresponding to the instruction on the basis of the captured image, and causes the projection device to project the enlarged annotation image.

### Claim 5 (depends on 1)

The instruction system according to claim 1, wherein when the judgment portion judges that a shape of the annotation image included in the captured image is a circle or rectangle, and the visibility of the annotation image included in the captured image is not secured, the projection control portion causes the projection device to project a moving image that causes an operator to watch the annotation image included in the captured image.

### Claim 6 (depends on 1)

The instruction system according to claim 1, wherein when the judgment portion judges that a color of the annotation image included in the captured image is close to a color of an object indicated by the annotation image, the projection control portion changes a color of the annotation image corresponding to the instruction on the basis of the captured image to a color having a complementary-colors relationship to the color of the object, and causes the projection device to project the annotation image having the changed color.

### Claim 7 (depends on 6)

The instruction system according to claim 6, wherein the projection control portion causes the projection device to sequentially project the annotation image having a color with a strong hue contrast from among the annotation images having colors included in the complementary-colors relationship.

### Claim 8 (depends on 1)

The instruction system according to claim 1, wherein when the judgment portion judges that the image quality of the annotation image included in the captured image has deteriorated, the projection control portion causes the projection device to project a region of interest of the annotation image included in the captured image.

### Claim 9 (depends on 8)

The instruction system according to claim 8, wherein the projection control portion causes the projection device to sequentially project the annotation image having a color with a strong hue contrast onto positions of the colors included in a complementary-colors relationship.

### Claim 10 (depends on 1)

The instruction system according to claim 1, wherein when the instruction on the basis of the projection mode transmitted from the transmission portion makes a denial of the projection mode, the projection control portion causes the projection device to stop projecting the annotation image corresponding to the instruction on the basis of the projection mode.

### Claim 11

An instruction apparatus comprising:
a judgment portion that judges visibility of the annotation image corresponding to an instruction on the basis of a captured image by a capture device, the capture device capturing a target area including an object;
a specifying portion that specifies a projection mode of the annotation image from projection modes of the annotation image stored into a storage portion, based on a result of the judgment by the judgment portion;
a notification portion that notifies the projection mode specified by the specifying portion; and
a projection control portion that causes a projection device to project the annotation image corresponding to an instruction on the basis of the projection mode notified from the notification portion, in the target area.

### Claim 12

A computer readable medium causing a computer to execute a process, the process comprising:
judging visibility of the annotation image corresponding to an instruction on the basis of a captured image by a capture device, the capture device capturing a target area including an object;
specifying a projection mode of the annotation image from projection modes of the annotation image stored into a storage portion, based on a result of the judgment;
notifying the specified projection mode; and
causing a projection device to project the annotation image corresponding to an instruction on the basis of the notified projection mode, in the target area.
