# US 2018/0027218 A1 · Work assistance device, work assistance system, work assistance method, and recording medium storing work assistance program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0027218 A1
- Document ID: US20180027218A1
- Status: Published application
- Kind: A1
- Application number: 15/550,254
- Filed: 2016-02-15
- Published: 2018-01-25
- Earliest claimed: 2015-02-16
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Hiroaki KISO; Kan ARAI; Nobuyuki YASUKAWA
- Web page: https://patentgrep.com/patent/US20180027218A1

## CPC

- H04N 9/3179: {Video signal processing therefor}
- G05B 19/41805: {characterised by assembly}
- G06Q 10/063112: {Skill-based matching of a person or a group to a task}
- H04N 9/3194: {including sensor feedback}
- G05B 19/042: using digital processors (G05B19/05 takes precedence)
- G05B 2219/37074: Projection device, monitor, track tool, workpiece form, process on display
- G05B 2219/45026: Circuit board, pcb
- Y02P 90/02: Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- Y02P: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS

## Abstract

Provided is a work assistance device that enables the working time of a worker to be reduced in a reliable manner. A work assistance device according to one embodiment of the present invention is equipped with: a reading means and a projection control means. The reading means sequentially reads from a work storage means, in accordance with the order of the steps of work performed by a worker, a projection data set for each of the steps. The work storage means stores a work procedure wherein the projection data set is associated with the order of the steps, said projection data set including an indication display that includes a visually recognizable visual representation which indicates, for each of the steps, a location where the work for that step is performed and a member to be handled in the work for that step. In response to the reading of the projection data set the projection control means uses a projection means to project the indication display included in the projection data set, said indication display being projected during an indication display projection time, which is a projection time that has been determined for that indication display.

## Claims

### Claim 1

A work assistance device comprising:
a memory that stores a set of instructions; and
at least one first processor configured to execute the set of instructions to:
read a projection data set for each process, according to a sequence number of the process, from work storage that stores a work procedure in which the projection data set is associated with a sequence number of the process, the projection data set including an indication display including a visually recognizable visual representation indicating, for each process of work performed by a worker, a position where work in a process is performed and a member handled in work in the process; and
project, by a projector, the indication display included in the projection data set, upon readout of the projection data set, for a period of an indication display projection time being a projection time determined for the indication display.

### Claim 2 (depends on 1)

The work assistance device according to claim 1, wherein
the projection data set further includes a caution display including the visual representation indicating a caution in the work, and
the at least one first processor is further configured to
project the caution display before projecting the indication display when the read projection data set includes the caution display.

### Claim 3 (depends on 1)

The work assistance device according to claim 1, wherein
the projection data set of a second process further includes a guidance display including the visual representation representing guidance from a position where work in a first process is performed to a position where work in the second process is performed, the first process and the second process being two consecutive processes in which a same member is handled, the second process following the first process, and
the at least one first processor is further configured to
project the guidance display when the read projection data set includes the guidance display.

### Claim 4 (depends on 1)

The work assistance device according to claim 1, wherein
the visual representation includes a representation by an animation.

### Claim 5 (depends on 1)

The work assistance device according to claim 1, wherein
the projection data set further includes the indication display projection time, and
the at least one first processor is further configured to
project the indication display for a period of the indication display projection time included in the read projection data set.

### Claim 6 (depends on 1)

The work assistance device according to claim 1, further comprising:
skill level storage that stores a skill level related to the work for each of the worker, wherein
the at least one first processor is further configured to
acquire an identifier of the worker, and
read the skill level of the worker the identifier of whom is acquired, update the indication display projection time based on the read skill level, and project the indication display for a period of the updated indication display projection time.

### Claim 7 (depends on 1)

The work assistance device according to claim 1, wherein
the work procedure includes the projection data set of a mounting process being the process of performing work of equipping a part as the member on a substrate, and
the projection data set of the mounting process includes a position on the substrate where the part is equipped, as a position where the work is performed, and includes, as the indication display, a display indicating a location where the part is equipped and a symbol indicating the part.

### Claim 8 (depends on 7)

The work assistance device according to claim 7, wherein
the work storage stores the work procedure for each type of the substrate, and
the at least one first processor is further configured to
acquire a type of the substrate; and
read the projection data set included in the work procedure for an acquired type of the substrate.

### Claim 9 (depends on 1)

The work assistance device according to claim 1, wherein:
the at least one first processor is further configured to
receive a control instruction being an instruction by the worker for controlling progression of the projection, wherein
store process identification information in history storage when receiving a predetermined type of the control instruction, the process identification information identifying the process in which the indication display is projected when the work indication is performed, and
analyze a frequency of performing the control instruction based on the process identification information stored in the history storage.

### Claim 10 (depends on 1)

A work assistance system including the work assistance device according to claim 1, comprising:
the projector.

### Claim 11

A work assistance method comprising:
successively reading a projection data set for each process, according to a sequence number of the process, from work storage that stores a work procedure in which the projection data set is associated with a sequence number of the process, the projection data set including an indication display including a visually recognizable visual representation indicating, for each process of work performed by a worker, a position where work in a process is performed and a member handled in work in the process; and
projecting, by a projector, the indication display included in the projection data set, upon readout of the projection data set, for a period of an indication display projection time being a projection time determined for the indication display.

### Claim 12 (depends on 11)

The work assistance method according to claim 11, wherein
the work procedure includes the projection data set further including a caution display including the visual representation indicating a caution in the work, and
the method comprises projecting the caution display before the indication display is projected when the read projection data set includes the caution display.

### Claim 13 (depends on 11)

The work assistance method according to claim 11, wherein
the work procedure includes the projection data set of work in a second process, the projection data set further including a guidance display including the visual representation representing guidance from a position where work in a first process is performed to a position where work in the second process is performed, the first process and the second process being two consecutive processes in which a same member is handled, the second process following the first process, and
the method comprises projecting the guidance display when the read projection data set includes the guidance display.

### Claim 14

A non-transitory computer readable storage medium storing a work assistance program causing a computer to perform:
reading processing of successively reading a projection data set for each process, according to a sequence number of the process, from work storage that stores a work procedure in which the projection data set is associated with a sequence number of the process, the projection data set including an indication display including a visually recognizable visual representation indicating, for each process of work performed by a worker, a position where work in a process is performed and a member handled in work in the process; and
projection control processing of projecting, by a projector, the indication display included in the projection data set, upon readout of the projection data set, for a period of an indication display projection time being a projection time determined for the indication display.

### Claim 15 (depends on 14)

The non-transitory computer readable storage medium according to claim 14, storing the work assistance program, wherein
the work procedure includes the projection data set further including a caution display including the visual representation indicating a caution in the work, and
the projection control processing projects the caution display before projecting the indication display when the read projection data set includes the caution display.

### Claim 16 (depends on 14)

The non-transitory computer readable storage medium according to claim 14, storing the work assistance program, wherein
the projection data set of a second process further includes a guidance display including the visual representation representing guidance from a position where work in a first process is performed to a position where work in a second process is performed, the first process and the second process being two consecutive processes in which a same member is handled, the second process following the first process, and
the projection control processing projects the guidance display when the read projection data set includes the guidance display.
