# US 2020/0401972 A1 · Work support device, work support method, and work support program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0401972 A1 - Document ID: US20200401972A1 - Status: Published application - Kind: A1 - Application number: 16/899,701 - Filed: 2020-06-12 - Published: 2020-12-24 - Earliest claimed: 2019-06-20 - Assignees: Hitachi, Ltd. - Applicants: Hitachi, Ltd. - Inventors: Yuichi SAKURAI; Yasuyuki MIMATSU; Shigeyasu TSUBAKI; Kazuaki SUZUKI; Ryouta HIGASHI - Web page: https://patentgrep.com/patent/US20200401972A1 ## CPC - G06Q 10/06316: {Sequencing of tasks or work} - G06Q 10/0633: Workflow analysis - G06T 7/0006: {using a design-rule based approach} - G06T 7/001: {using an image reference approach} - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract The work support device stores information indicating a work order for each process, and information indicating a work area of a worker for each work in the process. A processor executes a specifying processing in which a target work to be performed by the worker is specified based on the information indicating the work order, a selection processing in which a target area where the target work specified by the specifying processing to be performed by the worker is selected based on the information indicating the work area, an identification processing in which a work performed by the worker is identified based on image data from a camera that captures an image of the area selected by the selection processing, a determination processing in which whether the worker has deviated from the work order is determined based on an identification result by the identification processing. ## Claims ### Claim 1 A work support device comprising: a processor that executes a program; and a storage device that stores the program, wherein the storage device or another storage device accessible by the work support device stores information indicating a work order for each process, and information indicating a work area of a worker for each work in the process, and the processor executes a specifying processing in which a target work to be performed by the worker is specified based on the information indicating the work order, a selection processing in which a target area where the target work specified by the specifying processing to be performed by the worker is selected based on the information indicating the work area, an identification processing in which a work performed by the worker is identified based on image data from a camera that captures an image of the area selected by the selection processing, a determination processing in which whether the worker has deviated from the work order is determined based on an identification result by the identification processing, and an output processing in which a determination result by the determination processing is output. ### Claim 2 (depends on 1) The work support device according to claim 1, wherein in the specifying processing, the processor specifies the target work based on the determination result and the information indicating the work order. ### Claim 3 (depends on 1) The work support device according to claim 1, wherein in the identification processing, the processor extracts image data of the target area from the image data, and identifies the work performed by the worker based on the extracted image data. ### Claim 4 (depends on 1) The work support device according to claim 1, wherein the storage device stores image data for each tool used by the worker in the work, and in the identification processing, the processor identifies the work performed by the worker based on image data of a tool included in the image data. ### Claim 5 (depends on 4) The work support device according to claim 4, wherein the tool includes a driver or a reading device. ### Claim 6 (depends on 1) The work support device according to claim 1, wherein the storage device or the other storage device stores image data for each tool used by the worker in the work, and in the determination processing, the processor determines whether the worker has deviated from the work order based on time-series presence or absence of the tool in the identification result. ### Claim 7 (depends on 6) The work support device according to claim 6, wherein in the determination processing, the processor determines whether the worker has deviated from the work order based on a time-series position of the tool in the identification result. ### Claim 8 (depends on 1) The work support device according to claim 1, wherein in the output processing, when the worker does not deviate from the work order, the processor refers to the information indicating the work order and outputs a subsequent work instruction. ### Claim 9 (depends on 8) The work support device according to claim 8, wherein in the output processing, the processor records a work time from a start time point to an end time point of a target process including the target work in the storage device or the other storage device. ### Claim 10 (depends on 8) The work support device according to claim 8, wherein in the output processing, the processor outputs information that specifies a subsequent work of the target work as the subsequent work instruction when the target work is not a final work in a target process including the target work. ### Claim 11 (depends on 8) The work support device according to claim 8, wherein in the output processing, the processor outputs information that specifies a subsequent process of a target process including the target work as the subsequent work instruction when the target work is a final work in the target process. ### Claim 12 (depends on 1) The work support device according to claim 1, wherein in the output processing, when the worker has deviated from the work order, the processor outputs a deviation notification of the work order. ### Claim 13 (depends on 12) The work support device according to claim 12, wherein in the identification processing, when the deviation notification is output, the processor identifies the work performed by the worker after being restored to a state before the identified work based on new image data of the target area captured by the camera. ### Claim 14 A work support method which is executed by a work support device including a processor that executes a program and a storage device that stores the program, wherein the storage device or another storage device accessible by the work support device stores information indicating a work order for each process, and information indicating a work area of a worker for each work in the process, and the processor executes a specifying processing in which a target work to be performed by the worker is specified based on the information indicating the work order, a selection processing in which a target area where the target work specified by the specifying processing to be performed by the worker is selected based on the information indicating the work area, an identification processing in which a work performed by the worker is identified based on image data from a camera that captures an image of the area selected by the selection processing, a determination processing in which whether the worker has deviated from the work order is determined based on an identification result by the identification processing, and an output processing in which a determination result by the determination processing is output. ### Claim 15 A work support program that causes a processor accessible to a storage device to execute work support, wherein the storage device stores information indicating a work order for each process, and information indicating a work area of a worker for each work in the process, and the processor executes a specifying processing in which a target work to be performed by the worker is specified based on the information indicating the work order, a selection processing in which a target area where the target work specified by the specifying processing to be performed by the worker is selected based on the information indicating the work area, an identification processing in which a work performed by the worker is identified based on image data from a camera that captures an image of the area selected by the selection processing, a determination processing in which whether the worker has deviated from the work order is determined based on an identification result by the identification processing, and an output processing in which a determination result by the determination processing is output.