# US 2020/0401981 A1 · Work operation analysis system and work operation analysis method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0401981 A1 - Document ID: US20200401981A1 - Status: Published application - Kind: A1 - Application number: 16/969,499 - Filed: 2019-02-28 - Published: 2020-12-24 - Earliest claimed: 2018-03-05 - Assignees: Hitachi, Ltd. - Applicants: Hitachi, Ltd. - Inventors: Hiroto NAGAYOSHI; Takuma TERADA; Nobuhiro KAKENO; Toshihiro YAMADA - Web page: https://patentgrep.com/patent/US20200401981A1 ## CPC - G06Q 10/06393: {Score-carding, benchmarking or key performance indicator [KPI] analysis} - G06Q 10/0633: Workflow analysis - G06Q 10/06398: {Performance of employee with respect to a job function} - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 40/23: {Recognition of whole body movements, e.g. for sport training} - G08B 21/00: Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for - G08B 25/00: Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems - G09B 19/00: Teaching not covered by other main groups of this subclass (teaching or practice apparatus for gun-aiming or gun-laying F41G3/26) - H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast - G06V 10/34: Smoothing or thinning of the pattern; Morphological operations; Skeletonisation - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A work operation analysis system 11 includes: a deviant operation analysis unit 114 that analyzes a work video obtained by photographing work of a worker on a work process basis and, in the case where a deviant operation different from normal work has been detected, identifies the occurrence timing of the deviant operation; a work video accumulation unit (a normal work video accumulation unit 117 and a deviant work video accumulation unit 118) that accumulates a normal work video obtained by preliminarily photographing normal work and a deviant work video obtained when the deviant operation occurred; and a display unit (a display input device 111) that displays the normal work video and the deviant work video having predetermined time including the occurrence timing of the deviant operation. ## Claims ### Claim 1 A work operation analysis system comprising: a deviant operation analysis unit that analyzes a work video obtained by photographing work of a worker on a work process basis and, in the case where a deviant operation different from normal work has been detected, identifies the occurrence timing of the deviant operation; a work video accumulation unit that accumulates a normal work video obtained by preliminarily photographing normal work and a deviant work video obtained when the deviant operation occurred; and a display unit that displays the normal work video and the deviant work video having predetermined time including the occurrence timing of the deviant operation. ### Claim 2 (depends on 1) The work operation analysis system according to claim 1, wherein the deviant operation analysis unit identifies whether or not a factor of the deviant operation is work time deviation caused when work time in any one of elemental works configuring the work process is different from the work time in the normal work, and wherein the display unit displays the factor of the deviant operation identified by the deviant operation analysis unit. ### Claim 3 (depends on 1) The work operation analysis system according to claim 1, wherein the deviant operation analysis unit identifies whether or not a factor of the deviant operation is work position deviation caused when a body part of the worker is located at a position different from that in the normal work, and wherein the display unit displays the factor of the deviant operation identified by the deviant operation analysis unit. ### Claim 4 (depends on 1) The work operation analysis system according to claim 1, further comprising: a deviant operation analysis result accumulation unit that accumulates an analysis result by the deviant operation analysis unit; and a statistical information generation unit that generates predetermined statistical information using information accumulated in the deviant operation analysis result accumulation unit and displays the generated statistical information on the display unit. ### Claim 5 (depends on 4) The work operation analysis system according to claim 4, wherein the statistical information generated by the statistical information generation unit is information indicating the occurrence frequency of the deviant operation for a time series of the work process. ### Claim 6 (depends on 4) The work operation analysis system according to claim 4, wherein the statistical information generation unit generates the statistical information in a different display mode in accordance with the factor of the deviant operation, and displays the generated statistical information on the display unit. ### Claim 7 (depends on 1) The work operation analysis system according to claim 1, wherein the deviant operation analysis unit has: a first analysis unit that detects the deviant operation; and a second analysis unit that identifies the occurrence timing of the deviant operation after the detection of the deviant operation by the first analysis unit, wherein in the case where the deviant operation has been detected, the first analysis unit displays a display screen notifying the occurrence of the deviant operation on the display unit without waiting for a process by the second analysis unit, and wherein the display unit displays the normal work video and the deviant work video having predetermined time including the occurrence timing of the deviant operation after the occurrence timing of the deviant operation is identified by the second analysis unit. ### Claim 8 A work operation analysis method comprising: a normal work video accumulation step of accumulating a normal work video obtained by preliminarily photographing normal work; a deviant operation analysis step of analyzing a work video obtained by photographing work of a worker on a work process basis and, in the case where a deviant operation different from normal work has been detected, identifying the occurrence timing of the deviant operation; a deviant work video accumulation step of accumulating a deviant work video obtained when the deviant operation occurred; and a display step of displaying the normal work video and the deviant work video having predetermined time including the occurrence timing of the deviant operation identified in the deviant operation analysis step on a display device. ### Claim 9 (depends on 8) The work operation analysis method according to claim 8, wherein in the deviant operation analysis step, it is identified whether or not a factor of the deviant operation is work time deviation caused when work time in any one of elemental works configuring the work process is different from the work time in the normal work, and wherein in the display step, the factor of the deviant operation identified in the deviant operation analysis step is displayed on the display device. ### Claim 10 (depends on 8) The work operation analysis method according to claim 8, wherein in the deviant operation analysis step, it is identified whether or not a factor of the deviant operation is work position deviation caused when a body part of the worker is located at a position different from that in the normal work, and wherein in the display step, the factor of the deviant operation identified in the deviant operation analysis step is displayed on the display device. ### Claim 11 (depends on 8) The work operation analysis method according to claim 8, further comprising: a deviant operation analysis result accumulation step of accumulating an analysis result by the deviant operation analysis step; and a statistical information generation step of generating predetermined statistical information using information accumulated in the deviant operation analysis result accumulation step and displaying the generated statistical information on the display unit. ### Claim 12 (depends on 11) The work operation analysis method according to claim 11, wherein the statistical information generated in the statistical information generation step is information indicating the occurrence frequency of the deviant operation for a time series of the work process. ### Claim 13 (depends on 11) The work operation analysis method according to claim 11, wherein in the statistical information generation step, the statistical information is generated in a different display mode in accordance with the factor of the deviant operation, and the generated statistical information is displayed on the display unit. ### Claim 14 (depends on 8) The work operation analysis method according to claim 8, wherein the deviant operation analysis step has: a first analysis step of detecting the deviant operation; and a second analysis step of identifying the occurrence timing of the deviant operation after the first analysis step, wherein in the first analysis step, in the case where the deviant operation has been detected, a display screen notifying the occurrence of the deviant operation is displayed on the display unit without waiting for the execution of the second analysis step, and wherein in the display step, the normal work video and the deviant work video having predetermined time including the occurrence timing of the deviant operation are displayed on the display device after the occurrence timing of the deviant operation is identified in the second analysis step.