# US 2017/0286160 A1 · Task circumstance processing device and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0286160 A1
- Document ID: US20170286160A1
- Status: Published application
- Kind: A1
- Application number: 15/441,679
- Filed: 2017-02-24
- Published: 2017-10-05
- Earliest claimed: 2016-03-30
- Assignees: Fujitsu Limited
- Applicants: Fujitsu Limited
- Inventors: Masanao Fujii; Hiroyasu Fujiwara; Takumi Takeno; Takao Sekiya
- Web page: https://patentgrep.com/patent/US20170286160A1

## CPC

- G06F 9/4881: {Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues}
- G06F 9/46: Multiprogramming arrangements
- G06F 11/00: Error detection; Error correction; Monitoring (error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00)
- G06F 11/22: Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F 11/3024: {where the computing system component is a central processing unit [CPU]}
- G06F 11/3419: {by assessing time}
- G06Q 30/00: Commerce
- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- G06Q 30/0201: Market modelling; Market analysis; Collecting market data
- G06Q 30/0204: Market segmentation
- G06Q 30/0205: {based on location or geographical consideration}
- G06Q 30/0241: Advertisements
- G06Q 30/0244: {Optimization}
- G06Q 30/0246: {Traffic}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06V 10/96: Management of image or video recognition tasks
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- G08B 13/196: using television cameras
- G08B 13/19602: {Image analysis to detect motion of the intruder, e.g. by frame subtraction}
- G08B 13/19604: {involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change}
- G08B 13/19606: {Discriminating between target movement or movement in an area of interest and other non-signicative movements, e.g. target movements induced by camera shake or movements of pets, falling leaves, rotating fan}
- G08B 13/19613: {Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion}
- G08B 13/19615: {wherein said pattern is defined by the user}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS

## Abstract

A task circumstance processing system includes a processor that executes a process. The process includes: referencing a recognition information stored in a memory, the recognition information stores, for each of plural task processes in task definitions defining relationships between the plural task processes, recognition information for recognizing execution of each of the plural task processes, and extracting for each of the task processes a timing where the recognition information is expressed in observation data from observing circumstances of the task; and outputting a result of comparing a relationship between plural task processes that have been executed as identified by the extracted timings, against a relationship between plural task processes defined by the task definitions stored in the memory.

## Claims

### Claim 1

A task circumstance processing system comprising:
a memory; and
a processor coupled to the memory, and configured to:
reference a recognition information stored in the memory, the recognition information stores, for each of a plurality of task processes in task definitions defining relationships between the plurality of task processes, recognition information for recognizing execution of each of the plurality of task processes, and extract for each of the task processes a timing where the recognition information is expressed in observation data from observing circumstances of the task; and
output a result of comparing a relationship between a plurality of task processes that have been executed as identified by the extracted timings, against a relationship between a plurality of task processes defined by the task definitions stored in the memory.

### Claim 2 (depends on 1)

The task circumstance processing system of claim 1, wherein the recognition information is a pattern expressed in the observation data.

### Claim 3 (depends on 1)

The task circumstance processing system of claim 1, wherein the recognition information is specific information included in log information recorded by a task system employed in the execution of the plurality of task processes.

### Claim 4 (depends on 1)

The task circumstance processing system of claim 1, wherein
in cases in which a relationship between new task processes has been added to the task definitions, and recognition information of a new task process has been added to the memory,
a timing is extracted where recognition information of the new task process is expressed from the observation data, and
a relationship is identified between the plurality of executed task processes that include the timing where the recognition information of the extracted new task process is expressed.

### Claim 5 (depends on 1)

The task circumstance processing system of claim 1, wherein, when extracting the timing where the recognition information for each of the task processes is expressed, an index associated with the task process is appended to the timing in the observation data where the recognition information of each of the task processes is expressed.

### Claim 6 (depends on 5)

The task circumstance processing system of claim 5, wherein the index includes date and time information of when the task process was executed, identification information of an observation target object, identification information of a location where observation was performed, and at least one type of observation data.

### Claim 7 (depends on 1)

The task circumstance processing system of claim 1, wherein the observation data is image data capturing the execution location of the task process, audio data collecting sound of an execution location, or sensor data observed by a sensor installed at the execution location.

### Claim 8 (depends on 1)

The task circumstance processing system of claim 1, wherein, as the comparison result, a portion is output where there is a difference between the relationship between the plurality of executed task processes and the relationship between the plurality of task processes defined by the task definitions.

### Claim 9 (depends on 8)

The task circumstance processing system of claim 8, wherein, when outputting the comparison result, observation data is output corresponding to the portion having a difference.

### Claim 10 (depends on 8)

The task circumstance processing system of claim 8, wherein:
when extracting the timing where the recognition information for each of the task processes is expressed, an index for identifying the task process is appended to the timing in the observation data where the recognition information for each of the task processes is expressed; and
when outputting the comparison result, a listing is output of indexes appended to the observation data corresponding to any of the portions having a difference.

### Claim 11

A task circumstance processing method comprising:
referencing a recognition information stored in the memory, the recognition information stores, for each of a plurality of task processes in task definitions defining relationships between the plurality of task processes, recognition information for recognizing execution of each of the plurality of task processes, and extracting for each of the task processes a timing where the recognition information is expressed in observation data from observing circumstances of the task; and
by a processor, outputting a result of comparing a relationship between a plurality of task processes that have been executed as identified by the extracted timings, against a relationship between a plurality of task processes defined by the task definitions stored in the memory.

### Claim 12 (depends on 11)

The task circumstance processing method of claim 11, wherein the recognition information is specific information included in log information recorded by a task system employed in the execution of the plurality of task processes.

### Claim 13 (depends on 11)

The task circumstance processing method of claim 11, wherein
in cases in which a relationship between new task processes has been added to the task definitions, and recognition information of a new task process has been added to the memory,
a timing is extracted where recognition information of the new task process is expressed from the observation data, and
a relationship is identified between the plurality of executed task processes that include the timing where the recognition information of the extracted new task process is expressed.

### Claim 14 (depends on 11)

The task circumstance processing method of claim 11, wherein, when extracting the timing where the recognition information for each of the task processes is expressed, an index associated with the task process is appended to the timing in the observation data where the recognition information of each of the task processes is expressed.

### Claim 15 (depends on 11)

The task circumstance processing method of claim 11, wherein, as the comparison result, a portion is output where there is a difference between the relationship between the plurality of executed task processes and the relationship between the plurality of task processes defined by the task definitions.

### Claim 16 (depends on 15)

The task circumstance processing method of claim 15, wherein, when outputting the comparison result, observation data is output corresponding to the portion having a difference.

### Claim 17 (depends on 15)

The task circumstance processing method of claim 15, wherein:
when extracting the timing where the recognition information for each of the task processes is expressed, an index for identifying the task process is appended to the timing in the observation data where the recognition information for each of the task processes is expressed; and
when outputting the comparison result, a listing is output of indexes appended to the observation data corresponding to any of the portions having a difference.

### Claim 18

A non-transitory recording medium storing a task circumstance processing program that causes a computer to execute a process, the process comprising:
referencing a recognition information stored in the memory, the recognition information stores, for each of a plurality of task processes in task definitions defining relationships between the plurality of task processes, recognition information for recognizing execution of each of the plurality of task processes, and extracting for each of the task processes a timing where the recognition information is expressed in observation data from observing circumstances of the task; and
outputting a result of comparing a relationship between a plurality of task processes that have been executed as identified by the extracted timings, against a relationship between a plurality of task processes defined by the task definitions stored in the memory.

### Claim 19 (depends on 18)

The non-transitory recording medium of claim 18, wherein, in the process, the recognition information is specific information included in log information recorded by a task system employed in the execution of the plurality of task processes.

### Claim 20 (depends on 18)

The non-transitory recording medium of claim 18, wherein, in the process,
in cases in which a relationship between new task processes has been added to the task definitions, and recognition information of a new task process has been added to the memory,
a timing is extracted where recognition information of the new task process is expressed from the observation data, and
a relationship is identified between the plurality of executed task processes that include the timing where the recognition information of the extracted new task process is expressed.

### Claim 21 (depends on 1)

The task circumstance processing system of claim 1, further comprising another processor; and
the processor is configured to:
references a recognition information stored in the memory, the recognition information stores, for each of a plurality of task processes in task definitions defining relationships between the plurality of task processes, recognition information for recognizing execution of each of the plurality of task processes, and extract for each of the task processes a timing where the recognition information is expressed in observation data from observing circumstances of the task, and
the another processor is configured to:
outputs a result of comparing a relationship between a plurality of task processes that have been executed as identified by the extracted timings, against a relationship between a plurality of task processes defined by the task definitions stored in the memory.
