# US 2023/0410558 A1 · Information processing device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410558 A1
- Document ID: US20230410558A1
- Status: Published application
- Kind: A1
- Application number: 18/238,376
- Filed: 2023-08-25
- Published: 2023-12-21
- Earliest claimed: 2021-07-08
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Muneaki ONOZATO; Satoshi TERASAWA; Ryoma OAMI; Yadong PAN
- Web page: https://patentgrep.com/patent/US20230410558A1

## CPC

- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06T 7/00: Image analysis
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06V 2201/10: Recognition assisted with metadata
- G08B 25/00: Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS

## Abstract

An information processing device according to the present invention includes: a storage means that stores reference attribute information representing an attribute of a person corresponding to a target place; an extraction means that extracts person attribute information representing an attribute of a person in a captured image obtained by capturing an image of the target place; and a detection means that detects a predetermined person in the captured image based on the reference attribute information and the person attribute information.

## Claims

### Claim 1

A monitoring device comprising:
a memory storing instructions; and
a processor connected to the memory and configured to execute the instructions to:
receive a captured image of a target place;
extract an image portion of a person in the captured image;
extract, based on the image portion of the person, person attribute information representing an attribute of the person, person attribute information representing an attribute of the person, and scene information of the target place;
store the personal attribute information, the action information, and the scene information in association with each other; and
generate reference attribute information representing an attribute and an action of the person corresponding to the target place by learning the person attribute information, the action information, and the scene information stored in association with.

### Claim 2 (depends on 1)

The monitoring device according to claim 1, wherein
the processor is configured to execute the instructions to
generate the reference attribute information using the person attribute information, the action information, and the scene information extracted when the target place is determined to be in a normal state.

### Claim 3 (depends on 1)

The monitoring device according to claim 1, wherein
the processor is configured to execute the instructions to
update the reference attribute information using the person attribute information, the action information, and the scene information extracted from a newly captured image.

### Claim 4 (depends on 2)

The monitoring device according to claim 2, wherein
the processor is configured to execute the instructions to
detect the person as a suspicious person in a case where the person attribute information and the action information of the person do not agree with the reference attribute information in accordance with a preset criterion.

### Claim 5 (depends on 1)

The monitoring device according to claim 1, wherein
the processor is configured to execute the instructions to
generate the reference attribute information using the person attribute information, the action information, and the scene information of a suspicious person.

### Claim 6 (depends on 5)

The monitoring device according to claim 5, wherein
the processor is configured to execute the instructions to
detect the person as a suspicious person in a case where the person attribute information and the action information of the person do not agree with the reference attribute information in accordance with a preset criterion.

### Claim 7

A monitoring method comprising:
receiving a captured image of a target place;
extracting an image portion of a person in the captured image;
extracting, based on the image portion of the person, person attribute information representing an attribute of the person, person attribute information representing an attribute of the person, and scene information of the target place;
storing the personal attribute information, the action information, and the scene information in association with each other; and
generating reference attribute information representing an attribute and an action of the person corresponding to the target place by learning the person attribute information, the action information, and the scene information stored in association with.

### Claim 8 (depends on 7)

The monitoring method according to claim 7, comprising
generating the reference attribute information using the person attribute information, the action information, and the scene information extracted when the target place is determined to be in a normal state.

### Claim 9 (depends on 7)

The monitoring method according to claim 7, comprising
updating the reference attribute information using the person attribute information, the action information, and the scene information extracted from a newly captured image.

### Claim 10 (depends on 8)

The monitoring method according to claim 8, comprising
detecting the person as a suspicious person in a case where the person attribute information and the action information of the person do not agree with the reference attribute information in accordance with a preset criterion.

### Claim 11 (depends on 7)

The monitoring method according to claim 7, comprising
generating the reference attribute information using the person attribute information, the action information, and the scene information of a suspicious person.

### Claim 12 (depends on 11)

The monitoring method according to claim 11, comprising
detecting the person as a suspicious person in a case where the person attribute information and the action information of the person do not agree with the reference attribute information in accordance with a preset criterion.

### Claim 13

A non-transitory computer-readable storage medium storing a program, the program comprising instructions for causing an information processing device to execute:
a process to receive a captured image of a target place;
a process to extract an image portion of a person in the captured image;
a process to extract, based on the image portion of the person, person attribute information representing an attribute of the person, person attribute information representing an attribute of the person, and scene information of the target place;
a process to store the personal attribute information, the action information, and the scene information in association with each other; and
a process to generate reference attribute information representing an attribute and an action of the person corresponding to the target place by learning the person attribute information, the action information, and the scene information stored in association with.

### Claim 14 (depends on 13)

The non-transitory computer-readable storage medium storing the program according to claim 13, the program comprising instructions for causing the information processing device to execute
a process to generate the reference attribute information using the person attribute information, the action information, and the scene information extracted when the target place is determined to be in a normal state.

### Claim 15 (depends on 13)

The non-transitory computer-readable storage medium storing the program according to claim 13, the program comprising instructions for causing the information processing device to execute
a process to update the reference attribute information using the person attribute information, the action information, and the scene information extracted from a newly captured image.

### Claim 16 (depends on 14)

The non-transitory computer-readable storage medium storing the program according to claim 14, the program comprising instructions for causing the information processing device to execute
a process to detect the person as a suspicious person in a case where the person attribute information and the action information of the person do not agree with the reference attribute information in accordance with a preset criterion.

### Claim 17 (depends on 13)

The non-transitory computer-readable storage medium storing the program according to claim 13, the program comprising instructions for causing the information processing device to execute
a process to generate the reference attribute information using the person attribute information, the action information, and the scene information of a suspicious person.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium storing the program according to claim 17, the program comprising instructions for causing the information processing device to execute
a process to detect the person as a suspicious person in a case where the person attribute information and the action information of the person do not agree with the reference attribute information in accordance with a preset criterion.
