# US 2021/0279450 A1 · Person detection system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279450 A1
- Document ID: US20210279450A1
- Status: Published application
- Kind: A1
- Application number: 16/483,078
- Filed: 2017-12-12
- Published: 2021-09-09
- Earliest claimed: 2017-02-13
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Ryuta NIINO
- Web page: https://patentgrep.com/patent/US20210279450A1

## CPC

- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06V 20/53: {Recognition of crowd images, e.g. recognition of crowd congestion}
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G08B 21/02: Alarms for ensuring the safety of persons
- G08B 21/24: Reminder alarms, e.g. anti-loss alarms
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G08B 13/19613: {Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A person detection system of the present invention includes: a person extraction unit that extracts person information from image information; a group determination unit that extracts behavior information from the image information and determines a group; a first person identification unit that identifies a first person from the image information, based on the person information and the behavior information; a second person identification unit that identifies a second person belonging to a same group as the first person from the image information, based on the person information of a person identified as the first person and the group information; and a position identification unit that identifies a position of the first person and a position of the second person, based on position information of the security cameras used for taking the image information based on which the first person and the second person have been identified, respectively.

## Claims

### Claim 1

A person detection system comprising:
a person extraction unit configured to extract person information representing a person from image information taken with a security camera;
a group determination unit configured to extract behavior information representing behavior of the person from the image information and, based on the behavior information, determine a group composed of a plurality of persons and register group information including the person information;
a first person identification unit configured to identify a first person from the image information taken with the security camera, based on the extracted person information and the extracted behavior information;
a second person identification unit configured to identify a second person belonging to a same group as the first person from the image information taken with the security camera, based on the person information of a person identified as the first person and the group information; and
a position identification unit configured to identify a position of the first person and a position of the second person, based on position information of the security cameras used for taking the image information based on which the first person and the second person have been identified, respectively.

### Claim 2 (depends on 1)

The person detection system according to claim 1, wherein:
the person extraction unit is configured to extract feature information representing an external feature of a person as the person information; and
the first person identification unit is configured to identify a lost child as the first person based on the feature information.

### Claim 3 (depends on 2)

The person detection system according to claim 2, wherein the first person identification unit is configured to identify a child acting alone as the lost child who is the first person, based on the behavior information and the feature information.

### Claim 4 (depends on 2)

The person detection system according to claim 2, wherein the second person identification unit is configured to identify the second person as a parent of the lost child identified as the first person, based on the feature information.

### Claim 5 (depends on 1)

The person detection system according to claim 1, wherein the person extraction unit is configured to, from image information of a person taken with a camera different from the security camera, extract person information of the person,
the person detection system further comprising:
a third person identification unit configured to identify a third person from the group information, based on the person information of the person extracted from the image information taken with the camera different from the security camera; and
a fourth person identification unit configured to identify a fourth person belonging to a same group as the identified third person, based on the person information of a person identified as the third person and the group information, and also identify the fourth person from the image information taken with the security camera, based on the extracted person information,
wherein the position identification unit is configured to identify a position of the fourth person, based on position information of the security camera used for taking the image information based on which the fourth person has been specified.

### Claim 6 (depends on 5)

The person detection system according to claim 5, wherein:
the third person identification unit is configured to identify the third person as a parent; and
the fourth person identification unit is configured to identify the fourth person as a child of the parent identified as the third person.

### Claim 7 (depends on 1)

The person detection system according to claim 1, wherein the group determination unit is configured to update and register the group information based on the behavior information extracted from the new image information.

### Claim 8

A person detection method comprising:
extracting person information representing a person from image information taken with a security camera;
extracting behavior information representing behavior of the person from the image information and, based on the behavior information, determining a group composed of a plurality of persons and registering group information including the person information;
identifying a first person from the image information taken with the security camera, based on the extracted person information and the extracted behavior information;
identifying a second person belonging to a same group as the first person from the image information taken with the security camera, based on the person information of a person identified as the first person and the group information; and
identifying a position of the first person and a position of the second person, based on position information of the security cameras used for taking the image information based on which the first person and the second person have been identified, respectively.

### Claim 9 (depends on 8)

The person detection method according to claim 8, wherein:
in extracting the person information, feature information representing an external feature of a person is extracted as the person information; and
in identifying the first person, a lost child is identified as the first person based on the feature information.

### Claim 10 (depends on 9)

The person detection method according to claim 9, wherein in identifying the first person, a child acting alone is identified as the lost child who is the first person, based on the behavior information and the feature information.

### Claim 11 (depends on 9)

The person detection method according to claim 9, wherein in identifying the second person, the second person is identified as a parent of the lost child identified as the first person, based on the feature information.

### Claim 12 (depends on 8)

The person detection method according to claim 8, comprising:
identifying a third person from the group information, based on the person information of a person extracted from image information taken with a camera different from the security camera;
identifying a fourth person belonging to a same group as the identified third person, based on the person information of a person identified as the third person and the group information, and also identifying the fourth person from the image information taken with the security camera, based on the extracted person information; and
identifying a position of the fourth person, based on position information of the security camera used for taking the image information based on which the fourth person has been specified.

### Claim 13 (depends on 12)

The person detection method according to claim 12, wherein:
in identifying the third person, the third person is identified as a parent; and
in identifying the fourth person, the fourth person is identified as a child of the parent identified as the third person.

### Claim 14 (depends on 8)

The person detection method according to claim 8, wherein in registering the group information, the group information is updated and registered based on the behavior information extracted from the new image information.

### Claim 15

A non-transitory computer-readable storage medium for storing a computer program comprising instructions for causing an information processing device to realize:
a person extraction unit that extracts person information representing a person from image information taken with a security camera;
a group determination unit that extracts behavior information representing behavior of the person from the image information and, based on the behavior information, determines a group composed of a plurality of persons and registers group information including the person information;
a first person identification unit that identifies a first person from the image information taken with the security camera, based on the extracted person information and the extracted behavior information;
a second person identification unit that identifies a second person belonging to a same group as the first person from the image information taken with the security camera, based on the person information of a person identified as the first person and the group information; and
a position identification unit that identifies a position of the first person and a position of the second person, based on position information of the security cameras used for taking the image information based on which the first person and the second person have been identified, respectively.

### Claim 16 (depends on 15)

The non-transitory computer-readable storage medium for storing the computer program according to claim 15, wherein, from image information of a person taken with a camera different from the security camera, the person extraction unit extracts person information of the person,
the computer program further comprising instructions for causing the information processing device to realize:
a third person identification unit that identifies a third person from the group information, based on the person information of the person extracted from the image information taken with the camera different from the security camera; and
a fourth person identification unit that identifies a fourth person belonging to a same group as the identified third person, based on the person information of a person identified as the third person and the group information, and also identifies the fourth person from the image information taken with the security camera, based on the extracted person information,
wherein the position identification unit identifies a position of the fourth person, based on position information of the security camera used for taking the image information based on which the fourth person has been specified.
