# US 2020/0005044 A1 · Left object detecting system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0005044 A1
- Document ID: US20200005044A1
- Status: Published application
- Kind: A1
- Application number: 16/438,525
- Filed: 2019-06-12
- Published: 2020-01-02
- Earliest claimed: 2018-06-29
- Assignees: Kabushiki Kaisha Toshiba; Toshiba Infrastructure Systems & Solutions Corporation
- Applicants: Kabushiki Kaisha Toshiba; Toshiba Infrastructure Systems & Solutions Corporation
- Inventors: Kohta NAKAMURA
- Web page: https://patentgrep.com/patent/US20200005044A1

## CPC

- G06V 20/42: {of sport video content}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G08B 21/24: Reminder alarms, e.g. anti-loss alarms
- G06V 20/44: {Event detection}
- G08B 13/196: using television cameras
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS

## Abstract

A system according to an embodiment includes an analyzing device that includes a first database to store image analysis information identifying a person and an object, and determines that the object has been left behind, by using the image analysis information and performing image analysis on video footage captured by cameras installed in locations, associating the identified person with an object carried by the person, and comparing, at timings, the video footage captured by the cameras; and a communication device that includes a second database to store, in association with each other, usage to information and ID information of each of users, and transmit, when the analyzing device has determined that the object has been left behind, an alert to the user or a predetermined destination of notification associated with the object left behind.

## Claims

### Claim 1

A left object detecting system, comprising:
an image analyzing device that includes a first database configured to store at least image analysis information identifying a person and an object in an image, and determines that the object has been left behind, by using the image analysis information and performing image analysis on video footage captured by cameras installed in a plurality of locations, associating the identified person with an object carried by the person, and comparing, at a plurality of timings, the video footage captured by the cameras; and
a communication device that includes a second database configured to store, in association with each other, usage information and ID information of each of a plurality of users, and transmit, when the image analyzing device has determined that the object has been left behind, an alert to the user or a predetermined destination of notification associated with the object left behind.

### Claim 2 (depends on 1)

The left object detecting system according to claim 1, wherein the image analyzing device further comprises:
a video footage information gathering unit configured to gather a plurality of the video footage captured by the cameras;
a learning unit configured to perform, by using the image analysis information, an image processing for identifying the person and the object in an image based on the video footage gathered by the video footage information gathering unit;
an associating unit configured to associate the person and an object carried by the person based on the person and the object identified by the learning unit;
a left object detecting unit configured to judge whether or not an object carried by the user should be detected as left behind, by receiving the usage information and the ID information and recognizing that, based on the information on the person and the object carried by the person associated with each other, and the usage information, the user and the object carried by the user as belonging together; and
a detection result transmitting unit configured to transmit a detection result that an object has been left behind to the communication device.

### Claim 3 (depends on 1)

The left object detecting system according to claim 1, wherein the communication device further comprises:
a user information managing unit configured to transmit a plurality of the usage information and the ID information of the users to the image analyzing device; and
a left object notifying unit configured to receive a detection result that an object has been left behind, and transmit an alert to the user or the predetermined destination of notification associated with the object left behind.

### Claim 4 (depends on 2)

The left object detecting system according to claim 2, wherein the communication device further comprises:
a user information managing unit configured to transmit a plurality of the usage information and the ID information of the users to the image analyzing device; and
a left object notifying unit configured to receive a detection result that an object has been left behind, and transmit an alert to the user or the predetermined destination of notification associated with the object left behind.

### Claim 5 (depends on 3)

The left object detecting system according to claim 3, wherein the left object notifying unit is configured to transmit an alert to the user associated with the object left behind via at least one of: a contactless IC card, an e-mail, a short e-mail of the user.

### Claim 6 (depends on 4)

The left object detecting system according to claim 4, wherein the left object notifying unit is configured to transmit an alert to the user associated with the object left behind via at least one of: a contactless IC card, an e-mail, a short e-mail of the user.

### Claim 7 (depends on 3)

The left object detecting system according to claim 3, wherein
the cameras are installed in a plurality of locations of a transportation facility, and
the predetermined destination of notification includes a ground system of the transportation facility.

### Claim 8 (depends on 4)

The left object detecting system according to claim 4, wherein
the cameras are installed in a plurality of locations of a transportation facility, and
the predetermined destination of notification includes a ground system of the transportation facility.

### Claim 9 (depends on 2)

The left object detecting system according to claim 2, wherein
the cameras are installed in a plurality of locations of a transportation facility, and
the left object detecting unit is configured to detect whether or not an object has been left behind on a vehicle, by receiving the usage information from the communication device, recognizing that, based on the person and the object stored in the first data base in association with each other, the user and the object carried by the user belong together, and comparing, based on the usage information, an image before the user disembarked the vehicle to an image after the user disembarked the vehicle.

### Claim 10 (depends on 6)

The left object detecting system according to claim 6, wherein the left object detecting unit is configured to determine that an object has been left behind, if, after comparing the image before the user disembarked the vehicle to the image after the user disembarked the vehicle, a feature of an object carried by the user has changed.

### Claim 11 (depends on 6)

The left object detecting system according to claim 6, wherein the left object detecting unit is configured to determine that an object has been left behind, if it is detected that only the user has disembarked the vehicle.

### Claim 12 (depends on 2)

The left object detecting system according to claim 2, wherein the left object detecting unit is configured to determine that the user and the object carried by the user are further apart than a predetermined distance.

### Claim 13 (depends on 2)

The left object detecting system according to claim 2, wherein the left object detecting unit is configured to not perform a detection of whether an object has been left behind with regard to the person who has not been associated with the object.

### Claim 14 (depends on 2)

The left object detecting system according to claim 2, wherein the left object detecting unit is configured to perform the detection of whether an object has been left behind by recognizing, based on the user and the object stored in association with each other in the first database, that the user and the object carried by the user belong together, and using the part of the image of a predetermined range including the user and the object carried by the user.

### Claim 15 (depends on 2)

The left object detecting system according to claim 2, wherein the video footage information gathering unit can gather, based on the usage information received from the communication device, a part of the video footage captured by the cameras.

### Claim 16 (depends on 3)

The left object detecting system according to claim 3, wherein
the user information managing unit is configured to notify, when a feedback on the alert has been received, the image analyzing device of the feedback's content, and
the first database is configured to store a success count of the result of detection updated based on the feedback's content.

### Claim 17 (depends on 4)

The left object detecting system according to claim 4, wherein
the user information managing unit is configured to notify, when a feedback on the alert has been received, the image analyzing device of the feedback's content, and
the first database is configured to store a success count of the re suit of detection updated based on the feedback's content.
