# US 2021/0279740 A1 · System and method for handling lost item in autonomous vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279740 A1
- Document ID: US20210279740A1
- Status: Published application
- Kind: A1
- Application number: 16/891,869
- Filed: 2020-06-03
- Published: 2021-09-09
- Earliest claimed: 2020-03-03
- Assignees: Hyundai Motor Company; Kia Motors Corporation
- Applicants: Hyundai Motor Company; Kia Motors Corporation
- Inventors: Eun Young CHOI; Dong Il YANG; Jin Su JEONG; Ki Seok SEONG; Min Sang YU; Hyeong Jin HAM; Rosali Sun PYUN; Pil Cheon JANG; Woo Jin KIM
- Web page: https://patentgrep.com/patent/US20210279740A1

## CPC

- G06Q 30/016: After-sales
- G01G 19/12: having electrical weight-sensitive devices
- G01S 15/04: Systems determining presence of a target
- G01S 17/04: Systems determining the presence of a target
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06Q 20/085: {involving remote charge determination or related payment systems}
- G06Q 20/3224: {Transactions dependent on location of M-devices}
- G06Q 20/3278: {RFID or NFC payments by means of M-devices}
- G06Q 20/40155: {for triggering transactions}
- G06Q 50/40: Business processes related to the transportation industry (shipping G06Q10/083)
- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V 20/593: {Recognising seat occupancy}
- G08B 21/24: Reminder alarms, e.g. anti-loss alarms
- G08G 1/20: {Monitoring the location of vehicles belonging to a group, e.g. fleet of vehicles, countable or determined number of vehicles}
- H04W 4/44: for communication between vehicles and infrastructures, e.g. vehicle-to-cloud [V2C] or vehicle-to-home [V2H]
- G01G 19/4142: {for controlling activation of safety devices, e.g. airbag systems (electrical circuits for triggering safety arrangements in case of vehicle accidents B60R21/015)}
- G05D 1/0088: {characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours (using knowledge based models G06N5/00)}
- G06Q 2240/00: Transportation facility access, e.g. fares, tolls or parking
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G01G: WEIGHING (sorting by weighing B07C5/16)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES

## Abstract

A system for handling a lost item in an autonomous vehicle and a server. The vehicle includes a vision sensor configured to respectively capture a first vehicle interior image and a second vehicle interior image when a passenger boards and alights from the vehicle. The vehicle is configured to transmit the captured first vehicle interior image and second vehicle interior image to the server. The server is configured to compare the first vehicle interior image with the second vehicle interior image and transmit lost item information to the passenger when the lost item in the vehicle is sensed.

## Claims

### Claim 1

A system for handling a lost item in an autonomous vehicle, the system comprising:
the vehicle including a vision sensor configured to respectively capture a first vehicle interior image and a second vehicle interior image when a passenger boards and alights from the vehicle, the vehicle configured to transmit the captured first vehicle interior image and second vehicle interior image to a server; and
the server configured to compare the first vehicle interior image with the second vehicle interior image and to transmit lost item information to a user terminal associated with the passenger when the lost item in the vehicle is sensed.

### Claim 2 (depends on 1)

The system of claim 1, wherein the vehicle is configured to determine, based on whether the passenger agreed, a time point before the boarding or after the boarding as a first capturing time point, and a time point after the alighting or before the alighting as a second capturing time point.

### Claim 3 (depends on 2)

The system of claim 2, wherein the vehicle is configured to blur or delete a region matching a boarding location of another passenger in the first vehicle interior image in a state where the another passenger is boarded the vehicle at the first capturing time point.

### Claim 4 (depends on 2)

The system of claim 2, wherein the vehicle is configured to blur or delete a region matching a boarding location of another passenger in the second vehicle interior image in a state where the another passenger is boarded the vehicle at the second capturing time point.

### Claim 5 (depends on 1)

The system of claim 1, wherein the vehicle is configured to determine whether the vehicle has arrived at a calling location based on a vehicle location.

### Claim 6 (depends on 5)

The system of claim 5, wherein the vehicle is configured to determine whether the vehicle has arrived at the calling location additionally based on at least one of a vehicle speed and/or brake state information.

### Claim 7 (depends on 1)

The system of claim 1, wherein the vehicle is configured to sense a time point before the boarding of the passenger based on door status information.

### Claim 8 (depends on 1)

The system of claim 1, wherein the vehicle is configured to sense the passenger based on information provided by at least one of a weight sensor, the vision sensor, a camera, an ultrasonic sensor, and/or a radar.

### Claim 9 (depends on 1)

The system of claim 1, wherein the vehicle is configured to determine service end of the passenger based on completion of service fee payment and occupant location information.

### Claim 10 (depends on 1)

The system of claim 1, wherein the vehicle is configured to determine a time point after the alighting of the passenger, based on at least one of door status information, an external button signal, information provided by a weight sensor, information provided by an ultrasonic sensor, information provided by a radar, and/or information provided by the vision sensor.

### Claim 11 (depends on 1)

The system of claim 1, wherein the server is configured to transmit the lost item information to a business operator when the lost item in the vehicle is sensed.

### Claim 12 (depends on 11)

The system of claim 11, wherein the lost item in the vehicle is at least one of belongings of the passenger, a trash, and/or a garbage.

### Claim 13

A method for handling a lost item in an autonomous vehicle, the method comprising:
a first step of receiving, by a server, a first vehicle interior image and a second vehicle interior image respectively captured through a vision sensor when a passenger boards and alights from the vehicle;
a second step of comparing, by the server, the first vehicle interior image with the second vehicle interior image and to sense the lost item in the vehicle; and
a third step of transmitting, by the server, lost item information to a user terminal associated with the passenger.

### Claim 14 (depends on 13)

The method of claim 13, wherein the first step includes:
determining a time point before the boarding or after the boarding as a first capturing time point based on whether the passenger agreed to be captured; and
determining a time point after the alighting or before the alighting as a second capturing time point based on whether the passenger agreed to be captured.

### Claim 15 (depends on 14)

The method of claim 14, wherein the first step includes:
blurring or deleting a region matching a boarding location of another passenger in the first vehicle interior image when the another passenger exists in the vehicle at the first capturing time point.

### Claim 16 (depends on 14)

The method of claim 14, wherein the first step includes:
blurring or deleting a region matching a boarding location of another passenger in the second vehicle interior image in a state where the another passenger is boarded the vehicle at the second capturing time point.

### Claim 17 (depends on 13)

The method of claim 13, wherein the first step includes:
determining, by the vehicle, whether the vehicle has arrived at a calling location based on a vehicle location.

### Claim 18 (depends on 17)

The method of claim 17, wherein the first step further includes:
determining, by the vehicle, whether the vehicle has arrived at the calling location additionally based on at least one of a vehicle speed and/or brake state information.

### Claim 19 (depends on 13)

The method of claim 13, wherein the first step includes:
sensing, by the vehicle, a time point before the boarding of the passenger based on door status information.

### Claim 20 (depends on 13)

The method of claim 13, wherein the first step includes:
sensing, by the vehicle, the passenger based on information provided by at least one of a weight sensor, the vision sensor, a camera, an ultrasonic sensor, and/or a radar.

### Claim 21 (depends on 13)

The method of claim 13, wherein the first step includes:
determining, by the vehicle, service end of the passenger based on completion of service fee payment and occupant location information.

### Claim 22 (depends on 13)

The method of claim 13, wherein the first step further includes:
sensing a time point after the alighting of the passenger, by the vehicle, based on at least one of door status information, an external button signal, information provided by a weight sensor, information provided by an ultrasonic sensor, information provided by a radar, and/or information provided by the vision sensor.

### Claim 23 (depends on 13)

The method of claim 13, wherein the first step further includes:
transmitting, by the server, the lost item information to a business operator when the lost item in the vehicle is sensed.

### Claim 24 (depends on 23)

The method of claim 23, wherein the lost item in the vehicle is at least one of belongings of the passenger, a trash, and/or a garbage.