# US 2020/0005059 A1 · Information processing device, information processing method, and information processing program product

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0005059 A1
- Document ID: US20200005059A1
- Status: Published application
- Kind: A1
- Application number: 16/567,863
- Filed: 2019-09-11
- Published: 2020-01-02
- Earliest claimed: 2018-03-22
- Assignees: Toshiba Memory Corporation
- Applicants: Toshiba Memory Corporation
- Inventors: Hideki YAMADA; Masanobu SHIRAKAWA; Marie KURONAGA
- Web page: https://patentgrep.com/patent/US20200005059A1

## CPC

- G01C 21/36: Input/output arrangements for on-board computers
- B60W 60/00253: {Taxi operations}
- G01C 21/3438: {Rendezvous; Ride sharing}
- G01C 21/3605: {Destination input or retrieval}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06V 10/75: Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G08B 21/00: Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B 21/24: Reminder alarms, e.g. anti-loss alarms
- G08B 25/00: Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B 25/04: using a single signalling line, e.g. in a closed loop
- G08B 25/10: using wireless transmission systems {(G08B25/009 takes precedence)}
- G08G 1/123: indicating the position of vehicles, e.g. scheduled vehicles; {Managing passenger vehicles circulating according to a fixed timetable, e.g. buses, trains, trams}(transmission of navigation instructions to vehicles G08G1/0968)
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04W 4/40: for vehicles, e.g. vehicle-to-pedestrians [V2P]
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

According to one embodiment, an information processing device includes: a first memory; a first receiver; a first determination section; and a first transmitter. The first memory is configured to store first image data of interior of a vehicle at a first point in time. The first receiver is configured to receive second image data of the interior of the vehicle at a second point of time from the vehicle. The first determination section is configured to determine whether a change has been caused in the interior of the vehicle between the first point in time and the second point in time. The first transmitter is configured to transmit first data based on the determination result.

## Claims

### Claim 1

An information processing device comprising:
a first memory configured to store first image data of interior of a vehicle at a first point in time;
a first receiver configured to receive second image data of the interior of the vehicle at a second point of time, which is later than the first point in time, from the vehicle by wireless communication;
a first determination section configured to determine whether a change has been caused in the interior of the vehicle between the first point in time and the second point in time, based on the first image data and the second image data; and
a first transmitter configured to transmit first data based on the determination result obtained at the first determination section, to the vehicle by wireless communication.

### Claim 2 (depends on 1)

The device according to claim 1, wherein the first determination section compares the first image data with the second image data to determine whether an article that is not present at the first point in time is present inside the vehicle at the second point in time.

### Claim 3 (depends on 2)

The device according to claim 2, wherein the article is a left-behind item of a passenger who got in the vehicle after the first point in time and got out of the vehicle before the second point in time, or soiling of the interior of the vehicle by the passenger.

### Claim 4 (depends on 1)

The device according to claim 1, wherein the vehicle includes an alert section configured to sound an alert toward outside of the vehicle, and
the first data is used for determination as to whether to cause the alert section to sound the alert to notify that a change has been caused inside the vehicle.

### Claim 5 (depends on 4)

The device according to claim 4, wherein the change inside the vehicle indicates presence of an article that is not present at the first point in time, inside the vehicle at the second point in time.

### Claim 6 (depends on 5)

The device according to claim 5, wherein the article is a left-behind item of a passenger who got in the vehicle after the first point in time and got out of the vehicle before the second point in time, or the soiling of the interior of the vehicle by the passenger, and
the alert calls attention of the passenger who has egressed the vehicle.

### Claim 7 (depends on 1)

The device according to claim 1, wherein the first determination section compares the first image data with the second image data to determine whether a left-behind item a passenger has left is inside the vehicle, and
the information processing device further comprises a second transmitter configured to, when the first determination section determines that the left-behind item is present, transmit a message that prompts the passenger to select handling of the left-behind item, to an information terminal of the passenger.

### Claim 8 (depends on 7)

The device according to claim 7, further comprising a suspension processing section configured to receive selection information relating to the handling of the left-behind item from the information terminal of the passenger, suspend services of the vehicle based on the selection information, and set a new destination for the vehicle.

### Claim 9 (depends on 1)

The device according to claim 1, wherein the vehicle is capable of autonomous driving without a driver for general passenger automobile transportation business.

### Claim 10

An information processing device comprising:
a first transmitter configured to transmit second image data of interior of a vehicle at a second point in time, which is later than a first point in time, to a server by wireless communication;
a first receiver configured to receive first data that indicates whether a change has been caused inside the vehicle between the first point in time and the second point in time, from the server by wireless communication; and
a first command section configured to issue a command to provide a notification toward outside of the vehicle based on the first data received by the first receiver.

### Claim 11 (depends on 10)

The device according to claim 10, wherein the first data transmitted from the server is information regarding whether or not an article that is not present at the first point in time is present inside the vehicle at the second point in time.

### Claim 12 (depends on 11)

The device according to claim 11, wherein the article is a left-behind item of a passenger who got in the vehicle after the first point in time and got out of the vehicle before the second point in time, or soiling of the interior of the vehicle by the passenger.

### Claim 13 (depends on 10)

The device according to claim 10, wherein the vehicle includes an alert section configured to sound an alert toward the outside of the vehicle, and
the first command section issues the command to the alert section to sound the alert to notify that a change has been caused inside the vehicle.

### Claim 14 (depends on 13)

The device according to claim 13, wherein the change inside the vehicle indicates presence of an article that is not present at the first point in time, inside the vehicle at the second point in time.

### Claim 15 (depends on 14)

The device according to claim 14, wherein the article is a left-behind item of a passenger who got in the vehicle after the first point in time and got out of the vehicle before the second point in time, or soiling of the interior of the vehicle by the passenger, and
the alert calls attention of the passenger who got out of the vehicle.

### Claim 16 (depends on 15)

The device according to claim 15, wherein sounding of the alert is stopped if a door of the vehicle is opened within a predetermined period of time, or if opening and closing is detected, after sounding the alert.

### Claim 17 (depends on 10)

The device according to claim 10, wherein the vehicle is capable of autonomous driving without a driver for general passenger automobile transportation business.

### Claim 18

An information processing device comprising:
a first determination section configured to determine whether a change has been caused between a first point in time and a second point in time in a situation inside a vehicle, based on first image data of interior of the vehicle at the first point in time and second image data of the interior of the vehicle at the second point in time that is later than the first point in time; and
a first command section configured to, when the first determination section determines that a change has been caused in the situation, issue a command to provide a notification based on the determination toward outside of the vehicle.

### Claim 19 (depends on 18)

The device according to claim 18, wherein the first determination section compares the first image data with the second image data to determine whether an article that is not present at the first point in time is present inside the vehicle at the second point in time.

### Claim 20 (depends on 18)

The device according to claim 18, wherein the vehicle includes an alert section configured to sound an alert toward the outside of the vehicle, and
the first command section issues the command to the alert section to sound the alert to notify that a change has been caused inside the vehicle.

### Claim 21 (depends on 18)

The device according to claim 18, wherein the vehicle is capable of autonomous driving without a driver for general passenger automobile transportation business.

### Claim 22

An information processing device, comprising:
a receiver configured to receive, by wireless communication, information based on a measurement value obtained by an odor sensor inside a vehicle;
a first determination section configured to determine an odor level of interior of the vehicle, based on the received information and a reference value; and
a transmitter configured to transmit to the vehicle a notification based on the determination result obtained by the first determination section.

### Claim 23 (depends on 22)

The device according to claim 22, wherein the first determination section sets a destination of the vehicle to a first destination if the odor level is lower than or equal to a first reference value, and sets the destination to a second destination, which is different from the first destination, if the odor level is greater than a second reference value.

### Claim 24 (depends on 22)

The device according to claim 22, wherein the vehicle is capable of autonomous driving without a driver for general passenger automobile transportation business.

### Claim 25

An information processing device comprising:
a first determination section configured to determine an odor level of a vehicle based on a measurement value obtained by an odor sensor inside the vehicle and a reference value, and change a destination based on the determination result.

### Claim 26 (depends on 25)

The device according to claim 25, wherein the first determination section changes the destination from a first destination to a second destination if the odor level is greater than a second reference value.

### Claim 27 (depends on 25)

The device according to claim 25, wherein the vehicle is capable of autonomous driving without a driver for general passenger automobile transportation business.

### Claim 28

An information processing device comprising:
a calculation section configured to receive a dispatch request of a driver-free autonomous driving vehicle from a first terminal, associate a first vehicle with a first user corresponding to the first terminal by referring to a first database, and calculate a fare based on first fare information corresponding to the first user by referring to a second database; and
a change section configured to receive a fare payer change request from the first vehicle, and associate the first vehicle with a second user, who is different from the first user, in the first database.

### Claim 29 (depends on 28)

The device according to claim 28, wherein the first terminal is associated with the first user, and
the first vehicle requested by the first terminal picks up the second user and receives the change request from the second user.

### Claim 30

An information processing method for controlling a driver-free autonomous driving vehicle, the method comprising:
receiving second image data of interior of the vehicle at a second point in time, which is later than a first point in time, from the vehicle by wireless communication;
determining whether a change has been caused inside the vehicle between the first point in time and the second point in time, based on first image data of interior of the vehicle at the first point in time and the second image data; and
transmitting first data based on the determination result, to the vehicle by wireless communication.

### Claim 31

An information processing program product for controlling a driver-free autonomous driving vehicle, the program product executed by a processor and causing the processor to:
receive second image data of interior of the vehicle at a second point in time, which is later than a first point in time, from the vehicle by wireless communication;
determine whether a change has been caused inside the vehicle between the first point in time and the second point in time, based on first image data of interior of the vehicle at the first point in time and the second image data; and
transmit first data based on a determination result, to the vehicle by wireless communication.
