# US 2021/0342601 A1 · Information processing system, method of information processing, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342601 A1
- Document ID: US20210342601A1
- Status: Published application
- Kind: A1
- Application number: 17/305,770
- Filed: 2021-07-14
- Published: 2021-11-04
- Earliest claimed: 2018-11-29
- Assignees: Toyota Jidosha Kabushiki Kaisha
- Applicants: Toyota Jidosha Kabushiki Kaisha
- Inventors: Hideo HASEGAWA; Keiko KAMEDA; Misa EJIRI; Shintaro NARUSE; Tadahiro KASHIWAI; Naoya OKA; Kensuke KOIKE; Hiroyuki MONJI
- Web page: https://patentgrep.com/patent/US20210342601A1

## CPC

- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/49: {Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes}
- G06V 20/53: {Recognition of crowd images, e.g. recognition of crowd congestion}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An information processing system includes a server device, and an information processing device communicable with the server device. The information processing device is configured to acquire a plurality of images imaged by an imaging device included in a vehicle, and output to the server device, when detecting a change from a non-rainfall state to a rainfall state, or a change from the rainfall state to the non-rainfall state based on the acquired images, location information regarding the vehicle when the change is detected.

## Claims

### Claim 1

An information processing system comprising:
a server device; and
an information processing device communicable with the server device, wherein
the information processing device is configured to acquire a plurality of images imaged by an imaging device included in a vehicle, and
one of the server device and the information processing device is configured to:
determine a rain gear usage rate from the acquired plurality of images,
output, when a determination is made that the rain gear usage rate increases by a prescribed value within a prescribed time interval, a notification that indicates an increase in intensity of rainfall.

### Claim 2 (depends on 1)

The information processing system according to claim 1, wherein one of the information processing device and the server device is configured to
detect, in the images, a number of persons and rain gear used by one or more persons in the detected number of persons, the rain gear usage rate being determined from a ratio of a number of rain gear users to the detected number of persons, and
determine that a non-rainfall state changes to a rainfall state when the rain gear usage rate reaches the prescribed value.

### Claim 3 (depends on 1)

The information processing system according to claim 1, wherein the server device is configured to:
acquire location information of the vehicle from the information processing device,
map locations corresponding to the location information on a map, and
output the map after mapping.

### Claim 4 (depends on 1)

The information processing system according to claim 1, wherein the server device is configured to:
acquire location information of the vehicle from the information processing device,
detect a past transition of an area having a rainfall, the area being specified based on the location information, and
predict, based on the past transition, an area where the change occurs within a prescribed future time.

### Claim 5 (depends on 4)

The information processing system according to claim 4, wherein the server device is configured to notify occurrence of the change within the prescribed future time to user terminals that are present in the area where the change is predicted to occur within the prescribed future time.

### Claim 6 (depends on 5)

The information processing system according to claim 5, wherein the server device is further configured to notify, to the user terminals that are present in the area where the change is predicted to occur within the prescribed future time, information on facilities that are present in a prescribed distance from the user terminals.

### Claim 7 (depends on 2)

The information processing system according to claim 2, wherein a location of the vehicle is correlated with a detection of a change from the non-rainfall state to the rainfall state or a change from the rainfall state to the non-rainfall state.

### Claim 8

A method of information processing executed in an information processing system, including a server device, and an information processing device communicable with the server device, the information processing device acquiring a plurality of images imaged by an imaging device included in a vehicle, the method comprising steps, executed by one of the information processing device or the server device, of:
determining a rain gear usage rate from the acquired plurality of images; and
outputting, when a determination is made that the rain gear usage rate increases by a prescribed value within a prescribed time interval, a notification that indicates an increase in intensity of rainfall.

### Claim 9 (depends on 8)

The method according to claim 8, further comprising:
detecting, in the images, a number of persons and rain gear used by one or more persons in the detected number of persons, the rain gear usage rate being determined from a ratio of a number of rain gear users to the detected number of persons, and
determining that a non-rainfall state changes to a rainfall state when the rain gear usage rate reaches the prescribed value.

### Claim 10 (depends on 8)

The method according to claim 8, further comprising the server device executing the steps of:
acquiring location information of the vehicle from the information processing device;
mapping locations corresponding to the location information on a map; and
outputting the map after the mapping.

### Claim 11 (depends on 8)

The method according to claim 8, further comprising the server device executing the steps of:
acquiring location information of the vehicle from the information processing device;
detecting a past transition of an area having a rainfall, the area being specified based on the location information; and
predict, based on the past transition, an area where the change occurs within a prescribed future time.

### Claim 12 (depends on 11)

The method according to claim 11, further comprising the server device executing the step of notifying occurrence of the change within the prescribed future time to user terminals that are present in the area where the change is predicted to occur within the prescribed future time.

### Claim 13 (depends on 12)

The method according to claim 12, further comprising the server device executing the step of notifying, to the user terminals that are present in the area where the change is predicted to occur within the prescribed future time, information on facilities that are present in a prescribed distance from the user terminals.

### Claim 14 (depends on 9)

The method according to claim 9, wherein a location of the vehicle is correlated with a detection of a change from the non-rainfall state to the rainfall state or a change from the rainfall state to the non-rainfall state.

### Claim 15

A non-transitory computer readable medium having instructions stored therein, which when executed by a processor in one of an information processing device and a server device, the information processing device being communicable with the server device in an information processing system, the information processing device acquiring a plurality of images imaged by an imaging device included in a vehicle, causes the processor to execute the steps of:
determining a rain gear usage rate from the acquired plurality of images; and
outputting, when a determination is made that the rain gear usage rate increases by a prescribed value within a prescribed time interval, a notification that indicates an increase in intensity of rainfall.

### Claim 16 (depends on 15)

The non-transitory computer readable medium according to claim 15, wherein the processor executes the steps of:
detecting, in the images, a number of persons and rain gear used by one or more persons in the detected number of persons, the rain gear usage rate being determined from a ratio of a number of rain gear users to the detected number of persons, and
determining that a non-rainfall state changes to a rainfall state when the rain gear usage rate reaches the prescribed value.

### Claim 17 (depends on 15)

The non-transitory computer readable medium according to claim 15, wherein the processor of the server device executes the steps of:
acquiring location information of the vehicle from the information processing device;
mapping locations corresponding to the location information on a map; and
outputting the map after the mapping.

### Claim 18 (depends on 15)

The non-transitory computer readable medium according to claim 15, wherein the processor of the server device executes the steps of:
acquiring location information of the vehicle from the information processing device;
detecting a past transition of an area having a rainfall, the area being specified based on the location information; and
predict, based on the past transition, an area where the change occurs within a prescribed future time.

### Claim 19 (depends on 18)

The non-transitory computer readable medium according to claim 18, wherein the processor of the server device executes the step of notifying occurrence of the change within the prescribed future time to user terminals that are present in the area where the change is predicted to occur within the prescribed future time.

### Claim 20 (depends on 19)

The non-transitory computer readable medium according to claim 19, wherein the processor of the server executes the step of notifying, to the user terminals that are present in the area where the change is predicted to occur within the prescribed future time, information on facilities that are present in a prescribed distance from the user terminals.
