# US 2019/0244042 A1 · Rider rating systems and methods for shared autonomous vehicles

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0244042 A1
- Document ID: US20190244042A1
- Status: Published application
- Kind: A1
- Application number: 15/887,057
- Filed: 2018-02-02
- Published: 2019-08-08
- Earliest claimed: 2018-02-02
- Assignees: GM Global Technology Operations LLC
- Applicants: GM Global Technology Operations LLC
- Inventors: Mingyang YANG; Orhan DEMIROVIC; Alicia BIDWELL
- Web page: https://patentgrep.com/patent/US20190244042A1

## CPC

- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06Q 30/0282: Rating or review of business operators or products
- G05D 1/0287: {involving a plurality of land vehicles, e.g. fleet or convoy travelling (traffic control systems for road vehicles G08G1/00, particularly anticollision systems G08G1/16)}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES

## Abstract

A system for rating a rider of a shared autonomous vehicle (SAV) may include an image reception module, an image comparison module, an object determination module, and a passenger rating module. The image reception module may be configured to obtain first and second images of a cabin of the SAV at different times. The image comparison module may be configured to compare the first image with the second image to provide comparison data. The object determination module may be configured to (i) identify an object in the cabin of the SAV based on the comparison data and (ii) classify the identified object as a particular type of object to provide a classified object. The passenger rating module may be configured to adjust a rider rating associated with the rider based on the classified object.

## Claims

### Claim 1

A system for rating a rider of a shared autonomous vehicle (SAV), the system comprising:
a processor; and
a non-transitory computer readable medium including instructions executed by the processor for:
obtaining, using a camera, a first image of a cabin of the SAV prior to the SAV departing on a trip associated with the rider;
obtaining, using the camera, a second image of the cabin of the SAV after the SAV has departed on the trip;
comparing the first image with the second image to provide comparison data;
identifying an object in the cabin of the SAV based on the comparison data;
classifying the identified object as a particular type of object to provide a classified object by comparing an image of the identified object to images of objects stored in a database; and
adjusting a rider rating associated with the rider based on the classified object to provide an adjusted rider rating.

### Claim 2 (depends on 1)

The system of claim 1, wherein the instructions further include instructions for:
adjusting a trip rate associated with the rider based on the adjusted rider rating to provide an adjusted trip rate.

### Claim 3 (depends on 2)

The system of claim 2, wherein the instructions for adjusting the trip rate include instructions for adjusting the trip rate by performing at least one of:
initiating the trip rate;
maintaining the trip rate;
increasing the trip rate; and
decreasing the trip rate.

### Claim 4 (depends on 1)

The system of claim 1, wherein the instructions for adjusting the rider rating include instructions for adjusting the rider rating by performing at least one of:
initiating the rider rating;
maintaining the rider rating;
increasing the rider rating; and
decreasing the rider rating.

### Claim 5 (depends on 1)

The system of claim 1, wherein the instructions for obtaining the second image include instructions for obtaining the second image of the cabin of the SAV after the SAV has departed on the trip by obtaining the second image after the SAV has reached a destination associated with the trip.

### Claim 6 (depends on 1)

The system of claim 1, wherein the instructions for obtaining the second image include instructions for obtaining the second image of the cabin of the SAV after the SAV has departed on the trip by obtaining the second image prior to the SAV reaching a destination associated with the trip.

### Claim 7 (depends on 1)

The system of claim 1, wherein the instructions for obtaining the first image include instructions for obtaining the first image of the cabin of the SAV prior to the SAV departing on the trip by obtaining the first image prior to the rider entering the SAV.

### Claim 8 (depends on 1)

The system of claim 1, wherein the instructions for obtaining the first image include instructions for obtaining the first image of the cabin of the SAV prior to the SAV departing on the trip by obtaining the first image after the rider has entered the SAV.

### Claim 9 (depends on 1)

The system of claim 1, wherein the instructions for comparing the first image with the second image include instructions for comparing the first image with the second image by:
dividing the first image and the second image into a plurality of regions; and
comparing a first region of the first image to a second region of the second image to provide the comparison data, wherein the first region of the first image corresponds to the second region of the second image.

### Claim 10 (depends on 9)

The system of claim 9, wherein the instructions for comparing the first region to the second region include instructions for comparing the first region of the first image to the second region of the second image by detecting a change in pixel values between the first region and the second region.

### Claim 11 (depends on 9)

The system of claim 9, wherein the plurality of regions comprise two or more of the following regions of the SAV: a front left seat, a front middle seat, a front right seat, a rear left seat, a rear right seat, a rear middle seat, a front left floor, a front right floor, a rear left floor, a rear right floor, a rear middle floor, a dashboard, a cup holder, a center console, a trunk area, and surface adjacent a rear window.

### Claim 12

(canceled)

### Claim 13

A system for rating a rider of a shared autonomous vehicle (SAV), the system comprising:
a processor; and
a non-transitory computer readable medium including instructions executed by the processor for:
obtaining, using a camera, a first image of a cabin of the SAV prior to the SAV departing on a trip associated with the rider;
obtaining, using the camera, a second image of the cabin of the SAV after the SAV has departed on the trip;
comparing the first image with the second image to provide comparison data;
identifying an object in the cabin of the SAV based on the comparison data;
classifying the identified object as a particular type of object to provide a classified object by performing at least one of edge matching, greyscale matching, and gradient matching; and
adjusting a rider rating associated with the rider based on the classified object to provide an adjusted rider rating.

### Claim 14 (depends on 1)

The system of claim 1, wherein the instructions further include instructions for:
generating a notification based on the classified object.

### Claim 15 (depends on 14)

The system of claim 14, wherein the instructions for generating the notification include instructions for generating the notification by performing at least one of:
flashing one or more lights of the SAV; and
honking a horn of the SAV.

### Claim 16 (depends on 14)

The system of claim 14, wherein the instructions include instructions for:
transmitting the generated notification to an electronic device associated with the rider.

### Claim 17

(canceled)

### Claim 18 (depends on 1)

A shared autonomous vehicle (SAV) comprising:
the system of claim 1.

### Claim 19

A method for rating a rider of a shared autonomous vehicle (SAV), the method comprising:
obtaining, by a camera, a first image of a cabin of the SAV prior to the SAV departing on a trip associated with the rider;
obtaining, by the camera, a second image of the cabin of the SAV after the SAV has departed on the trip;
comparing, by a processor, the first image with the second image to provide comparison data;
identifying, by the processor, an object in the cabin of the SAV based on the comparison data;
classifying, by the processor, the identified object as a particular type of object to provide a classified object by one of:
comparing an image of the identified object to images of objects stored in a database; and
performing at least one of edge matching, greyscale matching, and gradient matching; and
adjusting, by the processor, a rider rating associated with the rider based on the classified object to provide an adjusted rider rating.

### Claim 20 (depends on 19)

The method of claim 19, further comprising:
adjusting, by the processor, a trip rate associated with the rider based on the adjusted rider rating.
