# US 2017/0284148 A1 · Detecting objects within a vehicle in connection with a service

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0284148 A1
- Document ID: US20170284148A1
- Status: Published application
- Kind: A1
- Application number: 15/629,372
- Filed: 2017-06-21
- Published: 2017-10-05
- Earliest claimed: 2015-05-11
- Assignees: Uber Technologies, Inc.
- Applicants: Uber Technologies, Inc.
- Inventors: David McAllister Bradley; Jean-Sebastien Valois
- Web page: https://patentgrep.com/patent/US20170284148A1

## CPC

- E05F 15/70: with automatic actuation
- B60N 2/002: {Seats provided with an occupancy detection means mounted therein or thereon (detection means responsive to presence or absence of children B60N2/266)}
- B60R 11/04: Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
- G05D 1/00: Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots (drive control systems specially adapted for autonomous road vehicles B60W60/00)
- G05D 1/0212: {with means for defining a desired trajectory (involving a plurality of land vehicles G05D1/0287)}
- G05D 1/0276: {using signals provided by a source external to the vehicle (involving a plurality of vehicles G05D1/0287; automatically controlling vehicle speed responsive to externally generated signals B60K31/0058)}
- G06Q 10/08: Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q 10/083: Shipping
- G06Q 50/40: Business processes related to the transportation industry (shipping G06Q10/083)
- G08B 21/24: Reminder alarms, e.g. anti-loss alarms
- B60N 2210/24: Cameras
- E05Y 2400/446: Vehicle state sensors, e.g. parked or inclination
- E05Y 2400/45: Control modes
- E05Y 2900/548: Trunk lids
- E05F: DEVICES FOR MOVING WINGS INTO OPEN OR CLOSED POSITION; CHECKS FOR WINGS; WING FITTINGS NOT OTHERWISE PROVIDED FOR, CONCERNED WITH THE FUNCTIONING OF THE WING
- B60N: SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- E05Y: INDEXING SCHEME ASSOCIATED WITH SUBCLASSES E05D AND E05F, RELATING TO CONSTRUCTION ELEMENTS, ELECTRIC CONTROL, POWER SUPPLY, POWER SIGNAL OR TRANSMISSION, USER INTERFACES, MOUNTING OR COUPLING, DETAILS, ACCESSORIES, AUXILIARY OPERATIONS NOT OTHERWISE PROVIDED FOR, APPLICATION THEREOF

## Abstract

A system for monitoring a vehicle used in providing a service is disclosed. The system detects when the service is complete, and upon detecting that the service is complete, the system determines, from one or more sensors of the vehicle, that an object which should have been removed from the vehicle after completion of the transport service, remains in the vehicle. The system then automatically initiates performance of a remedial action.

## Claims

### Claim 1

A method for monitoring a vehicle that is operating to provide a transport service, the method being implemented by one or more processors and comprising:
receiving, from a remote system, instructions for the vehicle to provide a first transport service from a start location to a destination;
after the vehicle arrives at or is within a first predetermined distance of the start location, receiving first image information of an interior of the vehicle from one or more cameras positioned within the vehicle;
after completion of the first transport service, receiving second image information of the interior of the vehicle from the one or more cameras positioned within the vehicle;
comparing the first image information and the second image information; and
in response to detecting a discrepancy between the first image information and the second image information, automatically initiating performance of a remedial action.

### Claim 2 (depends on 1)

The method of claim 1, wherein the discrepancy identifies damage to the vehicle, including a stain, spill, rip, or scratch.

### Claim 3 (depends on 1)

The method of claim 1, wherein the discrepancy identifies an object in the second image information which was not present in the first image information.

### Claim 4 (depends on 3)

The method of claim 3, further comprising performing an image recognition process on the first image information and the second image information to recognize the object based on visual characteristics.

### Claim 5 (depends on 3)

The method of claim 3, wherein automatically initiating performance of the remedial action includes transmitting a notification that the object is still present in the vehicle to a computing system that arranged the first transport service.

### Claim 6 (depends on 3)

The method of claim 3, further comprising:
scheduling an additional transport service to deliver the object to a specified location in response to receiving a request from a user of the first transport service to deliver the object to the specified location.

### Claim 7 (depends on 3)

The method of claim 3, wherein automatically initiating performance of the remedial action includes causing the vehicle to remain stationary at a specified location until the object is detected as being removed from the vehicle.

### Claim 8 (depends on 1)

The method of claim 1, wherein automatically initiating performance of the remedial action includes communicating, over one or more networks, a message to a computing device associated with a user of the first transport service, the message notifying the user of the discrepancy between the first image information and the second image information.

### Claim 9 (depends on 8)

The method of claim 8, wherein the message includes an image of the discrepancy or results of the comparison between the first image information and the second image information.

### Claim 10

A vehicle comprising:
one or more sensors generating sensor data; and
a control system to execute instructions that cause the vehicle to:
operate to provide a first transport service;
receive, from a remote system, instructions for the vehicle to provide a first transport service from a start location to a destination;
after the vehicle arrives at or is within a first predetermined distance of the start location, receive first image information of an interior of the vehicle from one or more cameras positioned within the vehicle;
after completion of the first transport service, receive second image information of the interior of the vehicle from the one or more cameras positioned within the vehicle;
compare the first image information and the second image information; and
in response to detecting a discrepancy between the first image information and the second image information, automatically initiate performance of a remedial action.

### Claim 11 (depends on 10)

The vehicle of claim 10, wherein the discrepancy identifies damage to the vehicle, including a stain, spill, rip, or scratch.

### Claim 12 (depends on 10)

The vehicle of claim 10, wherein the discrepancy identifies an object in the second image information which was not present in the first image information.

### Claim 13 (depends on 12)

The vehicle of claim 12, further comprising performing an image recognition process on the first image information and the second image information to recognize the object based on visual characteristics.

### Claim 14 (depends on 12)

The vehicle of claim 12, wherein automatically initiating performance of the remedial action includes transmitting a notification that the object is still present in the vehicle to a computing system that arranged the first transport service.

### Claim 15 (depends on 12)

The vehicle of claim 12, further comprising:
scheduling an additional transport service to deliver the object to a specified location in response to receiving a request from a user of the first transport service to deliver the object to the specified location.

### Claim 16 (depends on 12)

The vehicle of claim 12, wherein automatically initiating performance of the remedial action includes causing the vehicle to remain stationary at a specified location until the object is detected as being removed from the vehicle.

### Claim 17 (depends on 10)

The vehicle of claim 10, wherein automatically initiating performance of the remedial action includes communicating, over one or more networks, a message to a computing device associated with a user of the first transport service, the message notifying the user of the discrepancy between the first image information and the second image information.

### Claim 18 (depends on 17)

The vehicle of claim 17, wherein the message includes an image of the discrepancy or results of the comparison between the first image information and the second image information.

### Claim 19

A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of an on-board computing system of a vehicle, causes the on-board computing system to:
operate to provide a first transport service;
receive, from a remote system, instructions for the vehicle to provide a first transport service from a start location to a destination;
after the vehicle arrives at or is within a first predetermined distance of the start location, receive first image information of an interior of the vehicle from one or more cameras positioned within the vehicle;
after completion of the first transport service, receive second image information of the interior of the vehicle from the one or more cameras positioned within the vehicle;
compare the first image information and the second image information; and
in response to detecting a discrepancy between the first image information and the second image information, automatically initiate performance of a remedial action.

### Claim 20 (depends on 19)

The non-transitory computer-readable medium of claim 19, wherein the discrepancy identifies an object in the second image information which was not present in the first image information.
