# US 2017/0371345 A1 · Controlling host vehicle based on a predicted state of a parked vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0371345 A1
- Document ID: US20170371345A1
- Status: Published application
- Kind: A1
- Application number: 15/634,482
- Filed: 2017-06-27
- Published: 2017-12-28
- Earliest claimed: 2016-06-27
- Assignees: Mobileye Vision Technologies Ltd.
- Applicants: Mobileye Vision Technologies Ltd.
- Inventors: Barak COHEN; Gideon STEIN
- Web page: https://patentgrep.com/patent/US20170371345A1

## CPC

- G06V 20/584: {of vehicle lights or traffic lights}
- B60W 30/08: {Active safety systems} predicting or avoiding probable or impending collision {or attempting to minimise its consequences}
- B60W 60/0016: {of the vehicle or its occupants}
- G05D 1/00: Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots (drive control systems specially adapted for autonomous road vehicles B60W60/00)
- G05D 1/0246: {using a video camera in combination with image processing means}
- G05D 1/228: Command input arrangements located on-board unmanned vehicles
- G05D 1/249: from positioning sensors located off-board the vehicle, e.g. from cameras
- G06T 7/269: using gradient-based methods
- G06T 7/277: involving stochastic approaches, e.g. using Kalman filters
- G06T 7/521: from laser ranging, e.g. using interferometry; from the projection of structured light
- G06T 7/579: from motion
- G06T 7/593: from stereo images
- G06T 7/73: using feature-based methods
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V 20/586: {of parking space}
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- B60W 2554/4049: Relationship among other objects, e.g. converging dynamic objects
- G01C 21/3407: {specially adapted for specific applications}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10021: Stereoscopic video; Stereoscopic image sequence
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/10048: Infrared image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06T 2207/30256: Lane; Road marking
- G06T 2207/30261: Obstacle
- G06T 2207/30264: Parking
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)

## Abstract

Systems and methods are provided for navigating an autonomous vehicle. In one implementation, a system for determining a predicted state of a parked vehicle in an environment of a host vehicle may include an image capture device, an infrared image capture device, and at least one processing device. The processing device may be programmed to receive a plurality of images associated with the environment of the host vehicle, analyze at least one of the plurality of images to identify the parked vehicle, analyze at least two of the plurality of images to identify a change in an illumination state of at least one light associated with the parked vehicle, receive at least one thermal image of the parked vehicle, determine the predicted state of the parked vehicle, and cause at least one navigational response by the host vehicle based on the predicted state of the parked vehicle.

## Claims

### Claim 1

A system for determining a predicted state of a parked vehicle in an environment of a host vehicle, the system comprising:
an image capture device;
an infrared image capture device; and
at least one processing device programmed to:
receive, from the image capture device, a plurality of images associated with the environment of the host vehicle;
analyze at least one of the plurality of images to identify the parked vehicle;
analyze at least two of the plurality of images to identify a change in an illumination state of at least one light associated with the parked vehicle;
receive, from the infrared image capture device, at least one thermal image of the parked vehicle;
determine, based on the change in the illumination state and analysis of the at least one thermal image, the predicted state of the parked vehicle; and
cause at least one navigational response by the host vehicle based on the predicted state of the parked vehicle.

### Claim 2 (depends on 1)

The system of claim 1, wherein the change in the illumination state of the at least one light associated with the parked vehicle includes a change from a non-illuminated state to an illuminated state.

### Claim 3 (depends on 2)

The system of claim 2, wherein the predicted state of the parked vehicle includes an indication that an engine of the parked vehicle has been started.

### Claim 4 (depends on 1)

The system of claim 1, wherein the change in the illumination state of the at least one light associated with the parked vehicle includes a change from an illuminated state to a non-illuminated state.

### Claim 5 (depends on 4)

The system of claim 4, wherein the predicted state of the parked vehicle includes an indication that an engine of the parked vehicle has been turned off.

### Claim 6 (depends on 1)

The system of claim 1, wherein the analysis of the at least one thermal image includes determining a temperature value of an engine area of the parked vehicle.

### Claim 7 (depends on 6)

The system of claim 6, wherein the predicted state of the parked vehicle is determined based at least in part on a comparison of the temperature value to a threshold.

### Claim 8 (depends on 7)

The system of claim 7, wherein, when temperature value is lower than a threshold value, the predicted state of the parked vehicle includes an indication that the parked vehicle is not expected to move within a predetermined time period.

### Claim 9 (depends on 1)

The system of claim 1, wherein the analysis of the at least one thermal image includes determining a first temperature value of an engine area of the parked vehicle and a second temperature value of at least one wheel component of the parked vehicle.

### Claim 10 (depends on 9)

The system of claim 9, wherein the predicted state of the parked vehicle is determined based on a comparison of the first temperature value to a first threshold and a comparison of the second temperature value to a second threshold.

### Claim 11 (depends on 9)

The system of claim 9, wherein, when the first temperature value exceeds a first threshold and the second temperature value is lower than a second threshold, the predicted state of the parked vehicle includes an indication that the parked vehicle is expected to move within a predetermined time period.

### Claim 12 (depends on 9)

The system of claim 9, wherein, when the first temperature value exceeds a first threshold and the second temperature value exceeds a second threshold, the predicted state of the parked vehicle includes an indication that a door of the parked vehicle is expected to open within a predetermined time period.

### Claim 13 (depends on 1)

The system of claim 1, wherein the predicted state of the parked vehicle includes at least one of: an indication that the parked vehicle is not expected to move within a predetermined time period, an indication that the parked vehicle is expected to move within a predetermined time period, or an indication that a door of the parked vehicle is expected to open within a predetermined time period.

### Claim 14 (depends on 1)

The system of claim 1, wherein the at least one processing device is further programmed to:
align at least one of the plurality of images with the at least one thermal image; and
identify at least one of the engine area or at least one wheel component area of the parked vehicle in the aligned at least one thermal image.

### Claim 15

A method for determining a predicted state of a parked vehicle in an environment of a host vehicle, the method comprising:
receiving, from an image capture device, a plurality of images associated with the environment of the host vehicle;
analyzing at least one of the plurality of images to identify the parked vehicle;
analyzing at least two of the plurality of images to identify a change in an illumination state of at least one light associated with the parked vehicle;
receiving, from an infrared image capture device, at least one thermal image of the parked vehicle;
determining, based on the change in the illumination state and analysis of the at least one thermal image, the predicted state of the parked vehicle; and
causing at least one navigational response by the host vehicle based on the predicted state of the parked vehicle.

### Claim 16 (depends on 15)

The method of claim 15, wherein:
the analysis of the at least one thermal image includes determining a temperature value of an engine area of the parked vehicle, and
when the temperature value is lower than a threshold value, the predicted state of the parked vehicle includes an indication that the parked vehicle is not expected to move within a predetermined time period.

### Claim 17 (depends on 15)

The method of claim 15, wherein:
the analysis of the at least one thermal image includes determining a first temperature value of an engine area of the parked vehicle and a second temperature value of at least one wheel component of the parked vehicle, and
when the first temperature value exceeds a first threshold and the second temperature value is lower than a second threshold, the predicted state of the parked vehicle includes an indication that the parked vehicle is expected to move within a predetermined time period.

### Claim 18 (depends on 15)

The method of claim 15, wherein:
the analysis of the at least one thermal image includes determining a first temperature value of an engine area of the parked vehicle and a second temperature value of at least one wheel component of the parked vehicle, and
when the first temperature value exceeds a first threshold and the second temperature value exceeds a second threshold, the predicted state of the parked vehicle includes an indication that a door of the parked vehicle is expected to open within a predetermined time period.

### Claim 19 (depends on 15)

The method of claim 15, further comprising:
aligning at least of the plurality of images with the at least one thermal image; and
identifying at least one of the engine area or at least one wheel component area of the parked vehicle in the aligned at least one thermal image.

### Claim 20

A non-transitory computer-readable medium storing instructions, which, when executed by at least one processing device, perform a method comprising:
receiving, from an image capture device, a plurality of images associated with an environment of a host vehicle;
analyzing at least one of the plurality of images to identify a parked vehicle;
analyzing at least two of the plurality of images to identify a change in an illumination state of at least one light associated with the parked vehicle;
receiving, from an infrared image capture device, at least one thermal image of the parked vehicle;
determining, based on the change in the illumination state and analysis of the at least one thermal image, the predicted state of the parked vehicle; and
causing at least one navigational response by the host vehicle based on the predicted state of the parked vehicle.

### Claim 21

A system for determining a predicted state of a parked vehicle in an environment of a host vehicle, the system comprising:
an image capture device;
at least one processing device programmed to:
receive, from the image capture device, a plurality of images associated with the environment of the host vehicle;
analyze at least one of the plurality of images to identify the parked vehicle;
analyze at least two of the plurality of images to identify a change in an illumination state of at least one light associated with the parked vehicle;
determine, based on the change in the illumination state, the predicted state of the parked vehicle; and
cause at least one navigational response by the host vehicle based on the predicted state of the parked vehicle.

### Claim 22 (depends on 21)

The system of claim 21, wherein the change in the illumination state of the at least one light associated with the parked vehicle includes a change from a non-illuminated state to an illuminated state.

### Claim 23 (depends on 22)

The system of claim 22, wherein the predicted state of the parked vehicle includes an indication that an engine of the parked vehicle has been started.

### Claim 24 (depends on 21)

The system of claim 21, wherein the change in the illumination state of the at least one light associated with the parked vehicle includes a change from an illuminated state to a non-illuminated state.

### Claim 25 (depends on 24)

The system of claim 24, wherein the predicted state of the parked vehicle includes an indication that an engine of the parked vehicle has been turned off.
