# US 2021/0278835 A1 · Systems and methods for executing remotely-controlled automated vehicle parking operations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0278835 A1
- Document ID: US20210278835A1
- Status: Published application
- Kind: A1
- Application number: 16/809,101
- Filed: 2020-03-04
- Published: 2021-09-09
- Earliest claimed: 2020-03-04
- Assignees: Ford Global Technologies, LLC
- Applicants: Ford Global Technologies, LLC
- Inventors: Erick Michael Lavoie; Lawrence Chikeziri Amadi; Hemanth Yadav Aradhyula; John Robert Van Wiemeersch
- Web page: https://patentgrep.com/patent/US20210278835A1

## CPC

- G05D 1/0016: {characterised by the operator's input device (input arrangements for computing systems in general G06F3/00)}
- B60K 35/80: Arrangements for controlling instruments
- B60W 30/06: Automatic manoeuvring for parking
- G05D 1/0011: {associated with a remote control arrangement}
- G05D 1/0038: {by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation (images analyzed by a computer and used for automatic navigation G05D1/0246)}
- G05D 1/0055: {with safety arrangements}
- G06V 10/141: Control of illumination
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- G06V 20/20: in augmented reality scenes
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- B60K 2360/55: Remote control arrangements
- B60K 2360/566: Mobile devices displaying vehicle information
- B60K 2360/573: Mobile devices controlling vehicle functions
- B60W 2555/20: Ambient conditions, e.g. wind or rain
- G06V 2201/08: Detecting or categorising vehicles
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The disclosure is generally directed to remotely-controlled automated vehicle parking operations. A driver of a vehicle stands on a curb and launches a software application on a handheld device. The software application uses a camera of the handheld device to capture images of the vehicle that can be observed by the driver. The software application then attempts to obtain a visual lock between the camera and the vehicle. In some cases, obtaining the visual lock may be hampered due to adverse lighting conditions. Light may be transmitted from the handheld device to illuminate the vehicle for better image capture. Alternatively, a command can be transmitted from the handheld device to a controller in the vehicle for turning on a light in the vehicle. After obtaining visual lock, various techniques such as vehicle path prediction and interpolation, can be used for effectively tracking the vehicle.

## Claims

### Claim 1

A method comprising:
displaying, upon a display screen of a handheld device, a first image of a vehicle; and
executing a software application in the handheld device to carry out a remotely-controlled automated vehicle parking operation of the vehicle, the remotely-controlled automated vehicle parking operation comprising:
detecting an illumination level on the vehicle in the first image;
modifying the illumination level based on comparing the illumination level to a preset illumination threshold for establishing a visual lock between a camera of the handheld device and the vehicle;
establishing the visual lock between the handheld device and the vehicle after modifying the illumination level; and
using the visual lock to automatically track a movement of the vehicle during the remotely-controlled automated vehicle parking operation.

### Claim 2 (depends on 1)

The method of claim 1, wherein modifying the illumination level comprises one of increasing an amount of light emanating from the vehicle towards the camera or decreasing the amount of light emanating from the vehicle towards the camera.

### Claim 3 (depends on 2)

The method of claim 2, wherein increasing the amount of light emanating from the vehicle towards the camera comprises one of illuminating the vehicle by transmitting light from the handheld device towards the vehicle or transmitting a command from the handheld device to a light controller in the vehicle to direct the light controller to turn on a light in the vehicle.

### Claim 4 (depends on 3)

The method of claim 3, wherein illuminating the vehicle by transmitting light from the handheld device towards the vehicle comprises:
determining a state of charge of a battery in the handheld device; and
transmitting light from the handheld device towards the vehicle subject to the state of charge being above a threshold level.

### Claim 5 (depends on 2)

The method of claim 2, wherein decreasing the amount of light emanating from the vehicle towards the camera comprises transmitting a command from the handheld device to a light controller in the vehicle to direct the light controller to turn off a light in the vehicle.

### Claim 6 (depends on 2)

The method of claim 2, wherein the software application includes an interpolation procedure that predicts a direction of movement of the vehicle based on processing a set of images after the visual lock is established between the handheld device and the vehicle.

### Claim 7 (depends on 6)

The method of claim 6, wherein the interpolation procedure comprises generating a tracking diagram that includes a computer aided design (CAD) image of the vehicle.

### Claim 8

A method comprising:
determining that a camera of a handheld device is pointed towards a vehicle;
displaying, upon a display screen of the handheld device, a first image of the vehicle; and
executing a software application in the handheld device to carry out a remotely-controlled automated vehicle parking operation of the vehicle, the software application comprising a path prediction procedure that predicts a direction of movement of the vehicle during the remotely-controlled automated vehicle parking operation.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
detecting an illumination level on the vehicle in the first image;
modifying the illumination level based on comparing the illumination level to a preset illumination threshold for establishing a visual lock between a camera of the handheld device and the vehicle;
establishing the visual lock between the handheld device and the vehicle after modifying the illumination level; and
using the visual lock to automatically track a movement of the vehicle during the remotely-controlled automated vehicle parking operation.

### Claim 10 (depends on 9)

The method of claim 9, wherein modifying the illumination level comprises one of increasing an amount of light emanating from the vehicle towards the camera or decreasing the amount of light emanating from the vehicle towards the camera.

### Claim 11 (depends on 10)

The method of claim 10, wherein increasing the amount of light emanating from the vehicle towards the camera comprises one of illuminating the vehicle by transmitting light from the handheld device towards the vehicle or transmitting a command from the handheld device to a light controller in the vehicle to direct the light controller to turn on a light in the vehicle.

### Claim 12 (depends on 11)

The method of claim 11, wherein illuminating the vehicle by transmitting light from the handheld device towards the vehicle comprises:
determining a state of charge of a battery in the handheld device; and
transmitting light from the handheld device towards the vehicle subject to the state of charge being above a threshold level.

### Claim 13 (depends on 10)

The method of claim 10, wherein decreasing the amount of light emanating from the vehicle towards the camera comprises transmitting a command from the handheld device to a light controller in the vehicle to direct the light controller to turn off a light in the vehicle.

### Claim 14 (depends on 10)

The method of claim 10, wherein the software application includes an interpolation procedure that predicts a direction of movement of the vehicle based on processing a set of images after the visual lock is established between the handheld device and the vehicle.

### Claim 15

A handheld device comprising:
a display screen;
a camera;
a memory that stores computer-executable instructions; and
a processor configured to access the memory and execute the computer-executable instructions to at least:
displaying, upon a display screen, a first image of a vehicle; and
execute a remotely-controlled automated vehicle parking operation of the vehicle, the remotely-controlled automated vehicle parking operation comprising:
detecting an illumination level on the vehicle in the first image;
modifying the illumination level based on comparing the illumination level to a preset illumination threshold for establishing a visual lock between a camera of the handheld device and the vehicle;
establishing the visual lock between the handheld device and the vehicle after modifying the illumination level; and
using the visual lock to automatically track a movement of the vehicle during the remotely-controlled automated vehicle parking operation.

### Claim 16 (depends on 15)

The handheld device of claim 15, wherein modifying the illumination level comprises one of increasing an amount of light emanating from the vehicle towards the camera or decreasing the amount of light emanating from the vehicle towards the camera.

### Claim 17 (depends on 16)

The handheld device of claim 16, wherein increasing the amount of light emanating from the vehicle towards the camera comprises one of illuminating the vehicle by transmitting light from the handheld device towards the vehicle or transmitting a command from the handheld device to a light controller in the vehicle to direct the light controller to turn on a light in the vehicle.

### Claim 18 (depends on 17)

The handheld device of claim 17, wherein illuminating the vehicle by transmitting light from the handheld device towards the vehicle comprises:
determining a state of charge of a battery in the handheld device; and
transmitting light from the handheld device towards the vehicle subject to the state of charge being above a threshold level.

### Claim 19 (depends on 15)

The handheld device of claim 15, wherein the processor is configured to access the memory and execute additional computer-executable instructions to:
execute an interpolation procedure that predicts a direction of movement of the vehicle based on processing a set of images of the vehicle.

### Claim 20 (depends on 19)

The handheld device of claim 19, wherein the interpolation procedure comprises generating a tracking diagram that includes a computer aided design (CAD) image of the vehicle.
