# US 11,897,453 B2 · Parking spot detection reinforced by scene classification

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,897,453 B2
- Document ID: US11897453B2
- Status: Granted
- Kind: B2
- Application number: 17/134,750
- Filed: 2020-12-28
- Published: 2022-06-30
- Granted: 2024-02-13
- Earliest claimed: 2020-12-28
- Assignees: Continental Automotive Systems, Inc.
- Applicants: Continental Automotive Systems, Inc.
- Inventors: Julien Ip; Eduardo Jose Ramirez Llanos; Xin Yu; Kyle Carpenter
- Web page: https://patentgrep.com/patent/US11897453B2

## CPC

- B60W 30/06: Automatic manoeuvring for parking
- B62D 15/0285: {Parking performed automatically}
- G06N 3/02: Neural networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/09: Supervised learning
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/82: using neural networks
- G06V 20/582: {of traffic signs}
- G06V 20/586: {of parking space}
- G08G 1/145: {where the indication depends on the parking areas}
- B60W 2420/403: Image sensing, e.g. optical camera
- B62D 13/06: for backing a normally drawn trailer
- G06N 3/08: Learning methods
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30264: Parking
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B62D: MOTOR VEHICLES; TRAILERS (steering, or guiding on a desired track, of agricultural machines or implements A01B69/00; wheels, castors, axles, increasing wheel adhesion B60B; vehicle tyres, tyre inflation or tyre changing B60C; connections between vehicles of a train or the like B60D; vehicles for use on rail and road, amphibious or convertible vehicles B60F; suspension arrangements B60G; heating, cooling, ventilating or other air treating devices B60H; windows, windscreens, non-fixed roofs, doors or similar devices, protective coverings for vehicles not in use B60J; propulsion plant arrangements, auxiliary drives, transmissions, controls, instrumentation or dashboards B60K; electric equipment or propulsion of electrically-propelled vehicles B60L; power supply for electrically-propelled vehicles B60M; passenger accommodation not otherwise provided for B60N; adaptations for load transportation or to carry special loads or objects B60P; arrangement of signalling or lighting devices, the mounting or supporting thereof or circuits therefor, for vehicles in general B60Q; vehicles, vehicle fittings or vehicle parts not otherwise provided for B60R; servicing, cleaning, repairing, supporting, lifting, or manoeuvring, not otherwise provided for, B60S; brake arrangements, brake control systems or parts thereof B60T; air-cushion vehicles B60V; motor-cycles, accessories therefor B62J, B62K; testing of vehicles G01M)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

An automated parking system for a vehicle includes a camera configured to obtain images of objects proximate the vehicle, and a controller configured to review the obtained images of objects proximate the vehicle to classify an environment proximate the vehicle, determine a type of parking lot associated with the classified location and initiate an automated parking function of the vehicle corresponding to the determined type of parking lot.

## Claims

### Claim 1

An automated parking system for a vehicle, the automated parking system comprising:
a camera mounted to the vehicle configured to obtain the images of an environment surrounding the vehicle; and a processor configured to execute an artificial intelligence algorithm configured to detect a parking lot comprising unmarked parking areas based on input images, determine the environment surrounding the vehicle is the parking lot comprising unmarked parking areas based on the images of the environment surrounding the vehicle thorough execution of the artificial intelligence algorithm, determine an unmarked parking area from among the unmarked parking areas within the parking lot to park the vehicle, and control an automated parking function of the vehicle to park the vehicle in the unmarked parking area, wherein the environment surrounding the vehicle comprises structures, and wherein the artificial intelligence algorithm is configured to classify the environment surrounding the vehicle as the parking lot based on types of the structures.

### Claim 2 (depends on 1)

The automated parking system as recited in claim 1, wherein the artificial intelligence algorithm includes a neural network configured to classify the environment surrounding the vehicle based on a comparison of stored images corresponding to a known parking lot and the obtained images.

### Claim 3 (depends on 1)

The automated parking system as recited in claim 1, wherein the processor is configured to execute the automated parking function to park the vehicle within the unmarked parking area of the parking lot based on a configuration of the vehicle.

### Claim 4 (depends on 3)

The automated parking system as recited in claim 3, wherein the configuration of the vehicle includes a trailer.

### Claim 5 (depends on 1)

The automated parking system as recited in claim 1, wherein a structure among the structures is a building.

### Claim 6 (depends on 1)

The automated parking system as recited in claim 1, wherein a structure among the structures is a sign.

### Claim 7

A method of automated parking of a vehicle, the method comprising:
obtaining, by a camera mounted to the vehicle, images of an environment surrounding the vehicle;
executing an artificial intelligence algorithm configured to detect a parking lot comprising unmarked parking areas based on input images;
classifying the environment surrounding the vehicle as the parking lot comprising unmarked parking areas based on the images of the environment surrounding the vehicle through execution of the artificial intelligence algorithm;
determining an unmarked parking area from among the unmarked parking areas within the parking lot to park the vehicle; and
controlling an automated parking function of the vehicle to park the vehicle in the unmarked parking area,
wherein the environment surrounding the vehicle comprises structures, and
wherein the classifying comprises the artificial intelligence algorithm classifying the environment surrounding the vehicle as the parking lot based on types of the structures.

### Claim 8 (depends on 7)

The method as recited in claim 7, wherein the classifying comprises classifying the environment surrounding the vehicle based on comparisons of stored images corresponding to known infrastructure and a parking lot configuration corresponding with the known infrastructure.

### Claim 9 (depends on 7)

The method as recited in claim 7, further comprising determining a configuration of the vehicle.

### Claim 10 (depends on 9)

The method as recited in claim 9, wherein the configuration of the vehicle includes a trailer.

### Claim 11 (depends on 8)

The method as recited in claim 8, further comprising defining unmarked parking area based on placement of other vehicles within the environment.

### Claim 12

A non-transitory computer-readable recording medium having embodied thereon a program, which when executed by a processor causes the processor to control a method of automated parking of a vehicle, the method comprising:
obtaining, by a camera mounted to the vehicle, images of an environment surrounding the vehicle;
executing an artificial intelligence algorithm configured to detect a parking lot comprising unmarked parking areas based on input images;
determining the environment surrounding the vehicle as a parking lot comprising unmarked parking areas based on the images of the environment surrounding the vehicle through execution of the artificial intelligence; and
controlling an automated parking function of the vehicle to park the vehicle in the unmarked parking area, wherein the environment surrounding the vehicle comprises structures, and
wherein the classifying comprises the artificial intelligence algorithm classifying the environment surrounding the vehicle as the parking lot based on types of the structures.

### Claim 13 (depends on 12)

The non-transitory computer-readable recording medium as recited in claim 12, wherein the parking lot comprises an area of a campground.

### Claim 14 (depends on 12)

The non-transitory computer-readable recording medium as recited in claim 12, wherein the parking lot comprises an area such that definite alignment with a line or other object of the automated parking function is not possible.

### Claim 15 (depends on 12)

The non-transitory computer-readable recording medium as recited in claim 12, wherein the parking lot comprises an area that excludes definite parking spots.

### Claim 16 (depends on 12)

The non-transitory computer-readable recording medium as recited in claim 12, wherein the parking lot comprises an area that excludes parking lines.

### Claim 17 (depends on 12)

The non-transitory computer-readable recording medium as recited in claim 12, wherein the unmarked parking areas are irregularly shaped.
