# US 2020/0401157 A1 · Environment mapping for autonomous vehicles using video stream sharing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401157 A1
- Document ID: US20200401157A1
- Status: Published application
- Kind: A1
- Application number: 16/446,804
- Filed: 2019-06-20
- Published: 2020-12-24
- Earliest claimed: 2019-06-20
- Assignees: Cisco Technology, Inc.
- Applicants: Cisco Technology, Inc.
- Inventors: Jay Kemper Johnston; Magnus Mortensen; Kevin Klous; David C. White, JR.
- Web page: https://patentgrep.com/patent/US20200401157A1

## CPC

- G05D 1/0246: {using a video camera in combination with image processing means}
- G08G 1/143: {inside the vehicles}
- G05D 1/0022: {characterised by the communication link (data switching networks in general H04L12/00)}
- G05D 1/0088: {characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours (using knowledge based models G06N5/00)}
- G05D 1/0214: {in accordance with safety or protection criteria, e.g. avoiding hazardous areas (monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13)}
- G05D 1/0285: {using signals transmitted via a public communication network, e.g. GSM network}
- G08G 1/142: {external to the vehicles}
- G08G 1/165: {for passive traffic, e.g. including static obstacles, trees}
- G08G 1/167: {Driving aids for lane monitoring, lane changing, e.g. blind spot detection}
- G08G 1/168: {Driving aids for parking, e.g. acoustic or visual feedback on parking space}
- B64U 2101/30: for imaging, photography or videography
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR

## Abstract

In one embodiment, a supervisory service of a parking area may send a light fidelity (Li-Fi) based advertisement indicative of an offer to send video streams of the parking area to an autonomous vehicle. The supervisory service may receive an acceptance of the offer by the autonomous vehicle that includes an identifier for the autonomous vehicle. The supervisory service may identify one or more video streams of the parking area as associated with the autonomous vehicle based in part on a location of the autonomous vehicle in the parking area. The supervisory service may annotate the one or more identified video streams with metadata regarding a feature of the parking area. The supervisory service may send the annotated one or more video streams to the autonomous vehicle, wherein the autonomous vehicle uses the metadata of the annotated one or more video streams to avoid the feature of the parking area.

## Claims

### Claim 1

A method, comprising:
sending, by a supervisory service of a parking area and to an autonomous vehicle, a light fidelity (Li-Fi) based advertisement indicative of an offer by the supervisory service to send video streams of the parking area to the autonomous vehicle;
receiving, at the supervisory service, an acceptance of the offer by the autonomous vehicle that includes an identifier for the autonomous vehicle;
identifying, by the supervisory service, one or more video streams of the parking area as associated with the autonomous vehicle based in part on a location of the autonomous vehicle in the parking area;
annotating, by the supervisory service, the one or more identified video streams with metadata regarding a feature of the parking area; and
sending, by the supervisory service, the annotated one or more video streams to the autonomous vehicle, wherein the autonomous vehicle uses the metadata of the annotated one or more video streams to avoid the feature of the parking area.

### Claim 2 (depends on 1)

The method of claim 1, wherein the acceptance of the offer by the autonomous vehicle that includes the identifier for the autonomous vehicle is indicated by a pattern in emission of light from headlights of the autonomous vehicle, a Li-Fi transmitter of the autonomous vehicle, a light transmitter of the vehicle, or by infrared emission of the autonomous vehicle.

### Claim 3 (depends on 1)

The method of claim 1, wherein the metadata indicates a length, width, area, volume, color, speed, acceleration, or direction of the feature of the parking area.

### Claim 4 (depends on 1)

The method of claim 1, wherein using, by the autonomous vehicle, the metadata of the annotated one or more video streams to avoid the feature of the parking area comprises:
performing, by the autonomous vehicle, at least one of image recognition or mapping processes with the metadata to determine a proximity of the autonomous vehicle in relation to the feature of the parking area.

### Claim 5 (depends on 1)

The method of claim 1, wherein using, by the autonomous vehicle, the metadata of annotated one or more video streams to avoid the feature of the parking area:
combining, by the autonomous vehicle, the metadata with sensor data that is collected by the autonomous vehicle.

### Claim 6 (depends on 1)

The method of claim 1, wherein the metadata regarding the feature of the parking area is indicative of an occupied parking space or a destination parking spot, further wherein the autonomous vehicle avoids the occupied parking space.

### Claim 7 (depends on 1)

The method of claim 1, wherein the metadata regarding the feature of the parking area is indicative of another vehicle in the parking area, further wherein the autonomous vehicle avoids the other vehicle.

### Claim 8 (depends on 1)

The method of claim 1, wherein the metadata regarding the feature of the parking area is indicative of signage in the parking area, further wherein the autonomous vehicle avoids traveling in a direction different than indicated by the signage.

### Claim 9 (depends on 1)

The method of claim 1, wherein a video stream of the video streams is collected by a camera of a drone.

### Claim 10

A method, comprising:
receiving, by an autonomous vehicle and from a supervisory service of a parking area, a light fidelity (Li-Fi) based advertisement indicative of an offer by the supervisory service to send video streams of the parking area to the vehicle;
sending, by the autonomous vehicle, an acceptance of the offer by the autonomous vehicle that includes an identifier for the autonomous vehicle;
receiving, by the autonomous vehicle, one or more video streams annotated with metadata regarding a feature of the parking area, wherein the supervisory service identifies the annotated one or more video streams based in part on a location of the autonomous vehicle in the parking area and annotates the one or more video streams with metadata regarding the feature of the parking area; and
using, by the autonomous vehicle, the metadata of the annotated one or more video streams to avoid the feature of the parking.

### Claim 11 (depends on 10)

The method of claim 10, wherein the acceptance of the offer by the autonomous vehicle that includes the identifier for the autonomous vehicle is indicated by a pattern in emission of light from headlights of the autonomous vehicle, a Li-Fi transmitter of the autonomous vehicle, a light transmitter of the vehicle, or by infrared emission of the autonomous vehicle.

### Claim 12 (depends on 10)

The method of claim 10, wherein the metadata indicates a length, width, area, volume, color, speed, acceleration, or direction of the feature of the parking area.

### Claim 13 (depends on 10)

The method of claim 10, wherein using, by the autonomous vehicle, the metadata of the annotated one or more video streams to avoid the feature of the parking area comprises:
performing, by the autonomous vehicle, at least one of image recognition or mapping processes with the metadata to determine a proximity of the autonomous vehicle in relation to the feature of the parking area.

### Claim 14 (depends on 10)

The method of claim 10, wherein using, by the autonomous vehicle, the metadata of annotated one or more video streams to avoid the feature of the parking area:
combining, by the autonomous vehicle, the metadata with sensor data that is collected by the autonomous vehicle.

### Claim 15 (depends on 10)

The method of claim 10, wherein the metadata regarding the feature of the parking area is indicative of an occupied parking space or a destination parking spot, further wherein the autonomous vehicle avoids the occupied parking space.

### Claim 16 (depends on 10)

The method of claim 10, wherein the metadata regarding the feature of the parking area is indicative of another vehicle in the parking area, further wherein the autonomous vehicle avoids the other vehicle.

### Claim 17 (depends on 10)

The method of claim 10, wherein the metadata regarding the feature of the parking area is indicative of signage in the parking area, further wherein the autonomous vehicle avoids traveling in a direction different than indicated by the signage.

### Claim 18 (depends on 10)

The method of claim 10, wherein a video stream of the video streams is collected by a camera of a drone.

### Claim 19

An apparatus, comprising:
one or more network interfaces to communicate with a network;
a processor coupled to the network interfaces and configured to execute one or more processes; and
a memory configured to store a process executable by the processor, the process when executed configured to:
send a light fidelity (Li-Fi) based advertisement indicative of an offer by a supervisory service of a parking area to send video streams of the parking area to an autonomous vehicle;
receive an acceptance of the offer by the autonomous vehicle that includes an identifier for the autonomous vehicle;
identify one or more video streams of the parking area as associated with the autonomous vehicle based in part on a location of the autonomous vehicle in the parking area;
annotate the one or more identified video streams with metadata regarding a feature of the parking area; and
send the annotated one or more video streams to the autonomous vehicle, wherein the autonomous vehicle uses the metadata of the annotated one or more video streams to avoid the feature of the parking area.

### Claim 20 (depends on 19)

The apparatus as in claim 19, wherein the acceptance of the offer by the autonomous vehicle that includes the identifier for the autonomous vehicle is indicated by a pattern in emission of light from headlights of the autonomous vehicle, a Li-Fi transmitter of the autonomous vehicle, a light transmitter of the vehicle, or by infrared emission of the autonomous vehicle.
