# US 2023/0058639 A1 · Systems And Methods To Generate A Last Mile Travel Route For A Delivery Robot

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0058639 A1
- Document ID: US20230058639A1
- Status: Published application
- Kind: A1
- Application number: 17/407,458
- Filed: 2021-08-20
- Published: 2023-02-23
- Earliest claimed: 2021-08-20
- Assignees: Ford Global Technologies, LLC
- Applicants: Ford Global Technologies, LLC
- Inventors: Justin Miller; Pavithra Madhavan; Sanghyun Hong; Jianbo Lu
- Web page: https://patentgrep.com/patent/US20230058639A1

## CPC

- G06Q 10/0832: Special goods or special handling procedures, e.g. handling of hazardous or fragile goods
- G05D 1/0212: {with means for defining a desired trajectory (involving a plurality of land vehicles G05D1/0287)}
- G05D 1/0214: {in accordance with safety or protection criteria, e.g. avoiding hazardous areas (monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13)}
- G05D 1/0246: {using a video camera in combination with image processing means}
- G05D 1/0274: {using mapping information stored in a memory device (navigation using map-matching G01C21/30)}
- G06Q 10/0833: Tracking
- G06Q 50/40: Business processes related to the transportation industry (shipping G06Q10/083)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES

## Abstract

This disclosure is generally directed to systems and methods for generating a last mile travel route for a delivery robot. In an example embodiment, an individual captures an image of a frontage of a property. The image may include a package drop-off spot where a package can be dropped off by the delivery robot. The individual may also insert labels and/or illustrations into the image for conveying information such as object descriptors (front door, drop-of spot etc.), traversable areas (driveway, walkway, etc.), and non-traversable areas (lawn, flower bed, etc.). The image is converted by a computer into a travel map that the delivery robot can use to identify a travel, route through the frontage area of the property. The travel map may be provided in various forms such as a semantic map of the frontage area or a bird's eye view rendering of the frontage area.

## Claims

### Claim 1

A method comprising:
capturing an image comprising a package drop-off spot about a building; and
generating, based on the image, a travel map that is interpretable by a delivery robot for delivering a package to the package drop-off spot.

### Claim 2 (depends on 1)

The method of claim 1, wherein the travel snap is one of a bird's eye view rendering or a semantic map, wherein the image is a red-green-blue (RGB) image captured by an individual, and wherein generating the semantic map comprises:
converting the ROB image to a semantic image; and
converting the semantic image to the semantic map by adding depth information to the semantic image.

### Claim 3 (depends on 2)

The method of claim 2, wherein generating the bird's eye view rendering comprises:
converting the semantic map to the bird's eye view rendering,

### Claim 4 (depends on 2, 4)

The method of claim 2, wherein converting the semantic image to the semantic-map comprises adding depth information to the semantic image and/or adding a first label to a first area in the semantic image. The method of claim 4, wherein the RGB image is captured by a personal communication device and the first label is inserted by one of the individual or the personal communication device.

### Claim 6 (depends on 4)

The method of claim 4, wherein the first area is designated as a traversable area and wherein the method further comprises:
adding a second label to a second area in the semantic image, wherein the second area is designated as a non-traversable area.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
adding a third label to a third area in the semantic image, wherein the third area is designated as a conditionally traversable area.

### Claim 8

A method comprising:
evaluating, by a delivery robot, one of a bird's eye view rendering or a semantic map of a frontage area of a building;
generating, by the delivery robot, based on the evaluating, a travel route through the frontage area; and
traversing, by the delivery robot, the travel route to deliver a package at a package drop-off spot about the building.

### Claim 9 (depends on 8)

The method of claim 8, wherein the one of the bird's eye view rendering or the semantic map of the frontage area is generated from on an image captured by an individual.

### Claim 10 (depends on 9)

The method of claim 9, wherein the image is a red-green-blue (RGB) image captured by the individual, and wherein generating the semantic map comprises:
converting the ROB image to a semantic image; and
converting the semantic image to the semantic map by adding depth information to the semantic image and/or adding a first label to a first area in the semantic image.

### Claim 11 (depends on 10)

The method of claim 10, wherein the RGB image is captured by a personal communication device and the first label is inserted by one of the individual or the personal communication device.

### Claim 12 (depends on 10)

The method of claim 10, wherein the first area is designated as a traversable area and wherein the method further comprises:
adding a second label to a second area in the semantic image, wherein the second area is designated as a non-traversable area.

### Claim 13 (depends on 11)

The method of claim 11, further comprising:
adding a third label to a third area in the semantic image, wherein the third area is designated as a conditionally traversable area.

### Claim 14

A device comprising:
a camera; and
a computer comprising:
a memory that stores computer-executable instructions; and
a processor configured to access the memory and execute the computer-executable instructions to perform operations comprising:
capturing an image by operating the camera, the image comprising a package drop-off spot about a building; and
generating, based on the image, one of a bird's eye view rendering or a semantic map that is interpretable by a delivery robot for delivering a package to the package drop-off spot.

### Claim 15 (depends on 14)

The device of claim 14, wherein the image is a red-green-blue (RGB) image captured by an individual, and wherein generating the semantic map comprises:
converting the RGB image to a semantic image; and
converting the semantic image to the semantic map by adding depth information to the semantic image.

### Claim 16 (depends on 15)

The device of claim 15, wherein generating the bird's eye view rendering comprises:
converting the semantic map to the bird's eye view rendering.

### Claim 17 (depends on 15)

The device of claim 15, wherein converting the semantic image to the semantic map comprises adding depth information to the semantic image, and/or adding a first label to a first area in the semantic image.

### Claim 18 (depends on 17)

The device of claim 17, wherein the RGB image is captured by a personal communication device and the first label is inserted by one of the individual or the personal communication device.

### Claim 19 (depends on 17)

The device of claim 17, wherein the first area is designated as a traversable area and the device further comprises:
adding a second label to a second area in the semantic image, wherein the second area is designated as a non-traversable area.

### Claim 20 (depends on 19)

The device of claim 19, further comprising:
adding a third label to a third area in the semantic image, wherein the third area is designated as a conditionally traversable area.
