# US 2023/0266754 A1 · Work area overlay on operator display

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0266754 A1
- Document ID: US20230266754A1
- Status: Published application
- Kind: A1
- Application number: 17/676,458
- Filed: 2022-02-21
- Published: 2023-08-24
- Earliest claimed: 2022-02-21
- Assignees: Caterpillar Paving Products Inc.
- Applicants: Caterpillar Paving Products Inc.
- Inventors: Nathaniel S. Doy; Joel Case Miller
- Web page: https://patentgrep.com/patent/US20230266754A1

## CPC

- G05D 1/0033: {by having the operator tracking the vehicle either by direct line of sight or via one or more cameras located remotely from the vehicle}
- G05D 1/0038: {by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation (images analyzed by a computer and used for automatic navigation G05D1/0246)}
- G05D 1/0219: {ensuring the processing of the whole working surface}
- G06T 11/00: Two-dimensional [2D] image generation
- H04N 1/3871: {the composed originals being of different kinds, e.g. low- and high-resolution originals}
- H04N 1/3876: {Recombination of partial images to recreate the original image}
- H04N 7/181: {for receiving images from a plurality of remote sources}
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A work machine can include an image capturing device configured to capture an image of at least a portion of an environment adjacent to the work machine. The work machine can also include processing circuitry to receive the image from the image capturing device, generate an overlay that depicts a work area for the work machine, superimpose the overlay over the image to generate an enhanced image of the work area, and provide the enhanced image to a display device.

## Claims

### Claim 1

A work machine comprising:
an image capturing device configured to capture an image of at least a portion of an environment adjacent to the work machine; and
processing circuitry configured to:
receive the image from the image capturing device;
generate an overlay that depicts a work area for the work machine;
superimpose the overlay over the image to generate an enhanced image of an area to be worked in the work area; and
provide the enhanced image to a display device.

### Claim 2 (depends on 1)

The work machine of claim 1, further comprising a plurality of image capturing devices, and wherein the plurality of image capturing devices is configured to capture images of different portions of the environment adjacent to the work machine.

### Claim 3 (depends on 2)

The work machine of claim 2, wherein the processing circuitry is configured to generate a composite view of the environment adjacent to the work machine using the images and to superimpose the overlay over the composite view.

### Claim 4 (depends on 1)

The work machine of claim 1, wherein the processing circuitry is configured to determine parameters of the work area by accessing location information for the work area.

### Claim 5 (depends on 4)

The work machine of claim 4, further comprising a sensor to detect location information, and wherein the processing circuitry is configured access location information from the sensor.

### Claim 6 (depends on 5)

The work machine of claim 5, wherein the location information is accessed from a device located remotely from the work machine.

### Claim 7 (depends on 1)

The work machine of claim 1, wherein the overlay includes information or a work plan of the work machine.

### Claim 8 (depends on 7)

The work machine of claim 7, wherein the overlay includes a cut-and-fill map for a cut-and-fill operation to be performed by the work machine.

### Claim 9 (depends on 7)

The work machine of claim 7, wherein the overlay includes a compaction plan for a compaction operation to be performed by the work machine.

### Claim 10 (depends on 7)

The work machine of claim 7, wherein the overlay includes indicators to indicate a travel direction for the work machine.

### Claim 11 (depends on 7)

The work machine of claim 7, wherein the overlay includes indicators to indicate subsequent work operations for implementing the work plan.

### Claim 12 (depends on 7)

The work machine of claim 7, wherein the overlay includes indicators to indicate a starting location for the work machine for implementing the work plan.

### Claim 13 (depends on 1)

The work machine of claim 1, wherein the processing circuitry is configured to update the overlay based on location information of the work machine.

### Claim 14 (depends on 1)

The work machine of claim 1, wherein the display device is located remotely from the work machine.

### Claim 15 (depends on 1)

The work machine of claim 1, wherein the display device is located at the work machine.

### Claim 16

A method of remote control for a work machine, the method comprising:
capturing an image of at least a portion of an environment adjacent to the work machine;
generating an overlay that depicts a work area for the work machine;
superimposing the overlay over the image to generate an enhanced image of
an area to be worked in the work area; and
controlling the work machine to perform work in the work area based on the overlay and a position of the work machine within the work area.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
capturing a plurality of images of a plurality of portions of the environment adjacent to the work machine;
generating a composite view of the environment adjacent to the work machine using the plurality of images; and
superimposing the overlay over the composite view.

### Claim 18 (depends on 16)

The method of claim 16, further comprising:
determining parameters of the work area by accessing location information for the work area;
accessing location information for the work machine; and
controlling the work machine based on parameters of the work area and the location information.

### Claim 19

A system comprising:
an image capturing device configured to capture an image of at least a portion of an environment adjacent to a work machine;
a location sensor configured to detect location of the work machine;
processing circuitry configured to:
receive the image from the image capturing device;
generate an overlay that depicts a work area for the work machine; and
superimpose the overlay over the image to generate an enhanced image of an area to be worked in the work area; and
a display connected to the processing circuitry and configured to receive the enhanced image and display the enhanced image.

### Claim 20 (depends on 19)

The system of claim 19, further comprising a plurality of image capturing devices, and wherein the plurality of image capturing devices is configured to capture images of different portions of the environment adjacent to the work machine.
