# US 12,768,132 B2 · Controller, operator assistance system, and method of assisting operator of work machine

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,768,132 B2
- Document ID: US12768132B2
- Status: Granted
- Kind: B2
- Application number: 17/661,942
- Filed: 2022-05-04
- Published: 2023-11-09
- Granted: 2026-10-20
- Earliest claimed: 2022-05-04
- Assignees: Caterpillar Inc.
- Applicants: Caterpillar Inc.
- Inventors: Bradley Krone
- Web page: https://patentgrep.com/patent/US12768132B2

## CPC

- E02F 3/847: {using electromagnetic, optical or acoustic beams to determine the blade position, e.g. laser beams}
- E02F 5/32: Rippers {(E02F5/106 takes precedence, ripper or scarifying teeth mounted on blades E02F3/8152; ripper tips E02F9/2875)}
- E02F 9/262: {with follow-up actions to control the work tool, e.g. controller}
- E02F 9/265: {with follow-up actions (e.g. control signals sent to actuate the work tool)}
- E02F: DREDGING; SOIL-SHIFTING (winning peat E21C49/00)

## Abstract

A controller includes one or more memories and one or more processors. The one or more processors are configured to receive an input image. The input image contains a first pictorial view that includes a work implement of a work machine. The one or more processors are also configured to generate an output image containing a second pictorial view and an indication element superimposed on the second pictorial view. The second pictorial view is at least in part derived from the first pictorial view and includes the work implement. The indication element includes at least one reference line. An alignment of one or more portions of the work implement with the at least one reference line indicates that the one or more portions of the work implement are positioned at a desired height from a ground surface.

## Claims

### Claim 1

A controller comprising:
one or more memories; and
one or more processors configured to:
receive an input image, wherein the input image contains a first pictorial view that includes a first portion of a work implement of a work machine; and
generate an output image containing a second pictorial view and an indication element superimposed on the second pictorial view,
wherein the second pictorial view is at least in part derived from the first pictorial view and includes the first portion of the work implement,
wherein the indication element includes at least one reference line, and
wherein an alignment of the first portion of the work implement with the at least one reference line indicates that a second portion of the work implement that is not contained within either a boundary of the first pictorial view or a boundary of the second pictorial view is positioned at a desired height from a ground surface to perform work outside of the boundary of the first pictorial view and the boundary of the second pictorial view.

### Claim 2 (depends on 1)

The controller of claim 1, wherein the one or more processors are further configured to receive the input image from an imaging device, the imaging device being mounted on the work machine and facing the work implement of the work machine, the imaging device being configured to capture the input image containing the first pictorial view that includes the work implement.

### Claim 3 (depends on 1)

The controller of claim 1, wherein the one or more processors are further configured to transmit the output image to a user interface, and wherein the user interface is configured to display the output image thereon to assist an operator in positioning the second portion of the work implement at the desired height.

### Claim 4 (depends on 3)

The controller of claim 3, wherein the user interface is configured to display the output image based on an operating mode of the work implement.

### Claim 5 (depends on 3)

The controller of claim 3, wherein the output image is displayed on the user interface when the work implement is engaged with the ground surface or disengaged from the ground surface.

### Claim 6 (depends on 3)

The controller of claim 3, wherein the one or more processors are further configured to receive an input signal from an operator for adjusting a position of the indication element based on the desired height.

### Claim 7 (depends on 1)

The controller of claim 1, wherein the indication element includes a reference zone, wherein the reference zone includes a plurality of reference lines, and wherein an alignment of the first portion of the work implement with at least one of the plurality of reference lines indicates that the second portion of the work implement is positioned at the desired height from the ground surface.

### Claim 8 (depends on 1)

The controller of claim 1, wherein the alignment comprises superimposing the at least one reference line over the first portion of the work implement in the second pictorial view.

### Claim 9

An operator assistance system associated with a work machine, the operator assistance system comprising:
an imaging device mounted on the work machine and facing a work implement of the work machine, the imaging device being configured to capture an input image containing a first pictorial view that includes a first portion of the work implement;
a controller communicably coupled with the imaging device, the controller including one or more processors configured to:
receive the input image from the imaging device; and
generate an output image containing a second pictorial view and an indication element superimposed on the second pictorial view,
wherein the second pictorial view is at least in part derived from the first pictorial view and includes the first portion of the work implement,
wherein the indication element includes at least one reference line, and
wherein an alignment of the first portion of the work implement with the at least one reference line indicates that a second portion of the work implement which is not visible in the second pictorial view and which is outside of an area of the second pictorial view is positioned at a desired height from a ground surface, the desired height being outside of the second pictorial view; and
a user interface configured to receive the output image from the one or more processors,
wherein the user interface is configured to display the output image thereon to assist an operator in positioning the second portion of the work implement at the desired height.

### Claim 10 (depends on 9)

The operator assistance system of claim 9, wherein the indication element includes a reference zone, wherein the reference zone includes a plurality of reference lines, and wherein an alignment of the first portion of the work implement with at least one of the plurality of reference lines indicates that the second portion of the work implement is positioned at the desired height from the ground surface.

### Claim 11 (depends on 9)

The operator assistance system of claim 9, wherein the one or more processors are further configured to receive an input signal from the operator for adjusting a position of the indication element based on the desired height.

### Claim 12 (depends on 9)

The operator assistance system of claim 9, wherein the user interface is configured to display the output image based on an operating mode of the work implement.

### Claim 13 (depends on 9)

The operator assistance system of claim 9, wherein the output image is displayed on the user interface when the second portion of the work implement is engaged with the ground surface or disengaged from the ground surface.

### Claim 14 (depends on 9)

The operator assistance system of claim 9, wherein the second portion of the work implement is a ripper.

### Claim 15

A method of assisting an operator of a work machine, the method comprising:
capturing, by an imaging device mounted on the work machine and facing a work implement of the work machine, an input image containing a first pictorial view that includes a portion of the work implement;
receiving, by a controller communicably coupled with the imaging device, the input image from the imaging device;
generating, by the controller, an output image containing a second pictorial view and an indication element superimposed on the second pictorial view,
wherein the second pictorial view is at least in part derived from the first pictorial view and includes the portion of the work implement,
wherein the indication element includes at least one reference line, and
wherein an alignment of the portion of the work implement with the at least one reference line indicates that another portion of the work implement, which is not visible in either the first or second pictorial view because the another portion of the work implement is blocked from view by the portion of the work implement, and which is configured to engage a ground surface, is positioned at a desired height from a ground surface; and
displaying the output image on a user interface to assist the operator in positioning the another portion of the work implement at the desired height, wherein the user interface is configured to receive the output image from the controller, and wherein the output image does not display the another portion of the work implement.

### Claim 16 (depends on 15)

The method of claim 15, wherein the indication element includes a reference zone, wherein the reference zone includes a plurality of reference lines, and wherein an alignment of the portion of the work implement with at least one of the plurality of reference lines indicates that the another portion of the work implement is positioned at the desired height from the ground surface.

### Claim 17 (depends on 15)

The method of claim 15 further comprising receiving, by the controller, an input signal for adjusting a position of the indication element based on the desired height.

### Claim 18 (depends on 15)

The method of claim 15 further comprising displaying the output image based on an operating mode of the portion of the work implement or the another portion of the work implement.

### Claim 19 (depends on 15)

The method of claim 15 further comprising displaying the output image on the user interface when the another portion of the work implement is engaged with the ground surface or disengaged from the ground surface.

### Claim 20 (depends on 15)

The method of claim 15, wherein the another portion of the work implement is a ripper.
