# US 2021/0239808 A1 · Configuration of a lidar sensor scan area according to a cycle segment of an operation of a machine

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0239808 A1
- Document ID: US20210239808A1
- Status: Published application
- Kind: A1
- Application number: 16/781,759
- Filed: 2020-02-04
- Published: 2021-08-05
- Earliest claimed: 2020-02-04
- Assignees: Caterpillar Inc.
- Applicants: Caterpillar Inc.
- Inventors: Paul Russell FRIEND
- Web page: https://patentgrep.com/patent/US20210239808A1

## CPC

- G01S 7/497: Means for monitoring or calibrating
- E02F 9/2041: {Automatic repositioning of implements, i.e. memorising determined positions of the implement (for dipper-arms or bucket-arms E02F3/434, E02F3/437, E02F3/438, E02F3/439 take precedence)}
- E02F 9/205: {Remotely operated machines, e.g. unmanned vehicles (E02F3/8866 takes precedence)}
- E02F 9/262: {with follow-up actions to control the work tool, e.g. controller}
- E02F 9/265: {with follow-up actions (e.g. control signals sent to actuate the work tool)}
- E02F 9/267: {Diagnosing or detecting failure of vehicles}
- G01S 17/42: Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46)
- G01S 17/88: Lidar systems specially adapted for specific applications
- G07C 5/0816: {Indicating performance data, e.g. occurrence of a malfunction}
- E02F 3/439: {Automatic repositioning of the implement, e.g. automatic dumping, auto-return (E02F3/438 takes precedence)}
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- E02F: DREDGING; SOIL-SHIFTING (winning peat E21C49/00)
- G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE

## Abstract

A light detection and ranging (LIDAR) controller is disclosed. The LIDAR controller may receive cycle segment information identifying a cycle segment of an operation of a machine. The LIDAR controller may determine, based on the cycle segment information, a scan area within a field of view of the LIDAR sensor. The LIDAR controller may cause the LIDAR sensor to capture, with an increased point density relative to a non-scan area within the field of view, LIDAR data associated with the scan area. The LIDAR controller may process the LIDAR data to determine, using the increased point density, a status associated with the operation. The LIDAR controller may perform an action associated with indicating the status associated with the operation.

## Claims

### Claim 1

A method, comprising:
receiving, by a device, an input associated with an operation of a machine;
determining, by the device and based on the input, a cycle segment of the operation;
determining, by the device and based on the cycle segment, a scan area within a field of view of a light detection and ranging (LIDAR) sensor mounted to the machine,
wherein the scan area has an increased point density relative to another area of the field of view;
causing, by the device, the LIDAR sensor to capture, with the increased point density, LIDAR data associated with the scan area;
processing, by the device, the LIDAR data to determine, using the increased point density, a status associated with the operation; and
performing, by the device, an action associated with indicating the status associated with the operation.

### Claim 2 (depends on 1)

The method of claim 1, wherein the cycle segment is associated with at least one of:
a designated position of an implement of the machine, or
a machine position relative to a worksite,
wherein the scan area is configured to cause the LIDAR data to be associated with the implement or the worksite.

### Claim 3 (depends on 1)

The method of claim 1, wherein the input is associated with at least one of:
a control input to adjust a position of an implement of the machine,
a control input to adjust an orientation of the machine, or
a control input to move the machine.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
receiving information associated with a position of an implement of the machine,
wherein determining the cycle segment comprises:
determining the cycle segment based on the input and the information.

### Claim 5 (depends on 1)

The method of claim 1, wherein processing the LIDAR data comprises:
processing the LIDAR data to determine the status associated with the operation according to a specific cycle segment of the operation.

### Claim 6 (depends on 1)

The method of claim 1, wherein the status associated with the operation indicates at least one of:
a wear status of an implement of the machine during the operation, or
a production status of a worksite of the operation.

### Claim 7 (depends on 1)

The method of claim 1, wherein the scan area is associated with a portion of the field of view that includes a wear element of an implement of the machine, and
wherein performing the action comprises at least one of:
providing an alert to an operator interface of the machine to indicate a wear status of the wear element, or
providing an alert to a backend monitoring system to indicate a wear status of the wear element.

### Claim 8 (depends on 1)

The method of claim 1, wherein the scan area is associated with ground material at a worksite of the operation, and
wherein performing the action comprises at least one of:
providing information identifying a quantity of processed material at the worksite during the operation, or
providing information identifying a quantity of remaining material to be processed at the worksite in association with the operation.

### Claim 9

A device, comprising:
one or more memories; and
one or more processors, communicatively coupled to the one or more memories, configured to:
determine, based on operating parameters of a machine, a cycle segment of an operation of the machine;
determine, based on the cycle segment, a scan area within a field of view of a light detection and ranging (LIDAR) sensor associated with the machine,
wherein the scan area has an increased point density relative to another area of the field of view;
cause the LIDAR sensor to capture, with the increased point density, LIDAR data associated with the scan area;
process the LIDAR data to determine, using the increased point density and an object detection model, a status associated with the operation; and
perform an action associated with indicating the status associated with the operation.

### Claim 10 (depends on 9)

The device of claim 9, wherein the operating parameters include at least one of:
a position of an implement of the machine,
an input associated with controlling an implement of the machine, or
an input associated with controlling movement of the machine.

### Claim 11 (depends on 9)

The device of claim 9, wherein the LIDAR sensor is mounted to the machine in a fixed position that enables, based on the cycle segment, at least a portion of an implement of the machine to be within the field of view.

### Claim 12 (depends on 9)

The device of claim 9, wherein the object detection model is configured to identify a designated object associated with the operation that is specific to the cycle segment.

### Claim 13 (depends on 12)

The device of claim 12, wherein the increased point density satisfies a threshold point density associated with the object detection model being able to identify the designated object.

### Claim 14 (depends on 9)

The device of claim 9, wherein the one or more processors, when performing the action, are configured to at least one of:
provide an alert to an operator interface of the machine to indicate a wear status of an implement of the machine,
provide an alert to a backend monitoring system to indicate the wear status, or
provide performance information associated with the operation.

### Claim 15

A system comprising:
a light detection and ranging (LIDAR) sensor; and
a controller configured to:
receive cycle segment information identifying a cycle segment of an operation of a machine;
determine, based on the cycle segment information, a scan area within a field of view of the LIDAR sensor;
cause the LIDAR sensor to capture, with an increased point density relative to a non-scan area within the field of view, LIDAR data associated with the scan area;
process the LIDAR data to determine, using the increased point density, a status associated with the operation; and
perform an action associated with indicating the status associated with the operation.

### Claim 16 (depends on 15)

The system of claim 15, wherein the scan area is determined based on a point mapping in a data structure that maps a plurality of cycle segments of the operation to corresponding scan areas.

### Claim 17 (depends on 15)

The system of claim 15, wherein the controller, when causing the LIDAR sensor to capture the LIDAR data, is configured to:
configure the LIDAR sensor to focus a fixed quantity of LIDAR points of a scan of the LIDAR sensor to be focused within a perimeter of the scan area; and
cause the LIDAR sensor to execute the scan to capture the LIDAR data.

### Claim 18 (depends on 15)

The system of claim 15, wherein the cycle segment involves an implement of a machine being within the field of view,
wherein the status associated with the operation corresponds to a wear status of the implement, and
wherein the controller is configured to:
determine, based on the cycle segment information, a position of a ground engaging tool of the implement relative to the field of view; and
redistribute a set of points, of a fixed quantity of points of the LIDAR sensor, to be within a threshold distance of the position of the ground engaging tool to generate the increased point density.

### Claim 19 (depends on 15)

The system of claim 15, wherein the controller, when processing the LIDAR data, is configured to:
identify, using an object detection model, an object of interest associated with the cycle segment; and
determine a characteristic of the object of interest,
wherein the status is associated with the characteristic of the object of interest.

### Claim 20 (depends on 15)

The system of claim 15, wherein the controller, when performing the action, is configured to at least one of:
record the status in a log associated with monitoring the operation,
provide the status to a backend monitoring system associated with monitoring the operation, or
provide the status to an operator interface of the machine.
