# US 2021/0048290 A1 · System and method for determining field surface conditions using vision-based data and data from a secondary source

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0048290 A1
- Document ID: US20210048290A1
- Status: Published application
- Kind: A1
- Application number: 16/538,996
- Filed: 2019-08-13
- Published: 2021-02-18
- Earliest claimed: 2019-08-13
- Assignees: CNH Industrial Canada, Ltd.
- Applicants: CNH Industrial Canada, Ltd.
- Inventors: James W. Henry
- Web page: https://patentgrep.com/patent/US20210048290A1

## CPC

- G01B 11/24: for measuring contours or curvatures
- A01B 19/02: with tools rigidly or elastically attached to a tool-frame
- A01B 29/046: {the soil-pressing body being a helical coil}
- A01B 79/005: {Precision agriculture}
- G01B 11/303: {using photoelectric detection means}
- G01S 17/89: for mapping or imaging
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- A01B 49/027: {with a rotating, soil working support element, e.g. a roller}
- A01B 63/32: operated by hydraulic or pneumatic means {without automatic control}
- A01B 69/001: {Steering by means of optical assistance, e.g. television cameras (steering devices for road marking vehicles E01C23/163)}
- A01B 76/00: Parts, details or accessories of agricultural machines or implements, not provided for in groups A01B51/00 - A01B75/00
- G06T 2207/30188: Vegetation; Agriculture
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- A01B: SOIL WORKING IN AGRICULTURE OR FORESTRY; PARTS, DETAILS, OR ACCESSORIES OF AGRICULTURAL MACHINES OR IMPLEMENTS, IN GENERAL (making or covering furrows or holes for sowing, planting or manuring A01C5/00; mowers convertible to soil working apparatus or capable of soil working A01D42/04; mowers combined with soil working implements A01D43/12; soil working for engineering purposes E01, E02, E21)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A system for determining field surface conditions may include a frame member and a ground engaging tool coupled thereto. The ground engaging tool may be configured to engage soil within a field as an agricultural implement is moved across the field. The system may further include a vision sensor having a field of view directed towards a portion of a surface of the field and being configured to capture vision-based data indicative of a field surface condition of the field. The system may also include a secondary sensor coupled to the ground engaging tool and configured to capture secondary data indicative of the field surface condition. Additionally, the system may include a controller configured to determine an initial surface condition as a function of the vision-based data and to adjust the initial surface condition based at least in part on the secondary data received from the secondary sensor.

## Claims

### Claim 1

A system for determining field surface conditions, the system comprising:
a frame member;
a ground engaging tool coupled to the frame member, the ground engaging tool being configured to engage soil within a field as an agricultural implement is moved across the field;
a vision sensor having a field of view directed towards a portion of a surface of the field, the vision sensor being configured to capture vision-based data indicative of a field surface condition of the field;
a secondary sensor coupled to the ground engaging tool, the secondary sensor being configured to capture secondary data indicative of the field surface condition; and
a controller communicatively coupled to the vision sensor and the secondary sensor, the controller being configured to determine an initial surface condition associated with the field surface condition as a function of the vision-based data and to adjust the initial surface condition based at least in part on the secondary data received from the secondary sensor.

### Claim 2 (depends on 1)

The system of claim 1, wherein the controller is configured to adjust the initial surface condition by determining a correction factor based on the secondary data received from the secondary sensor and by applying the correction factor to the initial surface condition to determine a corrected surface condition.

### Claim 3 (depends on 2)

The system of claim 2, wherein the correction factor is determined based at least in part on a differential between the initial surface condition determined as a function of the vision-based data and a second surface condition associated with the field surface condition determined as a function of the secondary data received from the secondary sensor.

### Claim 4 (depends on 2)

The system of claim 2, wherein the controller is further configured to adjust an operation of one or more components of the agricultural implement based at least in part on the corrected surface condition.

### Claim 5 (depends on 1)

The system of claim 1, wherein the field surface condition is a soil surface roughness of the field and wherein the secondary sensor is provided in operative association with the ground-engaging tool such that the secondary sensor detects a parameter indicative of movement of the ground-engaging tool as the ground-engaging tool rides along a surface of the field.

### Claim 6 (depends on 5)

The system of claim 5, wherein the ground engaging tool comprises at least one of a tine or a basket assembly of the agricultural implement.

### Claim 7 (depends on 5)

The system of claim 5, wherein the controller is configured to determine a first soil roughness for the field as a function of the vision-based data received from the vision sensor and a second soil roughness for the field as a function of the secondary data received from the secondary sensor, the controller being further configured to determine a correction factor based on the first and second soil roughnesses and utilize the correction factor to adjust subsequent soil surface roughnesses determined based on the vision-based data received from the vision sensor.

### Claim 8 (depends on 1)

The system of claim 1, wherein the secondary sensor comprises at least one of an accelerometer, a load sensor, or a rotational sensor.

### Claim 9 (depends on 1)

The system of claim 1, wherein the vision sensor comprises at least one of a camera or a LIDAR device.

### Claim 10 (depends on 1)

The system of claim 1, wherein the field of view of the vision sensor is directed towards an aft portion of the field relative to the agricultural implement in a direction of travel of the agricultural implement.

### Claim 11

A method for determining field surface conditions, the method comprising:
receiving, with one or more computing devices, vision-based data indicative of a field surface condition of a field;
receiving, with the one or more computing devices, secondary data indicative of the field surface condition from a secondary sensor coupled to a ground engaging tool of an agricultural implement being moved across the field;
determining, with the one or more computing devices, a correction factor associated with the field surface condition based at least in part on the secondary data;
determining, with the one or more computing devices, a surface condition based at least in part on the vision-based data and the correction factor; and
adjusting, with the one or more computing devices, an operation of one or more components of the agricultural implement based at least in part on the determined surface condition.

### Claim 12 (depends on 11)

The method of claim 11, wherein the correction factor is determined based at least in part on a differential between a first surface condition determined as a function of the vision-based data and a second surface condition determined as a function of the secondary data.

### Claim 13 (depends on 12)

The method of claim 12, wherein determining the surface condition comprises adjusting the first surface condition using the correction factor.

### Claim 14 (depends on 11)

The method of claim 11, wherein the field surface condition is a soil surface roughness of the field, the secondary sensor being provided in operative association with the ground-engaging tool such that the secondary sensor detects a parameter indicative of movement of the ground-engaging tool as the ground-engaging tool rides along a surface of the field.

### Claim 15 (depends on 14)

The method of claim 14, wherein the ground engaging tool comprises at least one of a tine or a basket assembly of the agricultural implement.

### Claim 16 (depends on 11)

The method of claim 11, wherein the secondary sensor comprises at least one of an accelerometer, a load sensor, or a rotational sensor.

### Claim 17 (depends on 11)

The method of claim 11, wherein the vision-based data is received from a vision sensor, the vision sensor being provided in operative association with the agricultural implement and having a field of view directed towards a portion of a surface of the field.

### Claim 18 (depends on 17)

The method of claim 17, wherein the field of view of the vision sensor is directed towards an aft portion of the field relative to the agricultural implement in a direction of travel of the agricultural implement.

### Claim 19 (depends on 17)

The method of claim 17, wherein the vision sensor comprises at least one of a camera or a LIDAR device.
