# US 2021/0174488 A1 · System and method for detecting the operating condition of components of an implement

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174488 A1
- Document ID: US20210174488A1
- Status: Published application
- Kind: A1
- Application number: 16/707,479
- Filed: 2019-12-09
- Published: 2021-06-10
- Earliest claimed: 2019-12-09
- Assignees: CNH Industrial America LLC
- Applicants: CNH Industrial America LLC
- Inventors: Phillip Duane Dix; Daniel Geiyer; Aditya Singh; Brett McClelland; Navneet Gulati
- Web page: https://patentgrep.com/patent/US20210174488A1

## CPC

- G06T 7/0004: {Industrial image inspection}
- G05B 19/042: using digital processors (G05B19/05 takes precedence)
- G05B 23/0208: {characterized by the configuration of the monitoring system}
- G10L 25/51: for comparison or discrimination
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- G01N 2021/8411: {Application to online plant, process monitoring}
- G05B 2219/45017: Agriculture machine, tractor
- G06T 2207/30164: Workpiece; Machine component
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)

## Abstract

A system for detecting the operating condition of components of an implement may include an implement, a first sensor comprising one of an acoustic sensor or a vision-based sensor, a second sensor comprising the other of the acoustic sensor or the vision-based sensor, and a controller communicatively coupled to the first and second sensors. The controller may receive performance data from the first sensor indicative of a performance of the implement. The controller may further monitor the performance data received from the first sensor and identify an area of interest relative to the implement. Additionally, the controller may control an operation of the second sensor to collect component data indicative of an operating condition of at least one component of the implement located within the area of interest.

## Claims

### Claim 1

A system for detecting the operating condition of components of an implement, the system comprising:
an implement;
a first sensor comprising one of an acoustic sensor or a vision-based sensor;
a second sensor comprising the other of the acoustic sensor or the vision-based sensor; and
a controller communicatively coupled to the first and second sensors, the controller being configured to:
receive performance data from the first sensor indicative of a performance of the implement;
monitor the performance data received from the first sensor and identify an area of interest relative to the implement, and
control an operation of the second sensor to collect component data indicative of an operating condition of at least one component of the implement located within the area of interest.

### Claim 2 (depends on 1)

The system of claim 1, wherein, when the first sensor is the acoustic sensor, the performance data comprises acoustic data indicative of an acoustic parameter of a sound deriving from the area of interest, the controller being configured to compare the acoustic parameter to an acoustic parameter threshold and identify the area of interest when the acoustic parameter differs from the acoustic parameter threshold.

### Claim 3 (depends on 2)

The system of claim 2, wherein the acoustic data generated by the acoustic sensor further comprises data indicative of a location of the area of interest relative to the acoustic sensor.

### Claim 4 (depends on 2)

The system of claim 2, wherein, when the second sensor is the vision-based sensor, the component data comprises image data of the at least one component located within the area of interest, the controller being configured to receive the image data from the vision-based sensor and determine whether the at least one component has an impaired operating condition based on the image data.

### Claim 5 (depends on 4)

The system of claim 4, wherein the controller is configured to control the operation of an actuator to move the vision-based sensor such that a field of view of the vision-based sensor is directed towards the area of interest.

### Claim 6 (depends on 1)

The system of claim 1, wherein, when the first sensor is the vision-based sensor, the performance data comprises image data of a field worked by the implement, the controller being configured to identify the area of interest based at least in part on the image data of the field.

### Claim 7 (depends on 6)

The system of claim 6, wherein the controller is configured to analyze the image data to detect a worked area of the field that is indicative of an impaired operating condition of at least one component of the implement, the area of interest relative to the implement being identified based on the location of the worked area of the field relative to the implement.

### Claim 8 (depends on 6)

The system of claim 6, wherein the controller is configured to control a user interface to display the image data and receive a user input from an operator identifying the area of interest.

### Claim 9 (depends on 6)

The system of claim 6, wherein, when the second sensor is the acoustic sensor, the component data comprises acoustic data indicative of an acoustic parameter of a sound produced by the at least one component located within the area of interest, the controller being configured to receive the acoustic data from the acoustic sensor and determine that the at least one component has an impaired operating condition when the acoustic parameter differs from an acoustic parameter threshold.

### Claim 10

A method for detecting the operating condition of components of an implement, the method comprising:
receiving, with a computing device, performance data from a first sensor indicative of a performance of the implement;
identifying, with the computing device, an area of interest relative to the implement based at least in part on the performance data received from the first sensor; and
controlling, with the computing device, an operation of a second sensor to collect component data indicative of an operating condition of at least one component located within the area of interest,
wherein the first sensor comprises one of an acoustic sensor or a vision-based sensor, and the second sensor comprises the other of the acoustic sensor or the vision-based sensor.

### Claim 11 (depends on 10)

The method of claim 10, wherein, when the first sensor is the acoustic sensor, the performance data comprises acoustic data indicative of an acoustic parameter of a sound deriving from the area of interest,
the method further comprising comparing, with the computing device, the acoustic parameter to an acoustic parameter threshold,
wherein identifying the area of interest comprises identifying the area of interest when the acoustic parameter differs from the acoustic parameter threshold.

### Claim 12 (depends on 11)

The method of claim 11, wherein the acoustic data generated by the acoustic sensor further comprises data indicative of a location of the area of interest relative to the acoustic sensor.

### Claim 13 (depends on 11)

The method of claim 11, wherein, when the second sensor is the vision-based sensor, the component data comprises image data of the at least one component located within the area of interest,
the method further comprising receiving, with the computing device, the image data from the vision-based sensor and determining whether the at least one component has an impaired operating condition based on the image data.

### Claim 14 (depends on 13)

The method of claim 13, further comprising controlling the operation of an actuator to move the vision-based sensor such that a field of view of the vision-based sensor is directed towards the area of interest.

### Claim 15 (depends on 10)

The method of claim 10, wherein, when the first sensor is the vision-based sensor, the performance data comprises image data of a field worked by the implement.

### Claim 16 (depends on 15)

The method of claim 15, wherein identifying the area of interest comprises analyzing the image data to detect a worked area of the field that is indicative of an impaired operating condition of at least one component of the implement and identifying the area of interest based on the location of the worked area of the field relative to the implement.

### Claim 17 (depends on 15)

The method of claim 15, wherein identifying the area of interest comprises controlling a user interface to display the image data and receiving a user input from an operator via the user interface identifying the area of interest.

### Claim 18 (depends on 15)

The method of claim 15, wherein, when the second sensor is the acoustic sensor, the component data comprises acoustic data indicative of an acoustic parameter of a sound produced by the at least one component located within the area of interest,
the method further comprising receiving, with the computing device, the acoustic data from the acoustic sensor and determining that the at least one component has an impaired operating condition when the acoustic parameter differs from an acoustic parameter threshold.

### Claim 19 (depends on 10)

The method of claim 10, further comprising:
determining, with the computing device, that the at least one component located within the area of interest has an impaired operating condition based on the component data received from the second sensor; and
initiating, with the computing device, a control action in response to determining that the at least one component has the impaired operating condition.

### Claim 20 (depends on 19)

The method of claim 19, wherein the control action comprises adjusting at least one of a ground speed of the implement or notifying an operator of the implement of the impaired operating condition of the at least one component.
