# US 2025/0168555 A1 · Agricultural vehicle control systems and methods using audio signals from microphones

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0168555 A1
- Document ID: US20250168555A1
- Status: Published application
- Kind: A1
- Application number: 18/948,690
- Filed: 2024-11-15
- Published: 2025-05-22
- Earliest claimed: 2023-11-16
- Assignees: Raven Industries, Inc.
- Applicants: Raven Industries, Inc.
- Inventors: Jared Ernest Kocer; Christopher Richard Wiegman
- Web page: https://patentgrep.com/patent/US20250168555A1

## CPC

- H04R 1/326: {for microphones (H04R1/34 and H04R1/40 take precedence)}
- A01B 76/00: Parts, details or accessories of agricultural machines or implements, not provided for in groups A01B51/00 - A01B75/00
- H04R 1/406: {microphones}
- H04R 2499/13: Acoustic transducers and sound field adaptation in vehicles
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- A01B: SOIL WORKING IN AGRICULTURE OR FORESTRY; PARTS, DETAILS, OR ACCESSORIES OF AGRICULTURAL MACHINES OR IMPLEMENTS, IN GENERAL (making or covering furrows or holes for sowing, planting or manuring A01C5/00; mowers convertible to soil working apparatus or capable of soil working A01D42/04; mowers combined with soil working implements A01D43/12; soil working for engineering purposes E01, E02, E21)

## Abstract

Disclosed in some examples are methods and systems for controlling an agricultural vehicle using audio signals captured by one or more microphones mounted on the vehicle. An example system includes a processing system configured to receive the audio signals from the one or more microphones, process the audio signals using one or more machine learning models to detect an abnormal condition, and based on the detection of the abnormal condition, generate a control command related to the abnormal condition. The system can further include an actuator system for receiving the control command and altering operation of the vehicle. The system can further include processing audio signals and sensor signals from other sensors on the vehicle (such as one or more of cameras, radar systems, and the like). The fusion of audio and non-audio data can in some examples better enable detection of the abnormal condition. The abnormal condition can be a verbal command, a verbal distress signal, a mechanical failure noise, an obstacle, a failure condition, a heavy engine load, and the like.

## Claims

### Claim 1

An agricultural vehicle control system, comprising:
one or more microphones mounted on an agricultural vehicle and configured to detect sounds around the agricultural vehicle and generate audio signals representative of the detected sounds; and
a processing system, including a processor and a memory, configured to:
receive the audio signals from the one or more microphones;
process the audio signals using a machine learning model to detect an abnormal condition related to the agricultural vehicle; and
based on the detection of the abnormal condition, generate a control command for a vehicle actuator or implement actuator that is related to the abnormal condition.

### Claim 2 (depends on 1)

The agricultural vehicle control system of claim 1, wherein the one or more microphones includes at least two directional microphones facing in different directions.

### Claim 3 (depends on 1)

The agricultural vehicle control system of claim 1, wherein the one or more microphones includes at least four directional microphones facing in different directions.

### Claim 4 (depends on 1)

The agricultural vehicle control system of claim 1, wherein the processing system includes a pre-processing module for pre-processing the audio signals and wherein processing the audio signals includes processing the pre-processed audio signals.

### Claim 5 (depends on 4)

The agricultural vehicle control system of claim 4, wherein the pre-processing module filters the audio signals.

### Claim 6 (depends on 1)

The agricultural vehicle control system of claim 1, further including one or more non-audio sensors mounted on the agricultural vehicle for sensing conditions on or around the agricultural vehicle and generating non-audio signals, wherein the processing system is configured to:
receive the non-audio signals from the one or more non-audio sensors; and
process the audio signals and the non-audio signals using the machine learning model to detect the abnormal condition.

### Claim 7 (depends on 6)

The agricultural vehicle control system of claim 6, wherein the one or more non-audio sensors includes at least one of a camera, a radar system, a lidar system, or a combination thereof.

### Claim 8 (depends on 7)

The agricultural vehicle control system of claim 7, wherein processing the audio signals and the non-audio signals includes correlating a first time of the audio signals with a second time of the non-audio signals.

### Claim 9 (depends on 1)

The agricultural vehicle control system of claim 1, wherein the machine learning model includes a trained machine learning model.

### Claim 10 (depends on 1)

The agricultural vehicle control system of claim 1, further including an actuator system configured to receive the control command and alter operation of the vehicle actuator or the implement actuator based on the control command.

### Claim 11

A method of controlling an agricultural vehicle, comprising:
obtaining, with a processing system having one or more processors and a memory, one or more machine learning models trained using sounds from a representative agricultural machine;
receiving, with the processing system, audio signals detected by one or more microphones mounted on the agricultural vehicle;
processing, with the processing system, the audio signals using the one or more machine learning models to detect an abnormal condition; and
based on the detection of the abnormal condition, generating, with the processing system, a control command for the agricultural vehicle related to the abnormal condition.

### Claim 12 (depends on 11)

The method of claim 11, wherein the one or more microphones includes at least two directional microphones facing in different directions.

### Claim 13 (depends on 11)

The method of claim 11, wherein the one or more microphones includes at least four directional microphones facing in different directions.

### Claim 14 (depends on 11)

The method of claim 11, wherein processing the audio signals includes pre-processing the audio signals.

### Claim 15 (depends on 14)

The method of claim 14, wherein pre-processing includes filtering the audio signals.

### Claim 16 (depends on 11)

The method of claim 11, further including providing one or more non-audio sensors mounted on the agricultural vehicle for sensing conditions on or around the agricultural vehicle and generating non-audio signals, wherein the method includes:
receiving, with the processing system, the non-audio signals from the one or more non-audio sensors; and
processing the audio signals and the non-audio signals using the one or more machine learning models to detect the abnormal condition.

### Claim 17 (depends on 16)

The method of claim 16, wherein the one or more non-audio sensors includes at least one of a camera, a radar system, a lidar system, or a combination thereof.

### Claim 18 (depends on 17)

The method of claim 17, wherein the one or more machine learning models includes a trained model trained on audio data and non-audio data.

### Claim 19 (depends on 17)

The method of claim 17, wherein processing the audio signals and the non-audio signals includes correlating a first time of the audio signals with a second time of the non-audio signals.

### Claim 20 (depends on 11)

The method of claim 11, further including receiving the control command with an actuator system and altering operation of the agricultural vehicle based on the control command.
