# US 2024/0177494 A1 · Automatic implement recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0177494 A1
- Document ID: US20240177494A1
- Status: Published application
- Kind: A1
- Application number: 18/525,470
- Filed: 2023-11-30
- Published: 2024-05-30
- Earliest claimed: 2022-11-30
- Assignees: Zimeno Inc.
- Applicants: Zimeno Inc.
- Inventors: Rama Venkata BHUPATIRAJU
- Web page: https://patentgrep.com/patent/US20240177494A1

## CPC

- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- A01B 59/066: {of the type comprising at least two lower arms and one upper arm generally arranged in a triangle, e.g. three-point hitches}
- A01B 69/001: {Steering by means of optical assistance, e.g. television cameras (steering devices for road marking vehicles E01C23/163)}
- B60K 17/28: characterised by arrangement, location, or type of power take-off
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/215: Motion-based segmentation
- G06T 7/269: using gradient-based methods
- G06V 10/46: Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features (colour feature extraction G06V10/56)
- G06V 10/764: using classification, e.g. of video objects
- B60K 2360/176: Camera images
- B60K 2360/21: using cameras
- F16H 2200/0021: specially adapted for electric vehicles
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- A01B: SOIL WORKING IN AGRICULTURE OR FORESTRY; PARTS, DETAILS, OR ACCESSORIES OF AGRICULTURAL MACHINES OR IMPLEMENTS, IN GENERAL (making or covering furrows or holes for sowing, planting or manuring A01C5/00; mowers convertible to soil working apparatus or capable of soil working A01D42/04; mowers combined with soil working implements A01D43/12; soil working for engineering purposes E01, E02, E21)
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- F16H: GEARING

## Abstract

Optical flow may be carried out on a series of images captured by the camera during movement of a candidate implement. Particular pixels may be aggregated based on relative pixel motion and classifying the particular pixels as belonging to the candidate implement. A candidate implement contour may be determined based on the particular pixels classified as belonging to the candidate implement. Based upon the comparison, control signals may be output to adjust operation of at least one of a tractor and the candidate implement attached to the tractor. In some implementations, the implement or its contour may be tracked and compared to a boundary for further vehicle control or operator alerts.

## Claims

### Claim 1

An automatic implement recognition system comprising:
a tractor;
a camera mounted to the tractor and having a field-of-view configured to encompass a candidate implement that is attached to the tractor;
a processing resource;
a non-transitory computer-readable medium containing instructions configured to direct the processing resource to:
carry out optical flow on a series of images captured by the camera during movement of the candidate implement;
aggregate particular pixels based on relative pixel motion and classifying the particular pixels as belonging to the candidate implement;
determine a candidate implement contour based on the particular pixels classified as belonging to the candidate implement;
compare the contour to a stored implement contour; and
output control signals to adjust operation of at least one of the tractor and the candidate implement based on the comparison.

### Claim 2 (depends on 1)

The automatic implement recognition system of claim 1, wherein the instructions are further configured to direct the processing resource to:
save the candidate implement contour as a second stored implement contour in response to the candidate implement contour differing from the stored implement contour.

### Claim 3 (depends on 2)

The automatic implement recognition system of claim 2, wherein the instructions are further configured to direct the processing resource to associate a parameter of the candidate implement with the second stored implement contour.

### Claim 4 (depends on 3)

The automatic implement recognition system of claim 3, wherein the parameter comprises a width of the candidate implement.

### Claim 5 (depends on 3)

The automatic implement recognition system of claim 3, wherein the parameter comprises an operational setting for the candidate implement.

### Claim 6 (depends on 3)

The automatic implement recognition system of claim 3, wherein the parameter comprises an operational setting for the tractor.

### Claim 7 (depends on 6)

The automatic implement recognition system of claim 6, wherein the operational setting for the tractor is selected from a group of operational settings for the tractor consisting of: a power takeoff speed or range of power takeoff speeds; a hydraulic coupling output pressure or range of hydraulic coupling output pressures; a three-point hitch height or range of three-point hitch heights; and PTO RPM limits.

### Claim 8 (depends on 1)

The automatic implement recognition system of claim 1, wherein the control signals are configured to adjust an operational setting for the tractor.

### Claim 9 (depends on 8)

The automatic implement recognition system of claim 8, wherein the operational setting for the tractor is selected from a group of operational settings for the tractor consisting of: a power takeoff speed or range of power takeoff speeds; a hydraulic coupling output pressure or range of hydraulic coupling output pressures; a three-point hitch height or range of three-point hitch heights; and a guardrail safety distance.

### Claim 10 (depends on 8)

The automatic implement recognition system of claim 8, wherein the operational setting for the tractor is selected from a group of operational settings for the tractor consisting of: steering of the tractor and speed of the tractor.

### Claim 11 (depends on 8)

The automatic implement recognition system of claim 8, wherein the tractor comprises an electric motor and a battery to power the electric motor and wherein the instructions are further configured to direct the processing resource to output a notification indicating an estimated remaining battery duration based on the comparison.

### Claim 12 (depends on 1)

The automatic implement recognition system of claim 1, wherein instructions are configured to cause the processing resource to carry out the optical flow on the series of images captured by the camera (1) in response to and during pulling of the candidate implement by the tractor or (2) in response to and during raising or lowering of the candidate implement by the tractor.

### Claim 13 (depends on 1)

The automatic implement recognition system of claim 1 further comprising a library of stored implement contours including the stored implement contour and a second stored implement contour, wherein the stored implement contour is a contour of an implement in a first implement state and wherein the second stored implement contour is a contour of the implement in a second implement state different than the first implement state.

### Claim 14 (depends on 1)

The automatic implement recognition system of claim 1, wherein the instructions are configured to direct the processing resource to determine a state of the candidate implement based upon the comparison of the contour to the stored implement contour.

### Claim 15 (depends on 14)

The automatic implement recognition system of claim 14, wherein the candidate implement has portions movable between a first position and a second position and wherein the state of the candidate implement comprises whether the candidate implement is at the first position or at the second position.

### Claim 16 (depends on 14)

The automatic implement recognition system of claim 14, wherein the candidate implement comprises extendable and retractable wings, wherein the first position is a retracted position of the wings and wherein the second position is an extended position of the wings.

### Claim 17 (depends on 1)

The automatic implement recognition system of claim 1, wherein the instructions are to direct the processing resource to:
carry out optical flow on a series of images captured by the camera during movement of a first portion of the candidate implement while a second portion of the candidate implement is stationary;
aggregate particular pixels based on relative pixel motion and classifying the particular pixels as belonging to the first portion of candidate implement;
determine a movable portion contour based on the particular pixels classified as belonging to the first portion;
compare the contour and the movable portion contour to a stored implement contour and a stored movable portion contour; and
output control signals to adjust operation of at least one of the tractor and the candidate implement based on the comparison.

### Claim 18 (depends on 1)

The automatic implement recognition system of claim 1, wherein the instructions are configured to direct the processing resource to:
carry out optical flow on a series of images captured by the camera during movement of a first portion of the candidate implement while a second portion of the candidate implement is stationary;
aggregate particular pixels based on relative pixel motion and classifying the particular pixels as belonging to the first portion of candidate implement;
determine a movable portion contour based on the particular pixels classified as belonging to the first portion;
compare the movable portion contour to a stored movable portion contour;
determine a state of the first portion of the candidate implement based upon the comparison of the movable portion contour to the stored movable portion contour; and
output control signals to adjust operation of at least one of the tractor and the candidate implement based on the determined state of the first portion of the candidate implement.

### Claim 19

A non-transitory computer-readable medium containing instructions configured to direct a processing resource to:
carry out optical flow on a series of images captured by the camera during movement of the candidate implement;
aggregate particular pixels based on relative pixel motion and classifying the particular pixels as belonging to the candidate implement;
determine a candidate implement contour based on the particular pixels classified as belonging to the candidate implement; and
compare the contour to a stored implement contour; and output control signals to adjust operation of at least one of the tractor and the candidate implement based on the comparison.

### Claim 20

An automatic implement recognition method comprising:
carrying out optical flow on a series of images captured by the camera during movement of the candidate implement;
aggregating particular pixels based on relative pixel motion and classifying the particular pixels as belonging to the candidate implement;
determining a candidate implement contour based on the particular pixels classified as belonging to the candidate implement;
comparing the contour to a stored implement contour; and
outputting control signals to adjust operation of at least one of the tractor and the candidate implement based on the comparison.
