# US 2023/0408292 A1 · Agricultural Operation Mapping

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0408292 A1
- Document ID: US20230408292A1
- Status: Published application
- Kind: A1
- Application number: 18/336,650
- Filed: 2023-06-16
- Published: 2023-12-21
- Earliest claimed: 2022-06-17
- Assignees: AGCO International GmbH
- Applicants: AGCO International GmbH
- Inventors: Esma Mujkic
- Web page: https://patentgrep.com/patent/US20230408292A1

## CPC

- A01B 69/001: {Steering by means of optical assistance, e.g. television cameras (steering devices for road marking vehicles E01C23/163)}
- G01C 21/3833: {characterised by the source of data}
- G01C 21/3807: {characterised by the type of data}
- G05D 1/024: {in combination with a laser (lasers per se H01S)}
- G05D 1/0246: {using a video camera in combination with image processing means}
- G05D 1/0274: {using mapping information stored in a memory device (navigation using map-matching G01C21/30)}
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- A01B: SOIL WORKING IN AGRICULTURE OR FORESTRY; PARTS, DETAILS, OR ACCESSORIES OF AGRICULTURAL MACHINES OR IMPLEMENTS, IN GENERAL (making or covering furrows or holes for sowing, planting or manuring A01C5/00; mowers convertible to soil working apparatus or capable of soil working A01D42/04; mowers combined with soil working implements A01D43/12; soil working for engineering purposes E01, E02, E21)
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems and methods are provided for mapping one or more agricultural operations within a working environment. Image data is received from one or more imaging sensors mounted or otherwise associated with one or more agricultural machines within the working environment and configured to obtain image data indicative of the working environment and/or one or more objects located therein. The data is analysed utilising a detection model to classify one or more objects within the working environment to identify, from the one or more classified objects, one or more working machines within the working environment. Operational information for the working machine(s) is logged and/or updated in an operational map of the working environment in dependence on the identification of the classified object(s).

## Claims

### Claim 1

A system for mapping one or more agricultural operations within a working environment, comprising:
one or more imaging sensors mounted or otherwise associated with one or more agricultural machines within the working environment and configured to obtain image data indicative of the working environment and/or one or more objects located therein; and
one or more controllers, configured to:
receive image data from the one or more imaging sensors;
analyse the image data utilising a detection model to classify one or more objects within the working environment;
identify, from the one or more classified objects, one or more working machines within the working environment; and
log and/or update operational information associated with the one or more identified working machines within an operational map of the working environment in dependence on the identification of the classified object(s);
wherein the operational information comprises an indication of an operational task being performed by the working machine.

### Claim 2 (depends on 1)

A system of claim 1, wherein the one or more controllers are configured to receive image data from one or more imaging sensors on or otherwise associated with each of a plurality of agricultural machines operating within the environment.

### Claim 3 (depends on 1)

A system of claim 1, wherein the one or more controllers are configured to determine operational information for the one or more identified working machines, or an update to be applied thereto, in dependence on the received image data.

### Claim 4 (depends on 1)

A system of claim 1, wherein the operational information includes positional information for the one or more identified working machines.

### Claim 5 (depends on 4)

A system of claim 4, wherein the positional information includes one or more of:
an absolute position of the one or more identified working machines;
a relative position of the one or more identified working machines with respect to the imaging sensor(s) and/or with respect to the agricultural machine associated with the imaging sensor(s) from which the operational information is determined; and
a direction of travel of the one or more identified working machines.

### Claim 6 (depends on 1)

A system of claim 1, wherein the operational information comprises an indication of whether the working machine is or is not performing an operational task.

### Claim 7 (depends on 1)

A system of claim 1, wherein the one or more imaging sensors include: a camera; and/or a transceiver sensor.

### Claim 8 (depends on 1)

A system of claim 1, wherein the detection model comprises a machine-learned model trained on one or more training datasets with known objects with respective classifications.

### Claim 9 (depends on 1)

A system of claim 1, wherein the classification output by the detection model comprises a bounding box overlaid onto the image data at the location of the object as determined by the model; and wherein the position of the bounding box within the image data is utilised by the one or more controllers of the system for determining positional information for the respective working machine.

### Claim 10 (depends on 1)

A system of claim 1, wherein the one or more controllers are configured to receive positional data from a positioning system associated with the agricultural machine(s).

### Claim 11 (depends on 10)

A system of claim 10, wherein the one or more controllers are configured to utilise the positional data for an agricultural machine and image data from sensor(s) associated with that machine to determine positional information for the working machine(s) in dependence thereon.

### Claim 12 (depends on 1)

A system of claim 1, wherein the operational map is stored on a remote data server accessible through a suitable wireless communication link at the one or more agricultural machines, or remotely by an operator for the working environment overseeing individual operational tasks performed therein.

### Claim 13 (depends on 1)

A system of claim 1, comprising a user interface; and wherein the one or more controllers are configured to generate a representation of the operational map for display by, and optionally provide interaction via, the user interface.

### Claim 14

A control system for mapping one or more agricultural operations within a working environment, the control system comprising one or more controllers, and being configured to:
receive image data from one or more imaging sensors mounted or otherwise associated with one or more agricultural machines within the working environment and configured to obtain image data indicative of the working environment and/or one or more objects located therein;
analyse the image data utilising a detection model to classify one or more objects within the working environment;
identify, from the one or more classified objects, one or more working machines within the working environment; and
control the logging and/or updating of operational information associated with the one or more identified working machines within an operational map of the working environment in dependence on the identification of the classified object(s);
wherein the operational information comprises an indication of an operational task being performed by the working machine.

### Claim 15

A method of mapping one or more agricultural operations within a working environment, comprising:
receiving image data from one or more imaging sensors mounted or otherwise associated with one or more agricultural machines within the working environment and configured to obtain image data indicative of the working environment and/or one or more objects located therein;
analysing the image data utilising a detection model to classify one or more objects within the working environment;
identifying, from the one or more classified objects, one or more working machines within the working environment; and
controlling the logging and/or updating of operational information associated with the one or more identified working machines within an operational map of the working environment in dependence on the identification of the classified object(s);
wherein the operational information comprises an indication of an operational task being performed by the working machine.
