# US 2025/0093884 A1 · Self-propelled agricultural work machine with image-based control > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0093884 A1 - Document ID: US20250093884A1 - Status: Published application - Kind: A1 - Application number: 18/886,006 - Filed: 2024-09-16 - Published: 2025-03-20 - Earliest claimed: 2023-09-14 - Assignees: CLAAS Selbstfahrende Erntemaschinen GmbH - Applicants: CLAAS Selbstfahrende Erntemaschinen GmbH - Inventors: Bastian Bormann; Waldemar Thiesmann; Christoph Bussmann; Timo Korthals; Dennis Neitemeier; Andreas Wilken; Maik Heufekes; Torben Töniges - Web page: https://patentgrep.com/patent/US20250093884A1 ## CPC - G05D 1/65: Following a desired speed profile - A01D 41/1271: {for measuring crop flow} - A01D 41/1274: {for drives} - G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching} - G06V 20/188: {Vegetation} - G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle - G05D 2105/15: for harvesting, sowing or mowing in agriculture or forestry - G05D 2107/21: {Farming, e.g. fields, pastures or barns} - G05D 2111/10: Optical signals - G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES - A01D: HARVESTING; MOWING - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A self-propelled agricultural working machine. The self-propelled agricultural working machine includes working units for collecting, processing and forwarding harvested material of a crop, a drive motor for driving the working units and propelling the self-propelled agricultural work machine at a travel speed, a camera device for capturing a digital image of the crop. A processor determines the available proportion of the harvested material based on the digital image and automatically adjusts the self-propelled agricultural work machine based thereon, including automatically adjusting the working units and/or the travel speed. ## Claims ### Claim 1 A self-propelled agricultural work machine comprising: one or more working units configured to perform one or more of collecting, processing and forwarding harvested material of a crop of an agricultural field; at least one drive motor configured to drive the one or more working units and to propel the self-propelled agricultural working machine at a travel speed along the agricultural field; at least one camera device configured to capture one or more images of the crop of the agricultural field in an environment of the self-propelled agricultural work machine; at least one processor configured to: automatically determine a proportion of the harvested material present in the crop using the one or more images of the camera device; and automatically adjust, based on the proportion of the harvested material present in the crop, one or both of: at least one working unit of the one or more working units; or the travel speed of the self-propelled agricultural work machine. ### Claim 2 (depends on 1) The self-propelled agricultural work machine of claim 1, wherein the at least one processor is configured to determine in a plurality of different areas of the one or more images the proportion of harvested material in the crop in each respective area of the plurality of different areas; and wherein the at least one processor is configured to automatically adjust, based on the proportion of the harvested material present in the crop in at least one respective area of the plurality of different areas, by commanding one or both of: at least one working unit to adjust the at least one of the one or more working units; or the at least one drive motor to adjust the travel speed of the self-propelled agricultural work machine. ### Claim 3 (depends on 2) The self-propelled agricultural work machine of claim 2, wherein the plurality of different areas comprise at least one of: a closer area of the environment of the self-propelled agricultural work machine; a remote area of the environment of the self-propelled agricultural work machine; or a middle area of the environment of the self-propelled agricultural work machine between the closer area and the remote area; and wherein the at least one processor is configured to automatically adjust based on the proportion of the harvested material present in the crop in at least one of the closer area, the remote area, or the middle area. ### Claim 4 (depends on 3) The self-propelled agricultural work machine of claim 3, wherein the at least one processor is configured to perform one or both of: control a more precise adjustment of one or both of the at least one working unit or the travel speed of the self-propelled agricultural work machine depending on the proportion of harvested material in the closer area; or control a less precise adjustment of one or both of the at least one working unit or the travel speed of the self-propelled agricultural work machine depending on the proportion of harvested material in one or both of the middle area or the remote area. ### Claim 5 (depends on 1) The self-propelled agricultural work machine of claim 1, wherein the at least one processor is configured to determine in a plurality of different areas of the one or more images the proportion of harvested material in the crop in each respective area of the plurality of different areas; and wherein the at least one processor is configured to automatically adjust, based on the proportion of the harvested material present in the crop in each respective area of the plurality of different areas, by commanding one or both of: the at least one working unit; or the at least one drive motor to adjust the travel speed of the self-propelled agricultural work machine. ### Claim 6 (depends on 5) The self-propelled agricultural work machine of claim 5, wherein the plurality of different areas comprise: a closer area of the environment of the self-propelled agricultural work machine; a remote area of the environment of the self-propelled agricultural work machine; or a middle area of the environment of the self-propelled agricultural work machine in between the closer area and the remote area; and wherein the at least one processor is configured to automatically adjust based on the proportion of the harvested material present in the crop in each of the closer area, the remote area, or the middle area. ### Claim 7 (depends on 6) The self-propelled agricultural work machine of claim 6, wherein the at least one processor is configured to: control a more precise adjustment of one or both of the at least one working unit or the travel speed of the self-propelled agricultural work machine depending on the proportion of harvested material in the closer area; and control a less precise adjustment of one or both of the at least one working unit or the travel speed of the self-propelled agricultural work machine depending on the proportion of harvested material in one or both of the middle area or the remote area. ### Claim 8 (depends on 1) The self-propelled agricultural work machine of claim 1, further comprising at least one sensor device configured to detect an operating state of the self-propelled agricultural work machine; and wherein the at least one processor is configured to adjust one or both of the at least one working unit or the travel speed of the self-propelled agricultural work machine depending on both of the operating state detected by the at least one sensor device and the proportion of the harvested material that is available. ### Claim 9 (depends on 8) The self-propelled agricultural work machine of claim 8, wherein the at least one processor is configured to make an immediate accurate adjustment of one or both of the at least one working unit or the travel speed of the self-propelled agricultural work machine depending on the operating state of the self-propelled agricultural work machine; and wherein the immediate accurate adjustment comprises a smaller adjustment parameter range than a short-term precise adjustment. ### Claim 10 (depends on 1) The self-propelled agricultural work machine of claim 1, wherein complete plants of the crop each have a peduncle and an infructescence of inflorescence; wherein incomplete plants of the crop have at most one peduncle; wherein the at least one processor is configured to: detect one or more image areas indicative of the inflorescences of the crop within the one or more images and to determine the proportion of the harvested material present based on the one or more image areas indicative of the inflorescences; or detect one or more image areas indicative of the peduncles of the crop within the one or more images and to determine a non-existent proportion of the harvested material based on the one or more image areas indicative of the peduncles. ### Claim 11 (depends on 10) The self-propelled agricultural work machine of claim 10, wherein the at least one processor is configured to use one or more border polygons to detect the one or more image areas relating to the inflorescences of the crop. ### Claim 12 (depends on 11) The self-propelled agricultural work machine of claim 11, wherein the at least one processor is configured to use a number of pixels of the one or more image areas within the border polygons with respect to the inflorescences of the crop within the one or more images in order to determine the proportion of the harvested material. ### Claim 13 (depends on 12) The self-propelled agricultural work machine of claim 12, wherein the at least one processor is configured to use one or more rectangular border polygons to detect the one or more image areas relating to the inflorescences of the crop. ### Claim 14 (depends on 12) The self-propelled agricultural work machine of claim 12, wherein the at least one processor configured to combine overlapping image areas present in the one or more images with respect to the inflorescences of the crop to form a respective image area. ### Claim 15 (depends on 14) The self-propelled agricultural work machine of claim 14, wherein the at least one processor configured to combine overlapping border polygons present in the one or more images with respect to the inflorescences of the crop to form a border polygon. ### Claim 16 (depends on 1) The self-propelled agricultural work machine of claim 1, wherein the at least one processor is configured to use one or more of harvested material information, weather information, location information, satellite-based information or field information in determining the proportion of the harvested material. ### Claim 17 (depends on 1) The self-propelled agricultural work machine of claim 1, wherein the at least one processor is configured to use each of harvested material information, weather information, location information, satellite-based information or field information in determining the proportion of the harvested material. ### Claim 18 (depends on 1) The self-propelled agricultural work machine of claim 1, wherein the at least one processor is configured to adjust one or more of the at least one working unit or the travel speed of the self-propelled agricultural work machine based on the proportion of the harvested material so that the adjustment results in a predetermined harvested material flow being adjusted by the self-propelled agricultural work machine. ### Claim 19 (depends on 1) The self-propelled agricultural work machine of claim 1, wherein the at least one processor is configured to adjust the one or more of the at least one working unit or the travel speed of the self-propelled agricultural work machine based on the proportion of the harvested material so that the adjustment results in reduction in a loss of the harvested material from the self-propelled agricultural work machine. ### Claim 20 A method for controlling a self-propelled agricultural work machine comprising: operating the self-propelled agricultural work machine, the self-propelled agricultural work machine comprising: one or more working units configured to perform one or more of collecting, processing and forwarding harvested material of a crop of an agricultural field; at least one drive motor configured to drive the one or more working units and to propel the self-propelled agricultural working machine at a travel speed along the agricultural field; at least one camera device configured to capture one or more images of the crop of the agricultural field in an environment of the self-propelled agricultural work machine; automatically determining a proportion of the harvested material present in the crop using the one or more images of the camera device; and automatically adjusting, based on the proportion of the harvested material present in the crop, one or both of: at least one working unit of the one or more working units; or the travel speed of the self-propelled agricultural work machine.