# US 2025/0095138 A1 · Individual plant recognition and localization

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095138 A1
- Document ID: US20250095138A1
- Status: Published application
- Kind: A1
- Application number: 18/959,186
- Filed: 2024-11-25
- Published: 2025-03-20
- Earliest claimed: 2019-06-24
- Assignees: Deere & Company
- Applicants: Deere & Company
- Inventors: Jie Yang; Zhiqiang Yuan; Hongxu Ma; Cheng-en Guo; Elliott Grant; Yueqi Li
- Web page: https://patentgrep.com/patent/US20250095138A1

## CPC

- G06T 7/001: {using an image reference approach}
- G05D 1/0033: {by having the operator tracking the vehicle either by direct line of sight or via one or more cameras located remotely from the vehicle}
- G05D 1/2235: {involving the operator tracking the vehicle by direct line of sight}
- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06F 18/285: {Selection of pattern recognition techniques, e.g. of classifiers in a multi-classifier system}
- G06N 3/0418: {using chaos or fractal principles}
- G06N 3/045: Combinations of networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/09: Supervised learning
- G06V 10/255: {Detecting or recognising potential candidate objects based on visual cues, e.g. shapes}
- G06V 10/74: Image or video pattern matching; Proximity measures in feature spaces
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/776: Validation; Performance evaluation
- G06V 10/82: using neural networks
- G06V 20/188: {Vegetation}
- G06V 20/20: in augmented reality scenes
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30188: Vegetation; Agriculture
- G06V 2201/10: Recognition assisted with metadata
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Implementations are described herein for training and applying machine learning models to digital images capturing plants, and to other data indicative of attributes of individual plants captured in the digital images, to recognize individual plants in distinction from other individual plants. In various implementations, a digital image that captures a first plant of a plurality of plants may be applied, along with additional data indicative of an additional attribute of the first plant observed when the digital image was taken, as input across a machine learning model to generate output. Based on the output, an association may be stored in memory, e.g., of a database, between the digital image that captures the first plant and one or more previously-captured digital images of the first plant.

## Claims

### Claim 1

A client device comprising:
a network interface subsystem to obtain a first image that captures a depiction of an individual plant within a plurality of plants;
instructions that, in response to execution by one or more processors, cause the one or more processors to execute a trained machine learning model using the first image as an input, wherein the execution of the trained machine learning model generates an identifier of the individual plant; and
a display to present a change to the individual plant over time, wherein the instructions cause the one or more processors to determine visuals to present on the display based on the identifier of the individual plant and one or more previously-captured images that include the individual plant.

### Claim 2 (depends on 1)

The client device of claim 1, wherein the instructions cause the one or more processors to present a user interface on the display that includes a time-lapsed sequence of the individual plant.

### Claim 3 (depends on 2)

The client device of claim 2, wherein the instructions cause the one or more processors to:
predict a growth rate or yield of the individual plant based on the time-lapsed sequence; and
cause the display to present the prediction.

### Claim 4 (depends on 1)

The client device of claim 1, wherein the instructions cause the one or more processors to present a user interface on the display that shows disease progression associated with the individual plant.

### Claim 5 (depends on 1)

The client device of claim 1, wherein:
the identifier is a first identifier of the individual plant that corresponds to the first image; and
before causing the display to present the change to the individual plant over time, the instructions cause the one or more processors to:
execute the trained machine learning model using the previously-captured images as inputs, wherein the execution of the trained machine learning model generates a plurality of identifiers of the individual plant that correspond to the previously-captured images; and
associate the first identifier with the plurality of identifiers.

### Claim 6 (depends on 1)

The client device of claim 1, wherein the client device is one of a mobile phone, tablet, virtual reality apparatus, an augmented reality apparatus, or an in-vehicle navigation system.

### Claim 7 (depends on 1)

The client device of claim 1, wherein the instructions cause the one or more processors to:
process the first image to generate a bounding shape that corresponds to the individual plant; and
execute the trained machine learning model using both the first image and the bounding shape as inputs.

### Claim 8 (depends on 7)

The client device of claim 7, wherein the bounding shape is the smallest size possible that encloses outer extremities of the individual plant.

### Claim 9 (depends on 7)

The client device of claim 7, wherein the bounding shape encloses a predetermined percentage of the individual plant.

### Claim 10 (depends on 7)

The client device of claim 7, wherein:
the trained machine learning model is a first trained machine learning model; and
the instructions cause the one or more processors to generate the bounding shape by executing a second trained machine learning model.

### Claim 11 (depends on 1)

The client device of claim 1, wherein:
the trained machine learning model is a first trained machine learning model; and
the instructions cause the one or more processors to:
execute the first trained machine learning model in response to a determination that the plurality of plants are a first genus or species of plant; and
execute a second trained machine learning model in response to a determination that the plurality of plants are a different genus or species of plant, wherein the execution of both the first trained machine learning model and the second trained machine learning model generate an identifier of the individual plant.

### Claim 12 (depends on 1)

The client device of claim 1, wherein the instructions cause the one or more processors to execute the trained machine learning model using both the first image and a position coordinate indicative of a location of the individual plant as inputs.

### Claim 13 (depends on 1)

The client device of claim 1, wherein the instructions cause the one or more processors to execute the trained machine learning model using both the first image and a time interval since a milestone in a life of the individual plant as inputs.

### Claim 14

One or more non-transitory machine readable storage media comprising instructions to cause one or more processors to at least:
obtain a first image that captures a depiction of an individual plant within a plurality of plants;
execute a trained machine learning model using the first image as an input, wherein the execution of the trained machine learning model generates an identifier of the individual plant; and
cause a display to present a change to the individual plant over time, wherein the instructions cause the one or more processors to determine visuals to present on the display based on the identifier of the individual plant and one or more previously-captured images that include the individual plant.

### Claim 15 (depends on 14)

The one or more non-transitory machine readable storage media of claim 14, wherein the instructions cause the one or more processors to present a user interface on the display that includes a time-lapsed sequence of the individual plant.

### Claim 16 (depends on 15)

The or more non-transitory machine readable storage media of claim 15, wherein the instructions cause the one or more processors to:
predict a growth rate or yield of the individual plant based on the time-lapsed sequence; and
cause the display to present the prediction.

### Claim 17 (depends on 14)

The or more non-transitory machine readable storage media of claim 14, wherein the instructions cause the one or more processors to present a user interface on the display that shows disease progression associated with the individual plant.

### Claim 18 (depends on 14)

The or more non-transitory machine readable storage media of claim 14, wherein:
the identifier is a first identifier of the individual plant that corresponds to the first image; and
before causing the display to present the change to the individual plant over time, the instructions cause the one or more processors to:
execute the trained machine learning model using the previously-captured images as inputs, wherein the execution of the trained machine learning model generates a plurality of identifiers of the individual plant that correspond to the previously-captured images; and
associate the first identifier with the plurality of identifiers.

### Claim 19

A method comprising:
obtaining, with a client device, a first image that captures a depiction of an individual plant within a plurality of plants;
executing, with the client device, a trained machine learning model using the first image as an input, wherein the execution of the trained machine learning model generates an identifier of the individual plant;
causing, with the client device, a display to present a change to the individual plant over time; and
determining visuals to present on the display based on a) the first image, b) the identifier of the individual plant, and c) one or more previously-acquired images that include the individual plant.

### Claim 20 (depends on 19)

The method of claim 19, further including presenting a user interface on the display that includes a time-lapsed sequence of the individual plant.
