# US 2025/0209656 A1 · Method and system for calculating leaf area of plant and electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0209656 A1
- Document ID: US20250209656A1
- Status: Published application
- Kind: A1
- Application number: 18/918,949
- Filed: 2024-10-17
- Published: 2025-06-26
- Earliest claimed: 2023-12-25
- Assignees: Zhejiang University of Science and Technology
- Applicants: Zhejiang University of Science & Technology
- Inventors: Xing XU; Yun ZHAO; Yuan YANG
- Web page: https://patentgrep.com/patent/US20250209656A1

## CPC

- G06T 7/0012: {Biomedical image inspection}
- G06T 7/62: of area, perimeter, diameter or volume
- G01C 21/20: Instruments for performing navigational calculations (G01C21/24, G01C21/26 take precedence)
- G05D 1/243: Means capturing signals occurring naturally from the environment, e.g. ambient optical, acoustic, gravitational or magnetic signals (using passive navigation aids external to the vehicle G05D1/244; using signals from positioning sensors located off-board the vehicle G05D1/249)
- G05D 1/644: Optimisation of travel parameters, e.g. of energy consumption, journey time or distance
- G06T 7/149: involving deformable models, e.g. active contour models
- G06V 10/454: {Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]}
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06V 10/806: {of extracted features}
- G06V 10/82: using neural networks
- G06V 20/188: {Vegetation}
- G05D 2101/20: using external object recognition
- G05D 2107/21: {Farming, e.g. fields, pastures or barns}
- G05D 2109/10: Land vehicles
- G06T 2207/10024: Color image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30188: Vegetation; Agriculture
- Y02P 90/30: Computing systems specially adapted for manufacturing
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- Y02P: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS

## Abstract

Provided is a method, system, and electronic device for calculating a leaf area of a plant, relating to the field of image processing. The method includes: obtaining a leaf image of a target plant on a planned path, where the planned path is a path determined based on a dynamic window approach (DWA) path planning algorithm; segmenting the leaf image by using a UNet model to obtain a leaf segmentation image, where the UNet model includes an encoder, a decoder, and a trained segmentation network that are connected to each other; and calculating a leaf area based on the leaf segmentation image. This application can achieve rapid and accurate segmentation of leaf images and calculation of leaf areas.

## Claims

### Claim 1

A method for calculating a leaf area of a plant, comprising:
obtaining a leaf image of a target plant on a planned path, wherein the planned path is a path determined based on a dynamic window approach (DWA) path planning algorithm;
segmenting the leaf image by using a UNet model, to obtain a leaf segmentation image, wherein the UNet model comprises an encoder, a decoder, and a trained segmentation network that are connected to each other; and
calculating a leaf area based on the leaf segmentation image.

### Claim 2 (depends on 1)

The method for calculating a leaf area of a plant according to claim 1, wherein the leaf image is an RGB image captured by using an RGB camera mounted on a target robot.

### Claim 3 (depends on 2)

The method for calculating a leaf area of a plant according to claim 2, wherein a process for determining the planned path comprises:
determining a travel route of the target robot, wherein the travel route is determined by a line connecting a starting point and a target point;
obtaining travel data of the target robot on the travel route in real time in a form of a dynamic window, wherein the travel data comprises obstacle position data, a travel direction, and a travel speed;
determining a trajectory function based on the DWA path planning algorithm; and
determining the planned path based on the travel data and the trajectory function.

### Claim 4 (depends on 3)

The method for calculating a leaf area of a plant according to claim 3, wherein an expression of the trajectory function is as follows:
G
⁡
(
v
,
w
)
=
σ
⁡
(
α
*
heading
⁢
(
v
,
w
)
+
β
*
d
⁢
ist
⁢
(
v
,
w
)
+
γ
*
velocity
⁢
(
v
,
w
)
)
;
wherein G(v, w) is the trajectory function; v is the travel speed; w is an angular velocity of travel; σ is a first weight coefficient; α is a second weight coefficient; β is a third weight coefficient; γ is a fourth weight coefficient; heading(v, w) is an azimuth function; velocity(v, w) is a linear velocity of the target robot; and dist(v, w) is a distance from the target robot to an obstacle.

### Claim 5 (depends on 1)

The method for calculating a leaf area of a plant according to claim 1, wherein the segmenting the leaf image by using the UNet model to obtain the leaf segmentation image specifically comprises:
extracting, by the encoder, features of the leaf image, to obtain image feature information;
performing, by the decoder, data fusion based on the image feature information, to obtain fused feature data; and
segmenting, by the trained segmentation network, the fused feature data, to obtain the leaf segmentation image.

### Claim 6 (depends on 5)

The method for calculating a leaf area of a plant according to claim 5, wherein a process for determining the UNet model comprises:
obtaining training data, wherein the training data comprises: leaf images for training and leaf segmentation images corresponding to the leaf images for training;
extracting, by the encoder, features from the leaf images for training, to obtain image feature information for training;
performing data fusion based on the image feature information for training, to obtain fused feature data for training;
constructing a segmentation network;
inputting the fused feature data for training into the segmentation network, updating and optimizing model parameters by using a stochastic gradient descent method with an objective of minimizing a loss value, to obtain a trained segmentation network, wherein the model parameters comprise weight values; the loss value is determined using a cross-entropy loss function based on a difference between output data of the segmentation network and the leaf segmentation images corresponding to the leaf images for training; and
connecting the encoder, the decoder, and the trained segmentation network to form the UNet model.

### Claim 7 (depends on 1)

The method for calculating a leaf area of a plant according to claim 1, wherein the calculating a leaf area based on the leaf segmentation image specifically comprises:
extracting a contour of the leaf segmentation image to obtain a leaf contour;
converting the leaf contour into a binary image;
performing morphological processing on the binary image, removing noise, and eliminating a blank area, to obtain a processed image;
performing connected component analysis on the processed image to obtain a leaf region; and
determining the leaf area based on the obtained leaf region.

### Claim 8

A system for calculating a leaf area of a plant, comprising:
an image obtaining module, configured to obtain a leaf image of a target plant on a planned path, wherein the planned path is a path determined based on a dynamic window approach (DWA) path planning algorithm;
a segmentation module, configured to segment the leaf image by using a UNet model, to obtain a leaf segmentation image; and
a calculation module, configured to calculate a leaf area based on the leaf segmentation image.

### Claim 9 (depends on 1)

An electronic device, comprising a memory and a processor, wherein the memory is configured to store a computer program, and the processor runs the computer program to enable the electronic device to implement the method for calculating a leaf area of a plant according to claim 1.

### Claim 10 (depends on 9)

The electronic device according to claim 9, wherein the memory is a computer-readable storage medium.

### Claim 11 (depends on 9)

The electronic device according to claim 9, wherein the leaf image is an RGB image captured by using an RGB camera mounted on a target robot.

### Claim 12 (depends on 11)

The electronic device according to claim 11, wherein a process for determining the planned path comprises:
determining a travel route of the target robot, wherein the travel route is determined by a line connecting a starting point and a target point;
obtaining travel data of the target robot on the travel route in real time in a form of a dynamic window, wherein the travel data comprises obstacle position data, a travel direction, and a travel speed;
determining a trajectory function based on the DWA path planning algorithm; and
determining the planned path based on the travel data and the trajectory function.

### Claim 13 (depends on 12)

The electronic device according to claim 12, wherein an expression of the trajectory function is as follows:
G
⁡
(
v
,
w
)
=
σ
⁡
(
α
*
heading
⁢
(
v
,
w
)
+
β
*
d
⁢
ist
⁢
(
v
,
w
)
+
γ
*
velocity
⁢
(
v
,
w
)
)
;
wherein G(v, w) is the trajectory function; v is the travel speed; w is an angular velocity of travel; σ is a first weight coefficient; α is a second weight coefficient; β is a third weight coefficient; γ is a fourth weight coefficient; heading(v, w) is an azimuth function; velocity(v, w) is a linear velocity of the target robot; and dist(v, w) is a distance from the target robot to an obstacle.

### Claim 14 (depends on 9)

The electronic device according to claim 9, wherein the segmenting the leaf image by using the UNet model to obtain the leaf segmentation image specifically comprises:
extracting, by the encoder, features of the leaf image, to obtain image feature information;
performing, by the decoder, data fusion based on the image feature information, to obtain fused feature data; and
segmenting, by the trained segmentation network, the fused feature data, to obtain the leaf segmentation image.

### Claim 15 (depends on 14)

The electronic device according to claim 14, wherein a process for determining the UNet model comprises:
obtaining training data, wherein the training data comprises: leaf images for training and leaf segmentation images corresponding to the leaf images for training;
extracting, by the encoder, features from the leaf images for training, to obtain image feature information for training;
performing data fusion based on the image feature information for training, to obtain fused feature data for training;
constructing a segmentation network;
inputting the fused feature data for training into the segmentation network, updating and optimizing model parameters by using a stochastic gradient descent method with an objective of minimizing a loss value, to obtain a trained segmentation network, wherein the model parameters comprise weight values; the loss value is determined using a cross-entropy loss function based on a difference between output data of the segmentation network and the leaf segmentation images corresponding to the leaf images for training; and
connecting the encoder, the decoder, and the trained segmentation network to form the UNet model.

### Claim 16 (depends on 9)

The electronic device according to claim 9, wherein the calculating a leaf area based on the leaf segmentation image specifically comprises:
extracting a contour of the leaf segmentation image to obtain a leaf contour;
converting the leaf contour into a binary image;
performing morphological processing on the binary image, removing noise, and eliminating a blank area, to obtain a processed image;
performing connected component analysis on the processed image to obtain a leaf region; and
determining the leaf area based on the obtained leaf region.

### Claim 17 (depends on 11)

The electronic device according to claim 11, wherein the memory is a computer-readable storage medium.

### Claim 18 (depends on 12)

The electronic device according to claim 12, wherein the memory is a computer-readable storage medium.

### Claim 19 (depends on 13)

The electronic device according to claim 13, wherein the memory is a computer-readable storage medium.

### Claim 20 (depends on 14)

The electronic device according to claim 14, wherein the memory is a computer-readable storage medium.
