# US 2026/0311074 A1 · Assembly line variant path planning system and method based on graph-based deep reinforcement learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0311074 A1
- Document ID: US20260311074A1
- Status: Published application
- Kind: A1
- Application number: 19/460,051
- Filed: 2026-01-26
- Published: 2026-10-08
- Earliest claimed: 2025-07-21
- Assignees: Guangdong University of Technology
- Applicants: Guangdong University of Technology
- Inventors: Jiewu LENG; Qianwei ZHANG; Tengliang ZHU; Lianhong ZHOU; Jiahe LI; Kailin XU; Qiang LIU
- Web page: https://patentgrep.com/patent/US20260311074A1

## CPC

- G06Q 10/047: Optimisation of routes or paths, e.g. travelling salesman problem
- G06F 3/042: by opto-electronic means
- G06N 3/092: Reinforcement learning
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

An assembly line variant path planning system based on graph-based deep reinforcement learning includes an input layer, a knowledge and mechanism layer, a core processing module, an output layer, and an application and feedback layer. An assembly line variant process is modelled as a graph structure and a reward function that precisely matches a change propagation preference objective is designed. By using the input change propagation preference mathematical model as a training basis, a neural network model constructed based on graph-based deep reinforcement learning is repeatedly trained until a model output result is stabilized and converged, thereby intelligently identifying an optimal preliminary variant path. A key dimensional linkage skeleton for subsequent instantiated reconstruction is provided by this optimal path, ultimately enabling rapid virtual-physical mapping modeling of the entire assembly process and significantly reducing time for physical assembly line reverse modeling.

## Claims

### Claim 1

An assembly line variant path planning system based on graph-based deep reinforcement learning, comprising:
an input layer, configured to receive initial information of a to-be-planned assembly line variant requirement as a data source;
a knowledge and mechanism layer, configured to provide a constraint condition;
a core processing module, configured to: exchange data with the input layer, convert the initial information into a graph structure, and perform graph-based deep reinforcement learning using a graph neural network and a reinforcement learning strategy to construct a neural network model; set a reward function matching a change propagation preference objective; and by using the reward function of the change propagation preference objective as a training basis and according to the constraint condition, train the neural network model to obtain an optimal variant path; and
an output layer, configured to: exchange data with the core processing module and output the optimal variant path.

### Claim 2 (depends on 1)

The assembly line variant path planning system according to claim 1, wherein
the knowledge and mechanism layer comprises a domain experience database and a mechanism model database; and
the domain experience database and the mechanism model database are each configured to exchange data with the core processing module to provide the constraint condition.

### Claim 3 (depends on 1)

The assembly line variant path planning system according to claim 1, wherein the core processing module comprises:
a graph-based modeling unit, configured to: exchange data with the input layer and convert the initial information into the graph structure;
a graph-based deep reinforcement learning unit, configured to: exchange data with the graph-based modeling unit, perform, based on the graph structure, graph-based deep reinforcement learning using the graph neural network and the reinforcement learning strategy, and obtain deep-learned graph information data; and
a reward function and optimization objective evaluation unit, configured to: exchange data with the graph-based deep reinforcement learning unit, calculate, based on the deep-learned graph information data and a change propagation preference mathematical model, a reward to obtain a final reward result, and obtain the optimal variant path based on the final reward result, wherein
the reward function and optimization objective evaluation unit is configured to exchange data with the output layer, to output the optimal variant path.

### Claim 4 (depends on 3)

The assembly line variant path planning system according to claim 3, wherein the core processing module further comprises a knowledge fusion unit, wherein
the knowledge fusion unit is configured to: exchange data with the reward function and optimization objective evaluation unit and provide the constraint condition during construction of the change propagation preference mathematical model.

### Claim 5 (depends on 3)

The assembly line variant path planning system according to claim 3, wherein the graph-based modeling unit is configured to convert the initial information into the graph structure, and is specifically configured to:
convert the initial information into text via a graph-text multimodal model;
perform a cross-multiplication between visual_embedding and text_embedding in the graph-text multimodal model to obtain a to-be-used matrix of [N, N];
sequentially multiply values on a diagonal of the to-be-used matrix to obtain paired feature inner products;
compare the paired feature inner products and select a maximum value as a selection item;
obtain an image architecture via an image editor, add positional information to the image architecture, and unfold a feature map into a sequence, to obtain a priority of each graph block; and
correlate the selection item with a position of a graph block having a highest priority until the graph structure is obtained.

### Claim 6 (depends on 1)

The assembly line variant path planning system according to claim 1, further comprising: an application and feedback layer, wherein
the application and feedback layer is configured to: exchange data with the core processing module, collect actual data from an assembly line applying the optimal variant path, and send the actual data to a reward function and optimization objective evaluation unit in the core processing module to optimize the optimal variant path.

### Claim 7 (depends on 1)

An assembly line variant path planning method using the assembly line variant path planning system according to claim 1, comprising:
receiving the initial information of the to-be-planned assembly line variant requirement as the data source;
converting the initial information into the graph structure, and performing graph-based deep reinforcement learning using the graph neural network and the reinforcement learning strategy to construct the neural network model, so as to obtain the deep-learned graph information data;
setting the reward function matching the change propagation preference objective; and by using the reward function of the change propagation preference objective as the training basis and according to the constraint condition, training the neural network model to obtain the optimal variant path; and
collecting actual data from the assembly line applying the optimal variant path; and optimizing the optimal variant path using the actual data.
