Method, apparatus and device for automated control code generation and verification, and storage medium

A device for automated control code generation and verification, comprising:

• a memory,
• a processor, and
• a program for automated control code generation and verification stored in the memory and executable on the processor, wherein the program for automated control code generation and verification is configured to implement a computer-implemented method for automated control code generation and verification applied to a large language model;
• the device further comprises a software motion control system, and the software motion control system comprises a simulation motion engine and a real-time motion engine;
• and the method comprises:
• receiving a natural language command, wherein the natural language command is configured to instruct the large language model to output a code text that meets control requirements corresponding to the natural language command;
• performing matching retrieval on a vector database according to the natural language command to obtain a sample code snippet;
• obtaining Application Programming Interface (API) structured information corresponding to the sample code snippet from a knowledge graph database;
• generating an initial control code according to the sample code snippet and the API structured information;
• and
• performing a multi-level virtual operation verification on the initial control code in the software motion control system, and generating a target control code according to multi-level verification results confirmed multiple times by the user and the initial control code;
• wherein the performing the multi-level virtual operation verification on the initial control code in the software motion control system, and generating the target control code according to multi-level verification results confirmed multiple times by the user and the initial control code comprises:
• transmitting the initial control code to the simulation motion engine for device simulation operation to obtain a code execution result, and semantically matching the code execution result with the natural language command to generate a first verification result;
• after the user confirms the first verification result, driving a three-dimensional simulation model through the simulation motion engine to display a device motion process corresponding to the initial control code, and generating a second verification result, the user visually observes whether a device action corresponding to the initial control code in the three-dimensional simulation model meets the control requirements through the second verification result;
• after the user confirms the second verification result, periodically collecting motion process data of the simulation motion engine during operation, and generating a third verification result according to the motion process data, wherein the motion process data comprises position, speed, current feedback and IO status of a control axis;
• and
• after the user confirms the third verification result, using the control code finally confirmed by the user as the target control code;
• wherein the generating the first verification result comprises:
• in response to a semantic matching degree between an operation result and the natural language command is lower than a preset matching threshold, triggering an error correction process;
• querying the knowledge graph database according to operation error information to obtain error API node information, wherein the error API node information comprises API explanation information, sample error code, sample error code meaning and sample error code optimization suggestion;
• generating a first correction control code according to the error API node information and the initial control code;
• and
• re-executing the first correction control code and updating the first verification result;
• wherein the generating the third verification result according to the motion process data comprises:
• dividing the motion process data into multiple verification intervals according to a preset time stage;
• and
• in each verification interval, comparing, by the user, a real-time parameter with an expected value of the corresponding stage to generate the third verification result;
• wherein after the performing the multi-level virtual operation verification on the initial control code in the software motion control system, and generating the target control code according to the multi-level verification results confirmed multiple times by the user and the initial control code, the method further comprises:
• in response to user's execution decision, synchronizing runtime environment configuration of the simulation motion engine to the real-time motion engine, wherein after the configuration synchronization, axis numbers of the simulation motion engine and the real-time motion engine correspond one to one, and the simulation motion engine and the real-time motion engine use same motion control function library;
• and
• sending the control code to the real-time motion engine to periodically control an automated device based on the target control code through the real-time motion engine.

A non-transitory computer-readable storage medium, wherein a program for automated control code generation and verification is stored on the non-transitory computer-readable storage medium, and when the program for automated control code generation and verification is executed by a processor, a computer-implemented method for automated control code generation and verification is implemented;

• wherein the method is applied to a large language model and comprises:
• receiving a natural language command, wherein the natural language command is configured to instruct the large language model to output a code text that meets control requirements corresponding to the natural language command;
• performing matching retrieval on a vector database according to the natural language command to obtain a sample code snippet;
• obtaining Application Programming Interface (API) structured information corresponding to the sample code snippet from a knowledge graph database;
• generating an initial control code according to the sample code snippet and the API structured information;
• and
• performing a multi-level virtual operation verification on the initial control code in a software motion control system, and generating a target control code according to multi-level verification results confirmed multiple times by the user and the initial control code;
• wherein the software motion control system comprises a simulation motion engine, and the performing the multi-level virtual operation verification on the initial control code in the software motion control system, and generating the target control code according to multi-level verification results confirmed multiple times by the user and the initial control code comprises:
• transmitting the initial control code to the simulation motion engine for device simulation operation to obtain a code execution result, and semantically matching the code execution result with the natural language command to generate a first verification result;
• after the user confirms the first verification result, driving a three-dimensional simulation model through the simulation motion engine to display a device motion process corresponding to the initial control code, and generating a second verification result, the user visually observes whether a device action corresponding to the initial control code in the three-dimensional simulation model meets the control requirements through the second verification result;
• after the user confirms the second verification result, periodically collecting motion process data of the simulation motion engine during operation, and generating a third verification result according to the motion process data, wherein the motion process data comprises position, speed, current feedback and IO status of a control axis;
• and
• after the user confirms the third verification result, using the control code finally confirmed by the user as the target control code;
• wherein the generating the first verification result comprises:
• in response to a semantic matching degree between an operation result and the natural language command is lower than a preset matching threshold, triggering an error correction process;
• querying the knowledge graph database according to operation error information to obtain error API node information, wherein the error API node information comprises API explanation information, sample error code, sample error code meaning and sample error code optimization suggestion;
• generating a first correction control code according to the error API node information and the initial control code;
• and
• re-executing the first correction control code and updating the first verification result;
• wherein the generating the third verification result according to the motion process data comprises:
• dividing the motion process data into multiple verification intervals according to a preset time stage;
• and
• in each verification interval, comparing, by the user, a real-time parameter with an expected value of the corresponding stage to generate the third verification result;
• wherein the software motion control system further comprises a real-time motion engine, and after the performing the multi-level virtual operation verification on the initial control code in the software motion control system, and generating the target control code according to the multi-level verification results confirmed multiple times by the user and the initial control code, the method further comprises:
• in response to user's execution decision, synchronizing runtime environment configuration of the simulation motion engine to the real-time motion engine, wherein after the configuration synchronization, axis numbers of the simulation motion engine and the real-time motion engine correspond one to one, and the simulation motion engine and the real-time motion engine use same motion control function library;
• and
• sending the control code to the real-time motion engine to periodically control an automated device based on the target control code through the real-time motion engine.