# US 2025/0083309 A1 · Geometric policy fabrics for accelerated learning in robotics systems, platforms, and applications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0083309 A1
- Document ID: US20250083309A1
- Status: Published application
- Kind: A1
- Application number: 18/646,312
- Filed: 2024-04-25
- Published: 2025-03-13
- Earliest claimed: 2023-09-08
- Assignees: NVIDIA Corporation
- Applicants: NVIDIA Corporation
- Inventors: Nathan Donald RATLIFF; Karl VAN WYK; Ankur HANDA; Viktor MAKOVIICHUK; Yijie GUO; Jie XU; Tyler LUM; Balakumar SUNDARALINGAM; Jingzhou LIU
- Web page: https://patentgrep.com/patent/US20250083309A1

## CPC

- B25J 9/163: {learning, adaptive, model based, rule based expert control}
- B25J 9/161: {Hardware, e.g. neural networks, fuzzy logic, interfaces, processor}
- B25J 9/1664: {characterised by motion, path, trajectory planning}
- B25J 9/1671: {characterised by simulation, either to verify existing program or to create and verify new program, CAD/CAM oriented, graphic oriented programming systems}
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})

## Abstract

In various examples, systems and methods are disclosed relating to geometric fabrics for accelerated policy learning and sim-to-real transfer in robotics systems, platforms, and/or applications. For example, a system can provide an input indicative of a goal pose for a robot to a model to cause the model to generate an output, the output representing a plurality of points along a path for movement of the robot to the goal pose; and generate one or more control signals for operation of the robot based at least on the plurality of points along the path and a policy corresponding to one or more criteria for the operation of the robot. In examples, the system can provide the one or more control signals to the robot to cause the robot to move toward the goal pose.

## Claims

### Claim 1

One or more processors comprising:
one or more circuits to:
provide an input indicative of a goal pose for a robot to a model to cause the model to generate an output, the output representing a plurality of points along a path for movement of the robot to the goal pose;
generate one or more control signals for operation of the robot based at least on the plurality of points along the path and a policy corresponding to one or more criteria for the operation of the robot; and
provide the one or more control signals to the robot to cause the robot to move toward the goal pose.

### Claim 2 (depends on 1)

The one or more processors of claim 1, wherein the model is a reinforcement learning-based model, and
wherein the reinforcement learning-based model is updated to generate the output based at least on the policy.

### Claim 3 (depends on 1)

The one or more processors of claim 1, wherein, when providing the input indicative of the goal pose for the robot to the model, the one or more circuits are to:
provide an initial pose of the robot relative to an environment, the goal pose for the robot relative to the environment, and a pose of one or more objects relative to the environment in which the robot is operating to the model to cause the model to generate the output.

### Claim 4 (depends on 3)

The one or more processors of claim 3, wherein, when generating the one or more control signals for operation of the robot, the one or more circuits are to:
determine a set of control signals to move the robot between a first pose and at least one intermediate pose along the path based at least on the output of the model, and
provide the set of control signals to cause a second output to be generated based at least on the policy, the second output comprising an updated set of control signals representing an updated path that is compliant with a geometric fabric.

### Claim 5 (depends on 4)

The one or more processors of claim 4, wherein each control signal of the set of control signals is configured to cause at least one actuator associated with a corresponding joint of the robot to move at least a portion of the robot from the first pose to a second pose of the at least one intermediate pose.

### Claim 6 (depends on 1)

The one or more processors of claim 1, wherein the one or more circuits are to:
determine a type of maneuver associated with the input to the model,
wherein, when providing the input to the model, the one or more circuits are to:
provide the input to the model based at least on the type of maneuver associated with the path.

### Claim 7 (depends on 1)

The one or more processors of claim 1, wherein, when providing the input to the model, the one or more circuits are to:
determine the model from among a plurality of models, the model associated with the robot; and
provide the input to the model based at least on determining the model.

### Claim 8 (depends on 1)

The one or more processors of claim 1, wherein the one or more criteria represented by the policy comprises at least one criteria based at least on a second-order differential equation.

### Claim 9 (depends on 1)

The one or more processors of claim 1, wherein the one or more circuits are to:
simulate operation of the robot in a simulated environment, and
wherein the one or more circuits that provide the one or more control signals to the robot to cause the robot to move toward the goal pose are to:
provide the one or more control signals to the robot while operating in the simulated environment to cause the robot to move in the simulated environment.

### Claim 10 (depends on 1)

The one or more processors of claim 1, wherein the one or more processors are comprised in at least one of:
a control system for an autonomous or semi-autonomous machine;
a perception system for an autonomous or semi-autonomous machine;
a system for performing simulation operations;
a system for performing digital twin operations;
a system for performing light transport simulation;
a system for performing collaborative content creation for 3D assets;
a system for performing deep learning operations;
a system for generating or presenting at least one of augmented reality content, virtual reality content, or mixed reality content;
a system for hosting one or more real-time streaming applications;
a system for implementing large language models (LLMs);
a system for implementing vision language models (VLMs);
a system implemented using an edge device;
a system implemented using a robot;
a system for performing conversational AI operations;
a system for performing generative AI operations;
a system for generating synthetic data;
a system incorporating one or more virtual machines (VMs);
a system implemented at least partially in a data center; or
a system implemented at least partially using cloud computing resources.

### Claim 11

A system comprising:
one or more processors to perform operations comprising:
providing an input indicative of a goal pose for a robot to a model;
generating an output using the model, the output representing a plurality of points along a path for movement of the robot to the goal pose;
generating one or more control signals for operation of the robot based at least on the plurality of points along the path and a policy corresponding to one or more criteria for the operation of the robot; and
providing the one or more control signals to the robot to cause the robot to move toward the goal pose.

### Claim 12 (depends on 11)

The system of claim 11, wherein the model is a reinforcement learning-based model, and
wherein the reinforcement learning-based model is updated to generate the output based at least on the policy.

### Claim 13 (depends on 11)

The system of claim 11, wherein, when providing the input indicative of the goal pose for the robot to the model, the one or more processors perform the operations of:
providing an initial pose of the robot relative to an environment, the goal pose for the robot relative to the environment, and a pose of one or more objects relative to the environment in which the robot is operating to the model to cause the model to generate the output.

### Claim 14 (depends on 13)

The system of claim 13, wherein, when generating the one or more control signals for operation of the robot, the one or more processors perform the operations of:
determining a set of control signals to move the robot between a first pose and at least one intermediate pose along the path based at least on the output of the model, and
providing the set of control signals to cause a second output to be generated based at least on the policy, the second output comprising an updated set of control signals representing an updated path that is compliant with a geometric fabric.

### Claim 15 (depends on 14)

The system of claim 14, wherein each control signal of the set of control signals is configured to cause at least one actuator associated with a corresponding joint of the robot to move at least a portion of the robot from the first pose to a second pose of the at least one intermediate pose.

### Claim 16 (depends on 11)

The system of claim 11, wherein the one or more processors perform the operations of:
determining a type of maneuver associated with the input to the model,
wherein, when providing the input to the model, the one or more processors perform the operations of:
providing the input to the model based at least on the type of maneuver associated with the path.

### Claim 17 (depends on 11)

The system of claim 11, wherein, when providing the input to the model, the one or more processors perform the operations of:
determining the model from among a plurality of models, the model associated with the robot; and
providing the input to the model based at least on determining the model.

### Claim 18 (depends on 11)

The system of claim 11, wherein the one or more criteria represented by the policy comprises at least one criteria based at least on a second-order differential equation.

### Claim 19 (depends on 11)

The system of claim 11, wherein the one or more processors are comprised in at least one of:
a control system for an autonomous or semi-autonomous machine;
a perception system for an autonomous or semi-autonomous machine;
a system for performing simulation operations;
a system for performing digital twin operations;
a system for performing light transport simulation;
a system for performing collaborative content creation for 3D assets;
a system for performing deep learning operations;
a system for generating or presenting at least one of augmented reality content, virtual reality content, or mixed reality content;
a system for hosting one or more real-time streaming applications;
a system for performing generative AI operations;
a system for implementing large language models (LLMs);
a system for implementing vision language models (VLMs);
a system implemented using an edge device;
a system implemented using a robot;
a system for performing conversational AI operations;
a system for generating synthetic data;
a system incorporating one or more virtual machines (VMs);
a system implemented at least partially in a data center; or
a system implemented at least partially using cloud computing resources.

### Claim 20

A method comprising:
providing an input indicative of a goal pose for a robot to a model to cause the model to generate an output representing a plurality of points along a path for movement of the robot to the goal pose;
generating one or more control signals for operation of the robot using the plurality of points along the path and based at least on a policy corresponding to one or more criteria for the operation of the robot; and
providing the one or more control signals to the robot to cause the robot to move toward the goal pose.
