# US 2026/0061613 A1 · System and method for training and navigating a robot

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0061613 A1
- Document ID: US20260061613A1
- Status: Published application
- Kind: A1
- Application number: 19/306,641
- Filed: 2025-08-21
- Published: 2026-03-05
- Earliest claimed: 2024-08-30
- Assignees: Accenture Globall Solutions Limited
- Applicants: Accenture Globall Solutions Limited
- Inventors: Ioannis POLYKRETIS; Lavinia Andreea DANIELESCU
- Web page: https://patentgrep.com/patent/US20260061613A1

## CPC

- B25J 9/1666: {Avoiding collision or forbidden zones}
- B25J 9/163: {learning, adaptive, model based, rule based expert control}
- B25J 9/1661: {characterised by task planning, object-oriented languages}
- B25J 9/1664: {characterised by motion, path, trajectory planning}
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})

## Abstract

A system and a method for training and navigating a robot in an unmapped environment is disclosed. The method includes, training a movement model for the robot by recording and analyzing movement data of the robot as the robot moves over a plurality of walks within an environment, wherein the training is based on a mixed exploration strategy that incorporates a novelty-based exploration factor into a random exploration strategy, solving a planning task using the movement model, evaluating the movement model based on a planning error that represents a distance between the goal location and a final position reached by the robot on solving the planning task and navigating an unmapped environment including a source and a destination based on actions output by the trained movement model that successfully solves the planning task during the evaluation.

## Claims

### Claim 1

A robot for navigating in an environment, the robot comprising:
a processor, and
a memory storing instructions, that when executed by the processor cause the processor to perform operations comprising:
training a movement model for the robot by recording and analyzing movement data of the robot as the robot moves over a plurality of walks within an environment, wherein a walk includes a plurality of steps and for each of the walks, the processor:
identifies available directions of movement for the robot from a current location of the robot,
wherein the available directions of movement avoid obstructions to robot movements in the environment;
determines whether to move the robot from the current location in a random direction or a specific direction;
causes a movement of the robot in a random direction from the available directions of movement in response to the determination to move the robot from the current location in the random direction;
calculates the specific direction in response to the determination to move the robot from the current location in the specific direction,
wherein the specific direction is calculated based on prior movements of the robot;
causes a specific movement of the robot in the specific direction in response to the calculation of the specific direction; and
updates the current location to a final location of the robot upon completion of the random movement or the specific movement; and
returns to identifying the available directions until a predetermined criterion is satisfied.

### Claim 2 (depends on 1)

The robot of claim 1, wherein the instructions to determine whether to move the robot from the current location in the random direction or the specific direction further cause the processor to:
determine whether to move the robot from the current location in the random direction or the specific direction based on a number of completed walks,
wherein, as the number of completed walks increases, a probability that the robot implements the random movement from the current location in the random direction increases.

### Claim 3 (depends on 2)

The robot of claim 2, wherein the robot implements the random movement from the current location in the random direction when the number of completed walks exceeds a predetermined threshold.

### Claim 4 (depends on 1)

The robot of claim 1, wherein instructions for calculating the specific directions when executed by the processor, cause the processor to:
select the specific direction that will bring the robot to the final location that is at a maximum distance from up to a predetermined number of most recent prior locations of the robot.

### Claim 5 (depends on 1)

The robot of claim 1, wherein the memory stores instructions that cause the processor to:
receive a planning task that sets a goal location to be reached by the robot;
implement the movement model in solving a planning task; and
calculate a planning error representing a distance between the goal location set in the planning task and a final position of the robot upon solving the planning task.

### Claim 6 (depends on 5)

The robot of claim 5, wherein the memory stores instructions that cause the processor to:
evaluate the movement model for implementation by the robot based on the planning error.

### Claim 7 (depends on 6)

The robot of claim 6, wherein the memory stores instructions that cause the processor to:
navigate an unmapped environment based on actions output by the trained movement model that successfully solves the planning task during the evaluation with the planning error being zero.

### Claim 8 (depends on 7)

The robot of claim 7, wherein the memory stores instructions that cause the processor to:
operate the movement model in one of a training mode and an inferencing mode.

### Claim 9 (depends on 1)

The robot of claim 1, wherein the movement model comprises a single layer artificial neural network (ANN) configured to represent movement states through neural activity and to learn transitions between the states based on weighted connections.

### Claim 10 (depends on 9)

The robot of claim 9, wherein the processor is a neuromorphic processor.

### Claim 11

A processor-executable method for navigation of a robot comprising:
training, by the processor, a movement model for the robot by recording and analyzing movement data of the robot as the robot moves over a plurality of walks within an environment, wherein the training is based on a mixed exploration strategy that incorporates a novelty-based exploration factor into a random exploration strategy;
solving, by the processor, a planning task using the movement model,
wherein the planning task sets a goal location to be reached by the robot using the trained movement model;
evaluating, by the processor, the movement model based on a planning error that represents a distance between the goal location and a final position reached by the robot on solving the planning task; and
navigating, by the processor, an unmapped environment including a source and a destination based on actions output by the trained movement model that successfully solves the planning task during the evaluation.

### Claim 12 (depends on 11)

The processor-executable method of claim 11, wherein training the movement model based on the mixed exploration strategy further comprises:
identifying, by the processor, available directions of movement for the robot from a current location of the robot in the environment,
wherein the available directions avoid obstructions to robot movements; and
determining, by the processor, whether to move the robot from the current location in a random direction or a specific direction from the available directions.

### Claim 13 (depends on 12)

The processor-executable method of claim 12, wherein training the movement model based on the mixed exploration strategy further comprises:
causing, by the processor, a random movement of the robot in the random direction from the available directions of movement in response to the determination to move the robot from the current location in the random direction; and
causing, by the processor, a specific movement of the robot in a specific direction from the available directions of movement in response to the determination to move the robot from the current location in the specific direction.

### Claim 14 (depends on 13)

The processor-executable method of claim 13, wherein causing the specific movement of the robot in the specific direction further comprises:
calculating, by the processor, the specific direction based on the novelty-based exploration factor that configures the specific direction for faster visitation of unseen locations by the robot in the environment.

### Claim 15 (depends on 13)

The processor-executable method of claim 13, wherein training the movement model based on the mixed exploration strategy further comprises:
updating, by the processor, the current location of the robot to a final location of the robot upon completion of the random movement or the specific movement; and
returning, by the processor, to a step of identifying the available directions until a predetermined criterion is satisfied.

### Claim 16 (depends on 15)

The processor-executable method of claim 15, wherein training the movement model based on the mixed exploration strategy further comprises:
decreasing gradually, by the processor, impact of the novelty-based exploration factor as the robot executes the plurality of walks in the environment.

### Claim 17 (depends on 11)

The processor-executable method of claim 11, wherein navigating the unmapped environment further comprises:
selecting, by the processor, a direction that will bring the robot from a current position of the robot closer to a destination in the unmapped environment
wherein the direction is selected from available directions of movement of the robot;
executing, by the processor, a movement by the robot in the selected direction; and
updating, by the processor, the current position of the robot to a new position reached by the robot at an end of the movement in the selected direction.

### Claim 18 (depends on 11)

The processor-executable method of claim 11, wherein selecting the direction further comprises:
estimating, by the processor, probabilities for the available directions of movement for the robot to reach the destination in the unmapped environment;
identifying, by the processor, that one of the available directions associated with a highest probability is blocked; and
selecting, by the processor, a next one of the available directions associated with a penultimate highest probability for navigation of the robot upon determining that the next available direction is not blocked.

### Claim 19

A non-transitory processor-readable storage medium comprising processor-readable instructions that cause a processor to:
train a movement model for a robot by recording and analyzing movement data of the robot as the robot moves over a plurality of walks within an environment, wherein for each of the walks the processor:
identifies available directions of movement for the robot from a current location of the robot,
wherein the available directions avoid obstructions to robot movements in the environment;
determines whether to move the robot from the current location in a random direction or a specific direction;
causes a random movement of the robot in the random direction from the available directions of movement in response to the determination to move the robot from the current location in the random direction;
calculates the specific direction in response to the determination to move the robot from the current location in the specific direction,
wherein the specific direction is obtained based on prior movements of the robot;
causes a specific movement of the robot in the specific direction in response to the calculation of the specific direction; and
updates the current location of the robot to a final location of the robot upon completion of the random movement or the specific movement; and
return to identifying the available directions until a predetermined criterion is satisfied.

### Claim 20 (depends on 19)

The non-transitory processor-readable storage medium of claim 19, wherein the processor is a neuromorphic processor and the movement model includes a single layer artificial neural network (ANN) configured to represent movement states through neural activity and to learn transitions between the states based on weighted connections.
