# US 2023/0273598 A1 · Sharing world model objects between multiple autonomous systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0273598 A1
- Document ID: US20230273598A1
- Status: Published application
- Kind: A1
- Application number: 18/004,225
- Filed: 2020-07-31
- Published: 2023-08-31
- Earliest claimed: 2020-07-31
- Assignees: Siemens Aktiengesellschaft
- Applicants: Siemens Aktiengesellschaft
- Inventors: Richard Gary McDaniel; Beat Laemmle
- Web page: https://patentgrep.com/patent/US20230273598A1

## CPC

- G05B 19/418: Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
- G06F 9/54: Interprogram communication
- G06F 9/52: Program synchronisation; Mutual exclusion, e.g. by means of semaphores
- G05B 2219/31264: Control, autonomous self learn knowledge, rearrange task, reallocate resources
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A computer-implemented method includes operating a first autonomous system to perform a task based on executable code derived from objects in a world model of the first autonomous system. The world model objects of the first autonomous system represent an operating environment of the first autonomous system. The method includes determining an initiation trigger when the first autonomous system is to begin interaction with a second autonomous system. The second autonomous system is operated based on executable code derived from a world model that includes world model objects representing an operating environment of the second autonomous system. After the initiation trigger, the method includes sharing of the world model objects between the first and second autonomous systems. Subsequently, the method includes continuing operating the first autonomous system based on an extended world model of the first autonomous system that includes the shared world model objects of the second autonomous system.

## Claims

### Claim 1

A computer-implemented method comprising:
operating a first autonomous system to perform a task based on executable code derived from objects in a world model of the first autonomous system, wherein the world model of the first autonomous system comprises a plurality of world model objects that represent a state of an operating environment of the first autonomous system,
determining an initiation trigger when the first autonomous system is to begin interaction with a second autonomous system, the second autonomous system being operated based on executable code derived from objects in a world model of the second autonomous system, which comprises a plurality of world model objects that represent a state of an operating environment of the second autonomous system,
responsive to the initiation trigger, initiating data communication between the first autonomous system and the second autonomous system, wherein the data communication comprises sharing of the world model objects between the first autonomous system and the second autonomous system, and
continuing operating the first autonomous system based on an extended world model of the first autonomous system that includes the shared world model objects of the second autonomous system.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the shared world model objects of the first autonomous system and the second autonomous system comprise, in each case, one or more world model objects that correspond to one or more physical objects in the operating environment of the respective autonomous system.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the shared world model objects of the first autonomous system and the second autonomous system further comprise, in each case, one or more world model objects that correspond to one or more markers on simulated objects in the operating environment of the respective autonomous system.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the initiation trigger is determined when a physical range associated with the first autonomous system overlaps with a physical range associated with the second autonomous system.

### Claim 5 (depends on 1)

The method according to claim 1, further comprising terminating the sharing of world model objects between the first autonomous system and the second autonomous system responsive to a determination of a termination trigger.

### Claim 6 (depends on 5)

The method according to claim 5, wherein the termination trigger is determined when a physical range associated with the first autonomous system no longer overlaps with a physical range associated with the second autonomous system.

### Claim 7 (depends on 5)

The method according to claim 5, further comprising transferring one or more world model objects between the first autonomous system and second autonomous system at termination of the sharing of world model objects.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the transfer of the one or more world model objects is determined if, at the termination of the sharing of world model objects, said one or more world model objects are topologically connected to a different autonomous system than the autonomous system that said one or more world model objects were originally associated with.

### Claim 9 (depends on 7)

The method according to claim 7, wherein the transfer of the one or more world model objects is determined if, at the termination of the sharing of world model objects, said one or more world model objects are contained in a defined volume associated with a different autonomous system than the autonomous system that said one or more world model objects were originally associated with.

### Claim 10 (depends on 1)

The method according to claim 1, wherein subsequent to the sharing of the world model objects, the second autonomous system is operated based on an extended world model of the second autonomous system that includes the shared world model objects of the first autonomous system.

### Claim 11 (depends on 1)

The method according to claim 1, wherein the sharing of the world model objects between the first autonomous system and the second autonomous system is implemented via a middleware layer.

### Claim 12 (depends on 11)

The method according to claim 11, comprising:
each of the autonomous systems publishing updated data in connection with the world model objects of that autonomous system via the middleware layer at discrete time steps, and
subsequent to the initiation trigger, each of the autonomous systems polling the other autonomous system via the middleware layer to discover published world model objects of the other autonomous system.

### Claim 13 (depends on 11)

The method according to claim 11, comprising locally caching, by each of the autonomous systems, synchronized copies of the shared world model objects of the other autonomous system at discrete time steps.

### Claim 14 (depends on 11)

The method according to claim 11, wherein the shared world model objects of the first autonomous system and the second autonomous system are collected in a common database accessible to each of the first and second autonomous systems.

### Claim 15 (depends on 1)

The method according to claim 1, the shared world model objects comprise static data that is class-dependent and data that is subject to change at runtime.

### Claim 16 (depends on 1)

The method according to claim 1, wherein the sharing of the world model objects comprises data transfer implemented in multiple stages, comprising:
a first stage involving a one-time transfer of all static data in connection with the shared world model objects,
a second stage involving one or more synchronizing steps that includes transfer of all data in connection with the shared world model objects that are subject to change at runtime of the respective autonomous system,
a third stage involving one or more synchronicity maintenance steps that include only transfer of data related to device control,
a fourth stage involving one or more error correction steps that include transfer of data to correct errors arising due to a difference in simulation output between the first and second autonomous systems.

### Claim 17

A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer of an autonomous system, cause the computer to:
operate a controllable physical device of the autonomous system to perform a task based on executable code derived from objects in a world model of the autonomous system, wherein the world model of the autonomous system comprises a plurality of world model objects that represent a state of an operating environment of the autonomous system,
determine an initiation trigger when the autonomous system is to begin interaction with a peer autonomous system, the peer autonomous system being operated based on executable code derived from objects in a world model of the peer autonomous system, which comprises a plurality of world model objects that represent a state of an operating environment of the peer autonomous system,
responsive to the initiation trigger, initiate data communication between the autonomous system and the peer autonomous system, wherein the data communication comprises sharing of the world model objects between the autonomous system and the peer autonomous system, and
continue operating controllable physical device based on an extended world model of the autonomous system that includes the shared world model objects of the peer autonomous system.

### Claim 18

An autonomous system comprising:
a controllable physical device; and
a computer comprising a processor and a memory storing instructions that, when executed by the processor, configure the computer to:
operate the controllable physical device to perform a task based on executable code derived from objects in a world model of the autonomous system, wherein the world model of the autonomous system comprises a plurality of world model objects that represent a state of an operating environment of the autonomous system,
determine an initiation trigger when the autonomous system is to begin interaction with a peer autonomous system, the peer autonomous system being operated based on executable code derived from objects in a world model of the peer autonomous system, which comprises a plurality of world model objects that represent a state of an operating environment of the peer autonomous system,
responsive to the initiation trigger, initiate data communication between the autonomous system and the peer autonomous system, wherein the data communication comprises sharing of the world model objects between the autonomous system and the peer autonomous system, and
continue operating the controllable physical device based on an extended world model of the autonomous system that includes the shared world model objects of the peer autonomous system.
