# US 2023/0068323 A1 · Capabilities for error categorization, reporting and introspection of a technical apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0068323 A1
- Document ID: US20230068323A1
- Status: Published application
- Kind: A1
- Application number: 17/890,875
- Filed: 2022-08-18
- Published: 2023-03-02
- Earliest claimed: 2021-08-31
- Assignees: Magazino GmbH
- Applicants: Magazino GmbH
- Inventors: Guglielmo Gemignani; Markus Grimm; Moritz Tenorth
- Web page: https://patentgrep.com/patent/US20230068323A1

## CPC

- B25J 9/1602: {characterised by the control system, structure, architecture}
- B25J 9/162: {Mobile manipulator, movable base with manipulator arm mounted on it}
- B25J 9/163: {learning, adaptive, model based, rule based expert control}
- B25J 9/1676: {Avoiding collision or forbidden zones}
- G05B 23/0297: {Reconfiguration of monitoring system, e.g. use of virtual sensors; change monitoring method as a response to monitoring results}
- G05B 19/41895: {using automatic guided vehicles [AGV] (control of position or course of AGV's G05D1/00)}
- G05B 2219/50393: Floor conveyor, AGV automatic guided vehicle
- G05B 2223/06: Remote monitoring
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

An apparatus state data structure for controlling a technical apparatus includes at least one capability data field and at least one associated data field. Each capability data field indicates a respective functionality of the technical apparatus. Each associated data field is associated with a respective capability data field. The at least one associated data field includes at least one required component state data field and at least one required diagnostic data field. Each required component state data field indicates a configuration of a respective component required for the functionality of the capability data field associated with the respective required component state data field. Each required diagnostic data field indicates a respective operational state of a component of the technical apparatus required for the functionality of the capability data field associated with the respective required diagnostic data field.

## Claims

### Claim 1

A method of operating a technical apparatus, wherein the method comprises using an apparatus state data structure for controlling the technical apparatus,
wherein the apparatus state data structure comprises at least one capability data field, wherein each capability data field indicates a respective functionality of the technical apparatus,
wherein the apparatus state data structure comprises at least one associated data field, wherein each associated data field is associated with a respective capability data field,
wherein the at least one associated data field comprises at least one required component state data field and at least one required diagnostic data field,
wherein each required component state data field indicates a configuration of a respective component required for the functionality of the capability data field associated with the respective required component state data field, and
wherein each required diagnostic data field indicates a respective operational state of a component of the technical apparatus required for the functionality of the capability data field associated with the respective required diagnostic data field.

### Claim 2 (depends on 1)

The method according to claim 1, wherein each capability data field indicates the respective functionality of the technical apparatus based on each associated data field associated with the respective capability data field.

### Claim 3 (depends on 1)

The method according to claim 1, wherein each capability data field comprises a capability key and a capability value, and
wherein the capability key comprises a unique identifier corresponding to the respective functionality of the technical apparatus and the capability value indicates a status of the functionality.

### Claim 4 (depends on 1)

The method according to claim 1, wherein each required component state data field comprises a component key and a component state value, and
wherein the component key comprises a unique identifier corresponding to the respective component and the component state value indicates the configuration of the component.

### Claim 5 (depends on 1)

The method according to claim 1, wherein each required diagnostic data field comprises a part of an output of a diagnostic routine,
wherein the diagnostic routine is a general system diagnostic routine of the technical apparatus, and
wherein the general system diagnostic routine generates a respective operational state for each component of the technical apparatus.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the at least one associated data field comprises at least one event storage data field, wherein each event storage data field comprises data relating to an event relevant for the respective functionality of the capability data field associated with the respective event storage data field.

### Claim 7 (depends on 6)

The method according to claim 6, wherein the method comprises storing in a database data relating to critical events, and
wherein each event storage data field comprises at least one entry of the database.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the method comprises triggering storage in the database of the data relating to critical events based on an output of at least one sensor of the technical apparatus.

### Claim 9 (depends on 1)

The method according to claim 1, wherein the apparatus state data structure is an apparatus state tree structure,
wherein the apparatus state tree structure comprises a plurality of nodes and a plurality of edges connecting the nodes, and
wherein each capability data field is a capability node, and each associated data field is a capability child node.

### Claim 10 (depends on 1)

The method according to claim 1, wherein the method comprises determining a state of the technical apparatus using the apparatus state data structure and wherein determining a state of the technical apparatus comprises determining for each functionality of the technical apparatus whether it is present or missing.

### Claim 11 (depends on 1)

The method according to claim 1, wherein the method further comprises determining a cause for a missing functionality of the technical apparatus using the apparatus state data structure.

### Claim 12 (depends on 11)

The method according to claim 11, wherein determining a cause for a missing functionality of the technical apparatus using the apparatus state data structure comprises using a reasoning system, and
wherein the reasoning system is configured to determine the cause for the missing functionality based on each data field of the apparatus state data structure.

### Claim 13 (depends on 12)

The method according to claim 12, wherein the reasoning system comprises logical rules configured to determine the cause for the missing functionality, and
wherein the logical rules comprise logical operations on the data fields of the apparatus state data structure.

### Claim 14 (depends on 1)

The method according to claim 1, wherein the method further comprises recovering a missing functionality of the technical apparatus using the apparatus state data structure.

### Claim 15 (depends on 1)

The method according to claim 1, wherein the method further comprises using an executor application, and
wherein the executor application determines the state of the technical apparatus using the apparatus state data structure.

### Claim 16 (depends on 15)

The method according to claim 15, wherein the executor application determines to execute tasks based on the determined state of the technical apparatus.

### Claim 17 (depends on 1)

The method according to claim 1, wherein the technical apparatus is a robot configured to locate, pick up, store and transport items in a warehouse.

### Claim 18 (depends on 1, 17)

The method according to claim 17, wherein the robot comprises a processor and wherein the processor executes the method according to claim 1.

### Claim 19 (depends on 1)

A system comprising:
a technical apparatus, and
a memory device configured to store an apparatus state data structure for controlling the technical apparatus,
wherein the apparatus state data structure comprises at least one capability data field, wherein each capability data field indicates a respective functionality of the technical apparatus,
wherein the apparatus state data structure comprises at least one associated data field, wherein each associated data field is associated with a respective capability data field,
wherein the at least one associated data field comprises at least one required component state data field and at least one required diagnostic data field,
wherein each required component state data field indicates a configuration of a respective component required for the functionality of the capability data field associated with the respective required component state data field,
wherein each required diagnostic data field indicates a respective operational state of a component of the technical apparatus required for the functionality of the capability data field associated with the respective required diagnostic data field, and
wherein the system is configured to carry out the method according to claim 1.

### Claim 20

A computer readable storage medium having stored thereon an apparatus state data structure,
wherein the apparatus state data structure comprises at least one capability data field, wherein each capability data field indicates a respective functionality of a technical apparatus,
wherein the apparatus state data structure comprises at least one associated data field, wherein each associated data field is associated with a respective capability data field,
wherein the at least one associated data field comprises at least one required component state data field and at least one required diagnostic data field,
wherein each required component state data field indicates a configuration of a respective component required for the functionality of the capability data field associated with the respective required component state data field, and
wherein each required diagnostic data field indicates a respective operational state of a component of the technical apparatus required for the functionality of the capability data field associated with the respective required diagnostic data field.
