# US 2023/0055641 A1 · Real-time generation of digital twins based on input data captured by user device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0055641 A1
- Document ID: US20230055641A1
- Status: Published application
- Kind: A1
- Application number: 17/887,240
- Filed: 2022-08-12
- Published: 2023-02-23
- Earliest claimed: 2021-08-17
- Assignees: Honeywell International Inc.
- Applicants: Honeywell International Inc.
- Inventors: Arun Srinivasan PRASATH
- Web page: https://patentgrep.com/patent/US20230055641A1

## CPC

- G06Q 10/067: Enterprise or organisation modelling
- G06F 9/451: Execution arrangements for user interfaces
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Various embodiments described herein relate to real-time generation of digital twins using asset data captured from a user device. In this regard, input data is received and one or more attributes of an asset are determined based on the input data. In accordance with determining whether the one or more attributes satisfy a predefined threshold, a digital twin or suggested digital twin is generated. Data associated with the digital twin or suggested digital twin is presented at a user interface of the user device enabling a user to extend or modify the data.

## Claims

### Claim 1

A method comprising:
receiving input data associated with an asset;
determining one or more attributes of the asset based at least on the input data;
determining whether the one or more attributes satisfy a predefined threshold associated with a stored asset data unit based at least on querying an asset database;
in accordance with a determination that the one or more attributes do not satisfy the predefined threshold:
accessing sensor data associated with the asset;
based at least on the sensor data and the one or more attributes, generating a suggested digital twin of the asset; and
causing presentation, via a user interface, of data associated with the suggested digital twin of the asset at a user device.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
in accordance with a determination that the one or more attributes satisfy the predefined threshold:
generating a digital twin of the asset based at least on the stored asset data unit; and
storing the digital twin of the asset in association with at least one additional digital twin of a shared asset site.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
causing presentation, via the user interface, of data associated with the digital twin of the asset.

### Claim 4 (depends on 1)

The method of claim 1, the generating of the suggested digital twin comprising applying the sensor data and the one or more attributes to a contextual discovery model to determine one or more suggested digital twins of the asset.

### Claim 5 (depends on 4)

The method of claim 4, the method further comprising:
providing training data associated with a determination that the one or more attributes satisfy the predefined threshold to the contextual discovery model.

### Claim 6 (depends on 1)

The method of claim 1, the method further comprising:
receiving, via input to the user interface, an extension of the suggested digital twin;
modifying the suggested digital twin based on the extension.

### Claim 7 (depends on 1)

The method of claim 1, the input data being received from the user device.

### Claim 8 (depends on 7)

The method of claim 7, the input data comprising image data captured by the user device.

### Claim 9 (depends on 8)

The method of claim 8, the image data comprising an image of indicia associated with the asset.

### Claim 10 (depends on 7)

The method of claim 7, the input data comprising sound data captured by the user device.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
determining a location of the asset based at least on location data associated with the user device.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
generating a geospatial plan of an asset site associated with the asset, the geospatial plan comprising location data of a plurality of assets within the asset site.

### Claim 13

A system, comprising:
a processor; and
a memory that stores executable instructions that, when executed by the processor, cause the processor to:
receive input data associated with an asset;
determine one or more attributes of the asset based at least on the input data;
determine whether the one or more attributes satisfy a predefined threshold associated with a stored asset data unit based at least on querying an asset database;
in accordance with a determination that the one or more attributes do not satisfy the predefined threshold:
access sensor data associated with the asset;
based at least on the sensor data and the one or more attributes, generate a suggested digital twin of the asset; and
cause presentation, via a user interface, of data associated with the suggested digital twin of the asset at a user device.

### Claim 14 (depends on 13)

The system of claim 13, the executable instructions being further configured to, when executed by the processor, cause the processor to:
in accordance with a determination that the one or more attributes satisfy the predefined threshold:
generate a digital twin of the asset based at least on the stored asset data unit; and
store the digital twin of the asset in association with at least one additional digital twin of a shared asset site.

### Claim 15 (depends on 14)

The system of claim 14, the executable instructions being further configured to, when executed by the processor, cause the processor to:
cause presentation, via the user interface, of data associated with the digital twin of the asset.

### Claim 16 (depends on 13)

The system of claim 13, the executable instructions configured to generate the suggested digital twin being further configured to, when executed by the processor, cause the processor to apply the sensor data and the one or more attributes to a contextual discovery model to determine one or more suggested digital twins of the asset.

### Claim 17 (depends on 16)

The system of claims 16, the executable instructions being further configured to, when executed by the processor, cause the processor to:
provide training data associated with a determination that the one or more attributes satisfy the predefined threshold to the contextual discovery model.

### Claim 18 (depends on 13)

The system of claim 13, the executable instructions being further configured to, when executed by the processor, cause the processor to:
receive, via input to the user interface, an extension of the suggested digital twin;
modify the suggested digital twin based on the extension.

### Claim 19 (depends on 13)

The system of claim 13, the executable instructions being further configured to, when executed by the processor, cause the processor to:
determine a location of the asset based at least on location data associated with the user device.

### Claim 20

A non-transitory computer-readable storage medium comprising one or more programs for execution by one or more processors of a device, the one or more programs including instructions which, when executed by the one or more processors, cause the device to:
receive input data associated with an asset;
determine one or more attributes of the asset based at least on the input data;
determine whether the one or more attributes satisfy a predefined threshold associated with a stored asset data unit based at least on querying an asset database;
in accordance with a determination that the one or more attributes do not satisfy the predefined threshold:
access sensor data associated with the asset;
based at least on the sensor data and the one or more attributes, generate a suggested digital twin of the asset; and
cause presentation, via a user interface, of data associated with the suggested digital twin of the asset at a user device.
