# US 2024/0406269 A1 · System, method, and storage medium of distributed edge computing for cooperative augmented reality with mobile sensing capability

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0406269 A1
- Document ID: US20240406269A1
- Status: Published application
- Kind: A1
- Application number: 18/806,352
- Filed: 2024-08-15
- Published: 2024-12-05
- Earliest claimed: 2021-12-15
- Assignees: Intelligent Fusion Technology, Inc.
- Applicants: Intelligent Fusion Technology, Inc.
- Inventors: Qi ZHAO; Genshe CHEN; Khanh PHAM; Erik BLASCH
- Web page: https://patentgrep.com/patent/US20240406269A1

## CPC

- G06V 10/809: {of classification results, e.g. where the classifiers operate on the same input data}
- H04L 67/131: Protocols for games, networked simulations or virtual reality
- G06V 10/95: {structured as a network, e.g. client-server architectures}
- G06V 20/20: in augmented reality scenes
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

The present disclosure provides a system of distributed edge computing for cooperative augmented reality with mobile sensing capability. The system includes a plurality of nodes configured to generate a plurality of data streams; and a plurality of distributed edge servers configured to process one or more tasks using the plurality of data streams. An Apache Storm distributed stream processing platform is installed and properly configured on each distributed edge server; the plurality of distributed edge servers includes one or more service modules installed on each distributed edge server and configured to process the one or more tasks; and the plurality of distributed edge servers includes a master distributed edge server and a plurality of slave distributed edge servers; and a scheduler is installed on the master distributed edge server and configured to distribute the one or more tasks to the plurality of distributed edge servers.

## Claims

### Claim 1

A system of distributed edge computing for cooperative augmented reality (AR) with mobile sensing capability, applied to a service-centric distributed resource-aware architecture (SCDRA), comprising:
a plurality of nodes, wherein the plurality of nodes includes a plurality of HoloLens nodes and a plurality of sensor nodes; and the plurality of nodes is configured to generate a plurality of data streams; and
a plurality of distributed edge servers, configured to process one or more tasks using the plurality of data streams transmitted from the plurality of nodes, wherein:
an Apache Storm distributed stream processing platform is installed on each of the plurality of distributed edge servers; and the plurality of nodes and the plurality of distributed edge servers are connected to each other through a wireless network;
the plurality of distributed edge servers includes one or more service modules installed on each distributed edge server and configured to process the one or more tasks; and
the plurality of distributed edge servers includes a master distributed edge server and a plurality of slave distributed edge servers; the master distributed edge server is configured to manage the plurality of slave distributed edge servers; and an Apache Storm scheduler is installed on the master distributed edge server and configured to distribute the one or more tasks to the plurality of distributed edge servers.

### Claim 2 (depends on 1)

The system according to claim 1, wherein:
the one or more tasks include one or more of object detection, cooperative floor plan building, cooperative situational awareness, location tracking, event tagging, target navigation, and model reconstruction.

### Claim 3 (depends on 1)

The system according to claim 1, wherein:
the one or more tasks processed are shared among a plurality of users through the wireless network.

### Claim 4 (depends on 1)

The system according to claim 1, wherein:
the SCDRA includes a physical layer, a management layer, and a service layer.

### Claim 5 (depends on 4)

The system according to claim 4, wherein:
the physical layer includes the plurality of nodes and the plurality of distributed edge servers.

### Claim 6 (depends on 4)

The system according to claim 4, wherein:
the management layer includes a plurality of components including node registry, network management, task schedular, service registry, storage management, and failure handling.

### Claim 7

A method of distributed edge computing for cooperative augmented reality (AR) with mobile sensing capability, applied to a service-centric distributed resource-aware architecture (SCDRA), comprising:
generating a plurality of data streams by a plurality of nodes, wherein the plurality of nodes includes a plurality of HoloLens nodes and a plurality of sensor nodes; and
processing one or more tasks by a plurality of distributed edge servers using the plurality of data streams transmitted from the plurality of nodes, wherein:
an Apache Storm distributed stream processing platform is installed on each of the plurality of distributed edge servers; and the plurality of nodes and the plurality of distributed edge servers are connected to each other through a wireless network;
the plurality of distributed edge servers includes one or more service modules installed on each distributed edge server and configured to process the one or more tasks; and
the plurality of distributed edge servers includes a master distributed edge server and a plurality of slave distributed edge servers; the master distributed edge server is configured to manage the plurality of slave distributed edge servers; and an Apache Storm scheduler is installed on the master distributed edge server and configured to distribute the one or more tasks to the plurality of distributed edge servers.

### Claim 8 (depends on 7)

The method according to claim 7, wherein:
the one or more tasks include one or more of object detection, cooperative floor plan building, cooperative situational awareness, location tracking, event tagging, target navigation, and model reconstruction.

### Claim 9 (depends on 7)

The method according to claim 7, wherein:
the one or more tasks processed are shared among a plurality of users through the wireless network.

### Claim 10 (depends on 7)

The method according to claim 7, wherein:
the SCDRA includes a physical layer, a management layer, and a service layer.

### Claim 11 (depends on 10)

The method according to claim 10, wherein:
the physical layer includes the plurality of nodes and the plurality of distributed edge servers.

### Claim 12 (depends on 10)

The method according to claim 10, wherein:
the management layer includes a plurality of components including node registry, network management, task schedular, service registry, storage management, and failure handling.

### Claim 13

A non-transitory computer-readable storage medium, containing program instructions for, when being executed by a processor, performing a method of distributed edge computing for cooperative augmented reality (AR) with mobile sensing capability, applied to a service-centric distributed resource-aware architecture (SCDRA), the method comprising:
generating a plurality of data streams by a plurality of nodes, wherein the plurality of nodes includes a plurality of HoloLens nodes and a plurality of sensor nodes; and
processing one or more tasks by a plurality of distributed edge servers using the plurality of data streams transmitted from the plurality of nodes, wherein:
an Apache Storm distributed stream processing platform is installed on each of the plurality of distributed edge servers; and the plurality of nodes and the plurality of distributed edge servers are connected to each other through a wireless network;
the plurality of distributed edge servers includes one or more service modules installed on each distributed edge server and configured to process the one or more tasks; and
the plurality of distributed edge servers includes a master distributed edge server and a plurality of slave distributed edge servers; the master distributed edge server is configured to manage the plurality of slave distributed edge servers; and an Apache Storm scheduler is installed on the master distributed edge server and configured to distribute the one or more tasks to the plurality of distributed edge servers.

### Claim 14 (depends on 13)

The storage medium according to claim 13, wherein:
the one or more tasks include one or more of object detection, cooperative floor plan building, cooperative situational awareness, location tracking, event tagging, target navigation, and model reconstruction.

### Claim 15 (depends on 13)

The storage medium according to claim 13, wherein:
the one or more tasks processed are shared among a plurality of users through the wireless network.

### Claim 16 (depends on 13)

The storage medium according to claim 13, wherein:
the SCDRA includes a physical layer, a management layer, and a service layer.

### Claim 17 (depends on 16)

The storage medium according to claim 16, wherein:
the physical layer includes the plurality of nodes and the plurality of distributed edge servers.

### Claim 18 (depends on 16)

The storage medium according to claim 16, wherein:
the management layer includes a plurality of components including node registry, network management, task schedular, service registry, storage management, and failure handling.
