# US 2026/0065196 A1 · Systems and Methods for Augmented Reality Guided Labor Services

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065196 A1
- Document ID: US20260065196A1
- Status: Published application
- Kind: A1
- Application number: 19/319,521
- Filed: 2025-09-04
- Published: 2026-03-05
- Earliest claimed: 2024-09-04
- Assignees: California Institute of Technology
- Applicants: California Institute of Technology
- Inventors: Julian M. Humml; Morteza Gharib
- Web page: https://patentgrep.com/patent/US20260065196A1

## CPC

- G06Q 10/06316: {Sequencing of tasks or work}
- G06Q 10/063114: {Status monitoring or status determination for a person or group}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

One embodiment includes an augmented reality (AR) guided labor services system. The system includes a processor, a network interface configured to communicate with augmented reality headsets and mobile devices, and a memory storing instructions that, when executed by the processor, cause the system to receive a labor task request from a user, provide a matching worker to the user, generate task guidance based on the task request, monitor worker progress based on the generated guidance, validate task completion, and update a task library based on worker performance.

## Claims

### Claim 1

An augmented reality (AR) guided labor services system comprising:
a processor;
a network interface configured to communicate with augmented reality headsets and mobile devices; and
a memory storing instructions that, when executed by the processor, cause the system to:
receive a labor task request from a user;
provide a matching worker to the user;
generate task guidance based on the task request;
monitor worker progress based on the generated guidance;
validate task completion; and
update a task library based on worker performance.

### Claim 2 (depends on 1)

The AR guided labor services system of claim 1, wherein the instructions further cause the system to receive content related to a task from multiple sources including recordings of experts, descriptions from manuals, and instructional videos.

### Claim 3 (depends on 2)

The AR guided labor services system of claim 2, wherein the instructions further cause the system to segment the task into subtasks by analyzing the received content to identify discrete operational phases, tool transitions, and material handling procedures.

### Claim 4 (depends on 3)

The AR guided labor services system of claim 3, wherein the instructions further cause the system to convert the segmented subtasks into an encoded representation comprising nodes representing individual procedural states and edges representing allowed transitions between different phases of task execution.

### Claim 5 (depends on 4)

The AR guided labor services system of claim 4, wherein the instructions further cause the system to add the encoded representation of the task to the task library alongside metadata including task categories, complexity ratings, required tools and materials, and estimated completion times.

### Claim 6 (depends on 1)

The AR guided labor services system of claim 1, wherein the instructions further cause the system to retrieve an encoded representation from the task library based on the labor task request.

### Claim 7 (depends on 6)

The AR guided labor services system of claim 6, wherein the instructions further cause the system to assess a current state against the encoded representation by utilizing vision language models that analyze real-time sensor data streams from augmented reality headsets.

### Claim 8 (depends on 7)

The AR guided labor services system of claim 7, wherein the instructions further cause the system to generate the task guidance by creating visual overlays, audio prompts, and textual instructions that provide workers with specific guidance for completing current procedural steps.

### Claim 9 (depends on 1)

The AR guided labor services system of claim 1, wherein the task guidance is displayed through an augmented reality graphical user interface comprising multiple types of visual overlays including arrows, outlines, and ghosted overlays that highlight tool positions and material placements.

### Claim 10 (depends on 1)

The AR guided labor services system of claim 1, wherein monitoring worker progress comprises utilizing a vision language model to compare observed environmental conditions with stored procedural expectations and detect deviations from prescribed task sequences.

### Claim 11

A method for performing augmented reality (AR) guided labor services, comprising:
receiving a labor task request from a user;
providing a matching worker to the user;
generating task guidance based on the task request;
monitoring worker progress based on the generated guidance;
validating task completion; and
updating a task library based on worker performance.

### Claim 12 (depends on 11)

The method of claim 11, further comprising receiving content related to a task from multiple sources including recordings of experts, descriptions from manuals, and instructional videos.

### Claim 13 (depends on 12)

The method of claim 12, further comprising segmenting the task into subtasks by analyzing the received content to identify discrete operational phases, tool transitions, and material handling procedures.

### Claim 14 (depends on 13)

The method of claim 13, further comprising converting the segmented subtasks into an encoded representation comprising nodes representing individual procedural states and edges representing allowed transitions between different phases of task execution.

### Claim 15 (depends on 14)

The method of claim 14, further comprising adding the encoded representation of the task to the task library alongside metadata including task categories, complexity ratings, required tools and materials, and estimated completion times.

### Claim 16 (depends on 11)

The method of claim 11, further comprising retrieving an encoded representation from the task library based on the labor task request.

### Claim 17 (depends on 16)

The method of claim 16, further comprising assessing a current state against the encoded representation by utilizing vision language models that analyze real-time sensor data streams from augmented reality headsets.

### Claim 18 (depends on 17)

The method of claim 17, wherein generating the task guidance comprises creating visual overlays, audio prompts, and textual instructions that provide workers with specific guidance for completing current procedural steps.

### Claim 19 (depends on 11)

The method of claim 11, wherein the task guidance is displayed through an augmented reality graphical user interface comprising multiple types of visual overlays including arrows, outlines, and ghosted overlays that highlight tool positions and material placements.

### Claim 20 (depends on 11)

The method of claim 11, wherein monitoring worker progress comprises utilizing a vision language model to compare observed environmental conditions with stored procedural expectations and detect deviations from prescribed task sequences.
