# US 2025/0165057 A1 · Methods and Apparatuses for Providing Procedure Guidance

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0165057 A1
- Document ID: US20250165057A1
- Status: Published application
- Kind: A1
- Application number: 18/748,485
- Filed: 2024-06-20
- Published: 2025-05-22
- Earliest claimed: 2017-01-13
- Assignees: West Texas Technology Partners, LLC
- Applicants: West Texas Technology Partners, LLC
- Inventors: Mohamed Nabil Hajj Chehade; Chieh Wang; Mohamed Fayez Taha; Karim Fikani; Paul Neil Iglesias Paulino
- Web page: https://patentgrep.com/patent/US20250165057A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G02B 27/017: {Head mounted}
- G05B 19/41865: {characterised by job scheduling, process planning, material flow}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 16/00: Information retrieval; Database structures therefor; File system structures therefor
- G06Q 10/06313: {Resource planning in a project environment}
- G06Q 10/109: Time management, e.g. calendars, reminders, meetings or time accounting
- H04L 67/60: Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources (admission control or resource allocation H04L47/70)
- H04L 67/75: Indicating network or usage conditions on the user display
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0141: {characterised by the informative content of the display}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Apparatuses and methods of operating the same are described. An apparatus including a display, an input device, and a processing device coupled to the display and the input device. The processing device may send an output to the display. The output may include a graphical object associated with a first step of a user-implemented procedure. The processing device may receive an input from the input device. The input may indicate a progress on an execution of the first step by an operator. The processing device may determine whether the input indicates that the operator has completed the first step. The processing device may determine whether the first step is a final step in the user-implemented procedure. The processing device may identify a second step in the user-implemented procedure when the input indicates that the operator has completed the first step and the first step is not a final step.

## Claims

### Claim 1

An apparatus, comprising:
a housing adapted to be worn on a head of an operator;
an environmental sensor configured to measure an environmental condition in an area approximate the housing to obtain an environmental measurement;
a processing device coupled to the housing and the environmental sensor;
a stereographical display in communication with the processing device and attached to the housing such that when the housing is worn by the operator the stereographical display is facing and proximate eyes of the operator; and
an input device in communication with the processing device and disposed on the housing, wherein the processing device is to:
determine whether the environmental condition is present in the area approximate the housing based on the environmental measurement;
in response to the environmental condition being present in the area approximate the housing:
send a first output to the stereographical display, the first output comprising a first graphical object associated with a first step of a first branch of a user-implemented procedure;
receive a first input from the input device, the first input representative of feedback from the operator performing the user-implemented procedure, wherein the first input indicates a progress on an execution of the first step of the first branch by the operator;
determine whether the first input indicates that the operator has completed the first step of the first branch;
determine whether the first step of the first branch is a final step in the first branch of the user-implemented procedure; and
identify a link to a subsequent step of the first branch in the user-implemented procedure when the first input indicates that the operator has completed the first step of the first branch and the first step is not the final step in the first branch; and
in response to the environmental condition not being present in the area approximate the housing:
send a second output to the stereographical display, the second output comprising a second graphical object associated with a first step of a second branch of the user-implemented procedure;
receive a second input from the input device, the second input representative of feedback from the operator performing the user-implemented procedure, wherein the second input indicates a progress on an execution of the first step of the second branch by the operator;
determine whether the second input indicates that the operator has completed the first step of the second branch;
determine whether the first step of the second branch is a final step in the second branch of the user-implemented procedure; and
identify a link to a subsequent step in the user-implemented procedure when the second input indicates that the operator has completed the first step of the second branch and the first step is not the final step of the second branch.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the input device is attached to the housing such that when the housing is worn by the operator, the input device faces substantially away from the head of the operator.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the input device is attached to the housing such that when the housing is worn by the operator, the input device faces substantially toward the head of the operator.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the input device is a color camera or a depth camera.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein:
the first graphical object is to provide guidance to the operator for executing the first step of the first branch of the user-implemented procedure; and
the second graphical object is to provide guidance to the operator for executing the first step of the second branch of the user-implemented procedure.

### Claim 6

An apparatus, comprising:
a display;
an environmental sensor configured to measure an environmental condition in an area approximate the apparatus to obtain an environmental measurement;
an input device; and
a processing device coupled to the display, the environmental sensor, and the input device, wherein the processing device is to:
determine whether an environmental condition is present in the area approximate the apparatus based on the environmental measurement;
in response to the environmental condition being present in the area approximate the housing:
send an first output to the display, the first output comprising a first graphical object associated with a first step of a first branch of a user-implemented procedure;
receive first input from the input device, the first input indicating a progress on an execution of the first step of the first branch by an operator;
determine whether the first input indicates that the operator has completed the first step of the first branch;
determine whether the first step of the first branch is a final step in the first branch of the user-implemented procedure; and
identify a second step of the first branch in the user-implemented procedure when the first input indicates that the operator has completed the first step of the first branch and the first step is not a final step in the first branch; and
in response to the environmental condition not being present in the area approximate the apparatus:
send a second output to the display, the second output comprising a second graphical object associated with a first step of a second branch of the user-implemented procedure;
receive a second input from the input device, the second input representative of feedback from the operator performing the user-implemented procedure, wherein the second input indicates a progress on an execution of the first step of the second branch by the operator;
determine whether the second input indicates that the operator has completed the first step of the second branch;
determine whether the first step of the second branch is a final step in the second branch of the user-implemented procedure; and
identify a link to a second step in the user-implemented procedure when the second input indicates that the operator has completed the first step of the second branch and the first step is not the final step of the second branch.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the display is attached to a housing such that when the housing is worn by the operator the display is facing and proximate eyes of the operator.

### Claim 8 (depends on 6)

The apparatus of claim 6, wherein completing the first step of the first branch comprises at least one of receiving the first input, confirming a presence of content in the first input, confirming a type of the content in the first input, confirming a format of the content in the first input, confirming the content in the first input satisfies an input standard, or confirming a presence of a feature in the content in the first input.

### Claim 9 (depends on 6)

The apparatus of claim 6, further comprising identifying, by the processing device, an identity of at least one of the operator, the processing device, or the first input.

### Claim 10 (depends on 6)

The apparatus of claim 6, further comprising establishing, by the processing device, a communication channel between a device associated with the operator and the processing device.

### Claim 11 (depends on 6)

The apparatus of claim 6, further comprising establishing, by the processing device, a communication channel between the processing device and another device associated with an individual that is not the operator.

### Claim 12 (depends on 6)

The apparatus of claim 6, wherein:
the second step of the first branch is non-linear to the first step of the first branch; and
the second step of the second branch is non-linear to the first step of the second branch.

### Claim 13 (depends on 6)

The apparatus of claim 6, wherein:
the first step of the first branch comprises a first set of sub-steps; and
the first step of the second branch comprises a second set of sub-steps.

### Claim 14

A method, comprising:
sensing, by an environmental sensor, an environmental condition in an area approximate a housing to obtain an environmental measurement;
determining, by a processing device, whether an environmental condition is present in the area approximate the housing based on the environmental measurement;
in response to the environmental condition being present in the area approximate the housing:
sending, by the processing device, a first output to display on a display device, the first output comprising a first graphical object associated with a first step of a first branch of a user-implemented procedure, wherein the display device is to display the first graphical object to provide guidance to an operator for executing the first step of the first branch of the user-implemented procedure;
receiving, by the processing device, a first input from an input device, the first input representative of feedback from the operator indicating a progress on an execution of the first step of the first branch;
analyzing the first input of the first branch to determine whether the first input indicates that the operator has completed the first step of the first branch;
determining whether the first step of the first branch is a final step of the first branch in the user-implemented procedure; and
identifying a link to a subsequent step of the first branch in the user-implemented procedure when the first input indicates that the operator has completed the first step of the first branch and the first step is not the final step of the first branch; and
in response to the environmental condition not being present in the area approximate the housing:
sending a second output to the display, the second output comprising a second graphical object associated with a first step of a second branch of the user-implemented procedure;
receiving, by the processing device, a second input from the input device, the second input representative of feedback from the operator performing the user-implemented procedure, wherein the second input indicates a progress on an execution of the first step of the second branch by the operator;
determining, by the processing device, whether the second input indicates that the operator has completed the first step of the second branch;
determining, by the processing device, whether the first step of the second branch is a final step in the second branch of the user-implemented procedure; and
identifying, by the processing device, a link to a subsequent step in the user-implemented procedure when the second input indicates that the operator has completed the first step of the second branch and the first step is not the final step of the second branch.

### Claim 15 (depends on 14)

The method of claim 14, wherein the first graphical object of the first output or the second graphical object of the second output comprises at least one of text, a schematic, a graphic, an image, an animation, a video, audio, augmented reality content, virtual reality content, stereo content, an executable instruction, or an external communication.

### Claim 16 (depends on 14)

The method of claim 14, wherein the first graphical object of the first output or the second graphical object of the second output is displayed automatically by the display device.

### Claim 17 (depends on 14)

The method of claim 14, further comprising retrieving, by the processing device, the first output in response to at least one of an expiration of a timer, receiving a user command, or an environmental factor.

### Claim 18 (depends on 14)

The method of claim 14, wherein the display device is to display the first output to an individual other than the operator.

### Claim 19 (depends on 14)

The method of claim 14, further comprising receiving, by the processing device, a confirmation of display by the display device.

### Claim 20 (depends on 14)

The method of claim 14, wherein the first input or the second input comprises at least one of text, an image, a video, audio, augmented reality content, virtual reality content, stereo content, an executable instruction, an external communication, a selection input, a machine-readable code, or sensor data.
