# US 2025/0085773 A1 · Augmented reality machining aid

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0085773 A1
- Document ID: US20250085773A1
- Status: Published application
- Kind: A1
- Application number: 18/463,445
- Filed: 2023-09-08
- Published: 2025-03-13
- Earliest claimed: 2023-09-08
- Assignees: Pratt & Whitney Canada Corp.
- Applicants: Pratt & Whitney Canada Corp.
- Inventors: Jeff Beaudet
- Web page: https://patentgrep.com/patent/US20250085773A1

## CPC

- G05B 19/409: characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters (G05B19/408, G05B19/4093 take precedence)
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- B64F 5/60: Testing or inspecting aircraft components or systems
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)}
- G02B 27/017: {Head mounted}
- G05B 19/41875: {characterised by quality surveillance of production}
- G05B 23/0216: {Human interface functionality, e.g. monitoring system providing help to the user in the selection of tests or in its configuration}
- G06Q 10/20: Administration of product repair or maintenance
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/0141: {characterised by the informative content of the display}
- G05B 2219/32014: Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command
- G05B 2219/35482: Eyephone, head-mounted 2-D or 3-D display, also voice and other control
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- B64F: GROUND OR AIRCRAFT-CARRIER-DECK INSTALLATIONS SPECIALLY ADAPTED FOR USE IN CONNECTION WITH AIRCRAFT; DESIGNING, MANUFACTURING, ASSEMBLING, CLEANING, MAINTAINING OR REPAIRING AIRCRAFT, NOT OTHERWISE PROVIDED FOR; HANDLING, TRANSPORTING, TESTING OR INSPECTING AIRCRAFT COMPONENTS, NOT OTHERWISE PROVIDED FOR
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

A method of visualizing data with respect to a component includes identifying a model of the component. The method further includes accessing part data defining an internal configuration of each of a plurality of models of components. The method further includes associating the internal configuration of the model of the component with the component. The method further includes accessing process data defining a plurality of processing methods applicable to the identified model of the component, and receiving an indicator of a desired processing method out of the processing methods defined by the process data. The method further includes generating a visual overlay on a display based on the process data and the associated internal configuration of the component, wherein the visual overlay includes a guiding visualization for at least one step of the desired processing method associated with at least one feature of the internal configuration of the component.

## Claims

### Claim 1

A method of visualizing data with respect to a component, comprising:
identifying, at a computing device, a model of the component;
accessing, at the computing device, part data defining an internal configuration of each of a plurality of models of components, the part data including the model of the component;
associating, at the computing device, the internal configuration of the model of the component with the component;
accessing, at the computing device, process data defining a plurality of processing methods applicable to the identified model of the component;
receiving, at the computing device, an indicator of a desired processing method out of the processing methods defined by the process data; and
generating, by the computing device, a visual overlay on a display based on the process data and the associated internal configuration of the component, wherein the component is visible when the display is positioned between a user's eye and the component, wherein the visual overlay includes a guiding visualization for at least one step of the desired processing method associated with at least one feature of the internal configuration of the component, and wherein the generating the visual overlay includes generating outlines that are indicative of the internal configuration of the component.

### Claim 2 (depends on 1)

The method of claim 1, wherein the guiding visualization includes a visual indication of a correct tool path of a tool associated with the desired processing method.

### Claim 3 (depends on 1)

The method of claim 1, wherein the generating the visual overlay includes providing a visual warning associated with the desired processing method.

### Claim 4 (depends on 1)

The method of claim 1, wherein the desired processing method is a machining process and the generating the visual overlay includes providing a removal indicator that indicates portions of the component to be removed as part of the machining process.

### Claim 5 (depends on 1)

The method of claim 1, further comprising capturing perception data indicative of the user's field-of-view of the component, and wherein the generating the visual overlay is based on the perception data.

### Claim 6 (depends on 5)

The method of claim 5, wherein the generating the visual overlay includes aligning at least part of the visual overlay with a visual vector, the visual vector extending between the user's eye and a feature of the internal configuration of the component when the display is positioned between the user's eye and the component.

### Claim 7 (depends on 5)

The method of claim 5, wherein the identifying the model of the component includes comparing the perception data with the part data.

### Claim 8 (depends on 5)

The method of claim 5, wherein the generating the visual overlay includes providing a feedback indicator that is responsive to actions of the user captured within the perception data.

### Claim 9 (depends on 8)

The method of claim 8, wherein the feedback indicator includes a first visual indication if movement of a tool by the user matches a correct tool path stored in the process data and a second visual indication if the movement does not match the correct tool path.

### Claim 10 (depends on 9)

The method of claim 9, wherein the first visual indication includes highlighting the tool in a first color and wherein the second visual indication includes highlighting the tool in a second color different from the first color.

### Claim 11

(canceled)

### Claim 12 (depends on 1)

The method of claim 1, wherein the desired processing method is associated with removing a component from a gas turbine engine.

### Claim 13 (depends on 1)

The method of claim 1, wherein the display comprises a wearable display device.

### Claim 14

A system for visualizing data with respect to a component, comprising:
a computing device including a memory, wherein the memory stores part data defining an internal configuration of each of a plurality of models of components, and stores process data defining a plurality of processing methods applicable to the plurality of models of components;
wherein the computing device is configured to:
identify a model of the component;
associate the component with an internal configuration of the model of the component defined in the part data,
receive an indicator of a desired processing method out of the processing methods defined by the process data, and
generate a visual overlay for a display based on the process data and the associated internal configuration of the component, wherein the component is visible when the display is positioned between a user's eye and the component, wherein the visual overlay includes a guiding visualization for at least one step of the desired processing method associated with at least one feature of the internal configuration of the component, and wherein the visual overlay includes an outline that is indicative of the internal configuration of the component.

### Claim 15 (depends on 14)

The system of claim 14, wherein the guiding visualization includes a visual indication of a correct tool path of a tool associated with the desired processing method.

### Claim 16

(canceled)

### Claim 17 (depends on 14)

The system of claim 14, further comprising a perception sensor configured to capture perception data indicative of the user's field-of view of the component, and wherein the computing device is configured to generate the visual overlay based on the perception data.

### Claim 18 (depends on 17)

The system of claim 17, further comprising a wearable display device, the wearable display device including the perception sensor and the display.

### Claim 19 (depends on 17)

The system of claim 17, wherein the visual overlay includes a feedback indicator that is responsive to actions of the user captured within the perception data.

### Claim 20 (depends on 19)

The system of claim 19, wherein the feedback indicator includes a first visual indication if movement of a tool by the user matches a correct tool path stored in the process data and a second visual indication if the movement does not match the correct tool path.

### Claim 21 (depends on 2)

The method of claim 2, wherein the visual indication of the correct tool path includes a three-dimensional line.

### Claim 22 (depends on 2)

The method of claim 2, wherein the visual indication of the correct tool path provides a tool path that avoids contact of the tool with the at least one feature of the internal configuration of the component.