Back to results
US 12,182,950 B2Granted
Remote expert method and system utilizing quantitative quality assurance in mixed reality
AssigneeThe United States of America as represented by the Secretary of the Navy
InventorLarry Clay Greunke
Life of this patent
Estimating the term…
Abstract
This disclosure and exemplary embodiments described herein provide a Parallel Content Authoring Method and Tool for Procedural Guidance, and a Remote Expert Method and System Utilizing Quantitative Quality Assurance in Mixed Reality. The implementation described herein is related to the generation of content/instruction set that can be viewed in different modalities, including but not limited to mixed reality, VR, audio text, however it is to be understood that the scope of this disclosure is not limited to such application.
Claims21
A method for remote expert utilizing quantitative quality assurance in a mixed reality system, the method comprising:
- (a) presenting a 3D representation of target equipment to an expert user, wherein a synchronized 3D representation of the target equipment is presented to a novice user;
- (b) receiving a part selection and a requested action for an equipment part of the target equipment from the expert user;
- (c) parallel authoring, by a sensor, wherein the sensor creates a data structure based at least in part on information collected from a mixed reality environment, wherein the data structure is paralleled to author multiple outputs, the multiple outputs comprising position, corrosion type, and job control number;
- (e) presenting the novice user's performance of the requested action on the equipment part to the expert user, wherein the presentation of the novice user's performance comprises various sensor data collected at the novice user's physical environment location;
- (f) validating, by a direct measures feedback, the novice user's performance of the requested action;
- (g) generating a confidence assessment of the novice user's performance of the requested action, wherein the confidence assessment specifies whether the expert user rejects the requested action as failing performance requirements, based at least in part on an indirect measures or the direct measures feedback;
- (h) if the requested action is rejected as failing performance requirements, repeating steps (c)-(e) until the expert accepts the requested action as satisfying the performance requirements;
- and
- (i) repeating steps (a)-(h) until a plurality of requested actions are accepted by the expert as satisfying the performance requirements, wherein the plurality of requested actions complete a maintenance task.
6 more elements
A remote expert system utilizing quantitative quality assurance, the remote expert system comprising:
- a mixed reality controller performing a method to:
- define a coordinate system frame of reference for a target physical system, the coordinate system frame of reference including an initial point of the target physical system and at least one directional axis that are specified by a user of the mixed reality controller;
- define additional points of the target physical system;
- and
- define interface elements of the target physical system;
- and
- a computer system performing a method to:
- generate a 3D model of the target physical system based on the coordinate system frame of reference, the additional points, and the interface elements;
- (a) present the 3D representation of target equipment to an expert user, wherein a synchronized 3D representation of the target equipment is presented to a novice user;
- (b) receive a part selection and a requested action for an equipment part of the target equipment from the expert user;
- (c) parallel author, by a sensor, wherein the sensor creates a data structure based at least in part on information collected from a mixed reality environment, wherein the data structure is paralleled to author multiple outputs, the multiple outputs comprising position, corrosion type, and job control number;
- (d) present the novice user's performance of the requested action on the equipment part to the expert user, wherein the presentation of the novice user's performance comprises various sensor data collected at the novice user's physical environment location;
- (e) validate, by a direct measures feedback, the novice user's performance of the requested action;
- (f) generate a confidence assessment of the novice user's performance of the requested action, wherein the confidence assessment specifies whether the expert user rejects the requested action as failing performance requirements, based at least in part on an indirect measures or the direct measures feedback;
- (g) if the requested action is rejected as failing performance requirements, repeat steps (c)-(e) until the expert accepts the requested action as satisfying the performance requirements;
- and
- (h) repeat steps (a)-(g) until a plurality of requested actions are accepted by the expert as satisfying the performance requirements, wherein the plurality of requested actions complete a maintenance task.
14 more elements
A non-transitory computer-readable medium comprising executable instructions for causing a computer system to perform a method for remote expert utilizing quantitative quality assurance in a mixed reality system, the instructions when executed causing the computer system to:
- (a) present a 3D representation of target equipment to an expert user, wherein a synchronized 3D representation of the target equipment is presented to a novice user;
- (b) receive a part selection and a requested action for an equipment part of the target equipment from the expert user;
- (c) present the novice user's performance of the requested action on the equipment part to the expert user, wherein the presentation of the novice user's performance comprises various sensor data collected at the novice user's physical environment location;
- (d) parallel author, by a sensor, wherein the sensor creates a data structure based at least in part on information collected from a mixed reality environment, wherein the data structure is paralleled to author multiple outputs, the multiple outputs comprising position, corrosion type, and job control number;
- (e) validate, by a direct measures feedback, the novice user's performance of the requested action;
- (f) generate a confidence assessment of the novice user's performance of the requested action, wherein the confidence assessment specifies whether the expert user rejects the requested action as failing performance requirements, based at least in part on an indirect measures or the direct measures feedback;
- (g) if the requested action is rejected as failing performance requirements, repeat steps (c)-(d) until the expert accepts the requested action as satisfying the performance requirements;
- and
- (h) repeat steps (a)-(g) until a plurality of requested actions are accepted by the expert as satisfying the performance requirements, wherein the plurality of requested actions complete a maintenance task.
6 more elements
Dependencies are inferred from the claim text.