Parallel content authoring method and system for procedural guidance
AssigneeThe Government of the United States of America, as represented by the Secretary of the Navy
InventorLarry Clay Greunke
Life of this patent
Estimating the term…
Abstract
This disclosure and exemplary embodiments described herein provide a Parallel Content Authoring Method and Tool for Procedural Guidance, and a Remote Expert Method and System Utilizing Quantitative Quality Assurance in Mixed Reality. The implementation described herein is related to the generation of content/instruction set that can be viewed in different modalities, including but not limited to mixed reality, VR, audio text, however it is to be understood that the scope of this disclosure is not limited to such application.
Claims21
A method for parallel content authoring, the method comprising:
- creating a 3D representation of a target physical system;
- receiving a part selection from an editor of the 3D representation, the part selection from one of a plurality of parts included in the target physical system;
- collecting part actions from the editor, the part actions associated with actions to be performed on the selected part;
- creating queued annotations for the part actions, wherein the queued annotations are to be displayed in a 3D environment with respect to the 3D representation of the target physical system, and wherein at least one of the queued annotations includes a camera position recording based on a type of the corresponding part action and a location of the target system part;
- collecting and associating augmented reality data with the queued annotations;
- publishing a data structure bundle including a data set for generation of the queued annotations, the data set parsable to create mixed reality content;
- and
- a mixed reality system creating and presenting to a user content including the queued annotations from the data set, where the user interacts with the target physical system and parts included in the parts selection according to the queued annotations.
A parallel content authoring system comprising:
- a mixed reality controller performing a method to:
- define a coordinate system frame of reference for a target physical system, the coordinate system frame of reference including an initial point of the target physical system and at least one directional axis that are specified by a user of the mixed reality controller;
- define additional points of the target physical system;
- and
- define interface elements of the target physical system;
- and
- a computer system performing a method to:
- generate a 3D model of the target physical system based on the coordinate system frame of reference, the additional points, and the interface elements;
- receive a part selection from an editor of the 3D representation, the part selection from one of a plurality of parts included in the target physical system;
- collect part actions from the editor, the part actions associated with actions to be performed on the selected part;
- create queued annotations for the part actions, wherein the queued annotations are to be displayed in a 3D environment with respect to the 3D representation of the target physical system, and wherein at least one of the queued annotations includes a camera position recording based on a type of the corresponding part action and a location of the target system part;
- collect and associate augmented reality data with the queued annotations;
- and
- publish a data structure bundle including a data set for generation of the queued annotations, the data set parsable to create mixed reality content,
- wherein a mixed reality system creates and presents to a user content including the queued annotations from the data set, where the user interacts with the target physical system and parts included in the parts selection according to the queued annotations.
A non-transitory computer-readable medium comprising executable instructions for causing a computer system to perform a method for parallel content authoring, the instructions when executed causing the computer system to:
- create a 3D representation of a target physical system;
- receive a part selection from an editor of the 3D representation, the part selection from one of a plurality of parts included in the target physical system;
- collect part actions from the editor, the part actions associated with actions to be performed on the selected part;
- create queued annotations for the part actions, wherein the queued annotations are to be displayed in a 3D environment with respect to the 3D representation of the target physical system, and wherein at least one of the queued annotations includes a camera position recording based on a type of the corresponding part action and a location of the target system part;
- collect and associating augmented reality data with the queued annotations;
- publish a data structure bundle including a data set for generation of the queued annotations, the data set parsable to create mixed reality content;
- and
- present to a user using an associated mixed reality system content including the queued annotations from the data set, where the user interacts with the target physical system and parts included in the parts selection according to the queued annotations.
Dependencies are inferred from the claim text.