Back to results
US 10,706,626 B1Granted
Augmented reality procedural system
AssigneeRoger Brent
InventorsRoger Brent, James Ashley
Life of this patent
Estimating the term…
Abstract
An augmented reality device is provided to assist users in performing new or unfamiliar experimental techniques, identify materials and products utilized in a documented action set and within a work environment, identify equipment and instruments needed in the documented action set and within the work environment, assist in performing single person (autonomous) work, collaborate with other workers, and record data and observations in an electronic laboratory notebook.
Claims13
A method of guiding and documenting procedures of an action set through an augmented reality device, the method comprising:
- providing the augmented reality device, operatively disposed to a user space, comprising a processor, memory, a plurality of external transducers, a plurality of internal transducers, and a visual display;
- generating a graphical overlay to an ocular field of view on the visual display;
- transforming an environmental signal, captured through one or both of the plurality of external transducers and the plurality of internal transducers, into an image map comprising detected objects, wherein the processor executes image processing logic, stored in the memory, to detect environmental objects within an interaction environment from the environmental signal;
- recognizing materials and products from the detected objects through spatiotemporal movement analysis, comparative physical modeling, and referencing a materials database, wherein the processor is controlled by object recognition logic, stored in the memory, to recognize the materials and products from the detected objects in a series of sequential image maps;
- synchronizing the graphical overlay to coincidentally align the detected objects of the image map with the environmental objects of the interaction environment to the ocular field of view through operations of the processor controlled by overlay synchronization logic;
- recognizing procedural actions through contextual visual behavior recognition by tracking spatiotemporal movement of the materials and products relative to the materials and products in the series of sequential image maps and correlating to documented procedural actions in an action set database as controlled by behavior identification logic;
- capturing quantifiable data in quantifying features of the materials and products through contextual feature analysis by correlating the procedural actions and an ocular line of sight to the quantifying features of the materials and products in the series of sequential image maps;
- visualizing a guided interaction overlay as the graphical overlay in response to a selection input of a documented action set from the action set database;
- identifying upcoming actions from the documented action set and corresponding equipment and instrument identifiers for the upcoming actions;
- identifying equipment and instruments in the graphical overlay representing the corresponding equipment and instrument identifiers;
- warming the corresponding equipment and instrument identifiers in the graphical overlay in proportion to their distance from a current position in the documented action set;
- and
- providing on the augmented reality device a comparison of the action set as carried out by a user and an ideal version of the action set, in response to the user stopping motion and requesting the ideal version of the action set via the augmented reality device.
10 more elements
Dependencies are inferred from the claim text.