Augmented reality tutorial generation
AssigneeInternational Business Machines Corporation
InventorsPhilipp Schume, Shikhar Kwatra, Craig M. Trim, Zachary A. Silverstein
Life of this patent
Estimating the term…
Abstract
A method, system and computer program product includes identifying, by one or more processors of a computer system, a relevant tutorial to a user using a machine learning ontology tree, and providing, by the one or more processors of the computer system, the identified relevant tutorial to an augmented reality device of the user.
Claims18
A method comprising:
- capturing, by the one or more processors of the computer system, a user interaction with at least one surrounding object;
- determining, by the one or more processors of the computer system, a context of the user interaction based on machine learning technology, wherein the determining the context includes determining whether a user is actively taking steps associated with failure or frustration, wherein the context includes a contextual situation, including visual recognition of a location or environment;
- and
- feeding, by the one or more processors of the computer system, a machine learning ontology tree the determined context of user interaction;
- identifying, by one or more processors of a computer system, a relevant tutorial to a user using the machine learning ontology tree in real time to match the determined context of the user interaction based on a frustration level of the user, wherein the relevant tutorial has been updated by the machine learning technology based on a previous user interaction to determine differences in structure between structural components to be interacted with by the user;
- providing, by the one or more processors of the computer system, the identified relevant tutorial to an augmented reality device of the user;
- overlaying, by the one or more processors of the computer system, the detected relevant tutorial on the augmented reality device of the user;
- and
- highlighting, by the one or more processors of the computer system, the structural components to be interacted with by the user and the differences in structure during the detected relevant tutorial on the augmented reality device of the user.
A computer system, comprising:
- one or more processors;
- one or more memory devices coupled to the one or more processors;
- and
- one or more computer readable storage devices coupled to the one or more processors, wherein the one or more storage devices contain program code executable by the one or more processors via the one or more memory devices to implement a method, the method comprising:
- capturing, by the one or more processors of the computer system, a user interaction with at least one surrounding object;
- determining, by the one or more processors of the computer system, a context of the user interaction based machine learning technology, wherein the determining the context includes determining whether a user is actively taking steps associated with failure or frustration, wherein the context includes a contextual situation, including visual recognition of a location or environment;
- feeding, by the one or more processors of the computer system, a machine learning ontology tree the determined context of user interaction;
- identifying, by the one or more processors of the computer system, a relevant tutorial to a user using the machine learning ontology tree in real time to match the determined context of the user interaction based on a frustration level of the user, wherein the relevant tutorial has been updated by the machine learning technology based on a previous user interaction to determine differences in structure between structural components to be interacted with by the user;
- providing, by the one or more processors of the computer system, the identified relevant tutorial to an augmented reality device of the user;
- overlaying, by the one or more processors of the computer system, the detected relevant tutorial on the augmented reality device of the user;
- and
- highlighting, by the one or more processors of the computer system, the structural components to be interacted with by the user and the differences in structure during the detected relevant tutorial on the augmented reality device of the user.
A computer program product, comprising a computer readable hardware storage device storing a computer readable program code, the computer readable program code comprising an algorithm that when executed by one or more processors of a computer system implements a method, the method comprising:
- capturing, by the one or more processors of the computer system, a user interaction with at least one surrounding object;
- determining, by the one or more processors of the computer system, a context of the user interaction based on machine learning technology, wherein the determining the context includes determining whether a user is actively taking steps associated with failure or frustration, wherein the context includes a contextual situation, including visual recognition of a location or environment;
- feeding, by the one or more processors of the computer system, a machine learning ontology tree the determined context of user interaction;
- identifying, by the one or more processors of the computer system, a relevant tutorial to a user using the machine learning ontology tree in real time to match the determined context of the user interaction based on a frustration level of the user, wherein the relevant tutorial has been updated by the machine learning technology based on a previous user interaction to determine differences in structure between structural components to be interacted with by the user;
- providing, by the one or more processors of the computer system, the identified relevant tutorial to an augmented reality device of the user;
- overlaying, by the one or more processors of the computer system, the detected relevant tutorial on the augmented reality device of the user;
- and
- highlighting, by the one or more processors of the computer system, the structural components to be interacted with by the user and the differences in structure during the detected relevant tutorial on the augmented reality device of the user.
Dependencies are inferred from the claim text.