Multimodal User Interfaces for Interacting with Digital Model Files

A system for interacting with a live digital object, comprising:

• at least one processor;
• and
• at least one memory storing program code, the program code executable by the at least one processor to cause the at least one processor to execute a process for interacting with the live digital object, the program code comprising code to:
• receive the live digital object, wherein the live digital object comprises a digital artifact extracted from digital model data of a digital model file through a model representation, wherein the model representation comprises model-type-specific locators to the digital model data, wherein the live digital object is located in an object customer environment and the digital model file is located in a model customer environment that is distinct from the object customer environment, and wherein a notification of a modification of the digital model data appears in the live digital object within a predetermined delay;
• initiate a connection to a multimodal interface, wherein the multimodal interface is configured to receive input from at least two different modalities, and wherein the multimodal interface is configured to output the at least two different modalities;
• receive a security level of a first user;
• determine an access permission of the first user to access the digital artifact and a modification permission of the first user to modify the digital artifact, based on the security level of the first user;
• output to the multimodal interface, through the connection, the digital artifact based on the access permission of the first user to access the digital artifact;
• receive from the multimodal interface, through the connection, an input from the first user related to the digital artifact;
• and
• generate a modified digital artifact from the digital artifact via the model representation, based on the modification permission of the first user to modify the digital artifact, and based on the input from the first user.

A computer-implemented method for interacting with a live digital object, comprising:

• receiving the live digital object, wherein the live digital object comprises a digital artifact extracted from digital model data of a digital model file through a model representation, wherein the model representation comprises model-type-specific locators to the digital model data, wherein the live digital object is located in an object customer environment and the digital model file is located in a model customer environment that is distinct from the object customer environment, and wherein a notification of a modification of the digital model data appears in the live digital object within a predetermined delay;
• initiating a connection to a multimodal interface, wherein the multimodal interface is configured to receive input from at least two different modalities, and wherein the multimodal interface is configured to output the at least two different modalities;
• receiving a security level of a first user;
• determining an access permission of the first user to access the digital artifact and a modification permission of the first user to modify the digital artifact, based on the security level of the first user;
• outputting to the multimodal interface, through the connection, the digital artifact based on the access permission of the first user to access the digital artifact;
• receiving from the multimodal interface, through the connection, an input from the first user related to the digital artifact;
• and
• generating a modified digital artifact from the digital artifact via the model representation, based on the modification permission of the first user to modify the digital artifact, and based on the input from the first user.