Mixed reality workflow generation

A system for generating a mixed reality workflow, the system comprising:

• a process analysis module configured to:
• identify a series of tasks and generate an input task-to-object-mapping by analyzing data that defines a process performed by a first user interacting with objects in a first location, wherein the input task-to-object-mapping comprises, for each task in the series of tasks, a mapping of the task to an object used in the task, and
• determine a task-specific non-spatial characteristic of each object in the input task-to-object-mapping;
• a process mapping module configured to:
• identify a plurality of candidate objects in a second location, location data defining a position of each candidate object within the second location and a non-spatial characteristic of each candidate object by analyzing data received from the second location,
• generate an output task-to-object mapping by mapping each object in the input task-to-object-mapping to a candidate object using the non-spatial characteristic of each object in the input task-to-object mapping and the non-spatial characteristic of each candidate object, and
• generate a mapped workflow comprising a process path using the series of tasks, the location data and the output task-to-object-mapping;
• and
• a communication interface configured to output the mapped workflow to a device in the second location.

A system for generating a mixed reality workflow, the system comprising:

• a process analysis module configured to:
• receive a captured video stream of a process performed by a first user interacting with objects in a first location;
• identify in the captured video stream a series of tasks using video analysis;
• generate an input task-to-object-mapping that comprises for each task in the series of tasks, a mapping of the task to an object used in the task, and
• determine a task-specific non-spatial characteristic of each object in the input task-to-object-mapping;
• store the task-to-object-mapping in a data structure;
• a process mapping module configured to generate the mixed reality workflow from the stored data structure, by:
• identifying a plurality of candidate objects in a second location, location data defining a position of each candidate object within the second location and a non-spatial characteristic of each candidate object by analyzing data received from the second location,
• generating an output task-to-object mapping by mapping each object in the input task-to-object-mapping to a candidate object using the non-spatial characteristic of each object in the input task-to-object mapping and the non-spatial characteristic of each candidate object, and
• generate a mapped workflow comprising a process path using the series of tasks, the location data and the output task-to-object-mapping;
• and
• a communication interface configured to output the mapped workflow as the mixed reality workflow to a device configured to display the mixed reality workflow in the second location.