Augmented reality (AR)-based management of manual assembly processes
AssigneeShopify Inc.
InventorsRuss Maschmeyer, Eric Andrew Florenzano, Brennan Letkeman, Diego Macario Bello, Daniel Beauchamp, Neil Leonard Padgett, Hettige Ray Perera Jayatunga, James Lepp, Andrew Nhat-Nam Ngo
Life of this patent
Estimating the term…
Abstract
A computer-implemented is disclosed. The method includes: obtaining image data from a plurality of cameras providing views of a designated assembly zone; updating a three-dimensional model of an assembly of a structure based on the obtained image data; and determining a location of a first component of the structure based on the updated three-dimensional model of the assembly.
Claims20
A computer-implemented method, comprising:
- obtaining image data from a plurality of cameras providing views of a designated assembly zone;
- updating a three-dimensional model of an assembly of a structure based on the obtained image data;
- determining locations of one or more components of sub-assemblies of the assembly based on the updated three-dimensional model of the assembly;
- identifying assemblers associated with one or more assembly steps;
- determining relative position information indicating positions of the identified assemblers with respect to the locations of the components of the sub-assemblies;
- and
- determining, for each of one or more of the identified assemblers, a respective subset of all assembly instructions to assign to the assembler based on the relative position information.
A computing system, comprising:
- a processor;
- and
- a memory coupled to the processor, the memory storing computer-executable instructions that, when executed by the processor, configure the processor to:
- obtain image data from a plurality of cameras providing views of a designated assembly zone;
- update a three-dimensional model of an assembly of a structure based on the obtained image data;
- determine locations of one or more components of sub-assemblies of the assembly based on the updated three-dimensional model of the assembly;
- identify assemblers associated with one or more assembly steps;
- determine relative position information indicating positions of the identified assemblers with respect to the locations of the components of the sub-assemblies;
- and
- determine, for each of one or more of the identified assemblers, a respective subset of all assembly instructions to assign to the assembler based on the relative position information.
A non-transitory processor-readable medium storing computer-executable instructions that, when executed by a processor, are to cause the processor to:
- obtain image data from a plurality of cameras providing views of a designated assembly zone;
- update a three-dimensional model of an assembly of a structure based on the obtained image data;
- determine locations of one or more components of sub-assemblies of the assembly based on the updated three-dimensional model of the assembly;
- identify assemblers associated with one or more assembly steps;
- determine relative position information indicating positions of the identified assemblers with respect to the locations of the components of the sub-assemblies;
- and
- determine, for each of one or more of the identified assemblers, a respective subset of all assembly instructions to assign to the assembler based on the relative position information.
Dependencies are inferred from the claim text.