Back to results
US 12,340,502 B2Granted
Projector assembly system and method
AssigneeInspecVision Limited
InventorJan Antonis
Life of this patent
Estimating the term…
Abstract
A method of assembling a plurality of objects comprises: creating a pixel map of a current scene in a work zone by mapping pixels of a camera to pixels of a projector; comparing the current scene pixel map with a corresponding previous scene pixel map; creating a projector pixel set depending on the differences between the current scene pixel map and the previous scene pixel map; and causing the projector to illuminate the work zone using the projector pixel set. The method may include a training mode in which the correct assembly steps are learned, a guidance mode in which a user is guided through the assembly steps, and a verification mode in which the actual assembly steps are verified.
Claims12
A method of assembling a plurality of objects in a work zone using a camera and a projector, wherein said camera is configured to capture images defined by camera pixels, and said projector is configured to project images defined by projector pixels, the method comprising:
- in a training mode, in respect of a first step of a sequence of assembly steps:
- arranging at least one object correctly in said work zone;
- causing said projector to illuminate a first current scene in said work zone by projecting at least one projector image onto said work zone, wherein said at least one projector image is defined by projector pixels, wherein said first current scene comprises said at least one object correctly arranged in said work zone;
- causing said camera to capture at least one captured image of said first current scene in said work zone illuminated by said at least one projector image, wherein said at least one captured image is defined by camera pixels;
- mapping the camera pixels of said at least one captured image to the projector pixels of said at least one projector image to create a first current scene pixel map that defines a correspondence between said camera pixels and said projector pixels for said first step of said sequence of assembly steps;
- comparing said first current scene pixel map with a corresponding other reference scene pixel map for said work zone to identify at least one difference between said first current scene pixel map and said reference scene pixel map;
- creating a projector pixel set for said first step, said projector pixel set representing said at least one difference identified between said first current scene pixel map and said reference scene pixel map;
- and
- in said training mode, in respect of each subsequent step of said sequence of assembly steps:
- arranging at least one other object correctly in said work zone, and/or rearranging said at least one object in said work zone;
- causing said projector to illuminate a respective current scene in said work zone by projecting at least one projector image onto said work zone, wherein said at least one projector image is defined by projector pixels;
- causing said camera to capture at least one captured image of said respective current scene in said work zone illuminated by said at least one projector image, wherein said at least one captured image is defined by camera pixels;
- mapping the camera pixels of said at least one captured image to the projector pixels of said at least one projector image to create a respective current scene pixel map that defines a correspondence between said camera pixels and said projector pixels for the respective subsequent step of said sequence of assembly steps;
- comparing said respective current scene pixel map with a preceding scene pixel map for a preceding step of said sequence of assembly steps to identify at least one difference between said respective current scene pixel map and said preceding scene pixel map;
- creating a projector pixel set for the respective subsequent step, said projector pixel set representing said at least one difference identified between said respective current scene pixel map and said preceding scene pixel map;
- and
- in a guidance mode or in a verification mode, in respect of said first step:
- causing said projector to illuminate said work zone using said projector pixel set for said first step to indicate, by illumination of said work zone, said at least one difference identified between said first current scene pixel map and said reference scene pixel map, and
- in said guidance mode or in said verification mode, in respect of each subsequent step of said sequence of assembly steps:
- causing said projector to illuminate said work zone using said projector pixel set for the respective subsequent step to indicate, by illumination of said work zone, said at least one difference identified between said respective current scene pixel map and said preceding scene pixel map.
17 more elements
An assembly system comprising:
- at least one camera configured to capture images defined by camera pixels;
- at least one projector configured to project images defined by projector pixels;
- and a computer-implemented controller,
- said controller being configured to, in a training mode, in respect of a first step of a sequence of assembly steps:
- cause said projector to illuminate a first current scene in said work zone by projecting at least one projector image onto said work zone, wherein said at least one projector image is defined by projector pixels, wherein said first current scene comprises said at least one object correctly arranged in said work zone;
- cause said camera to capture at least one captured image of said first current scene in said work zone illuminated by said at least one projector image, wherein said at least one captured image is defined by camera pixels;
- map the camera pixels of said at least one captured image to the projector pixels of said at least one projector image to create a first current scene pixel map that defines a correspondence between said camera pixels and said projector pixels for said first step of said sequence of assembly steps;
- compare said first current scene pixel map with a reference scene pixel map for said work zone to identify at least one difference between said first current scene pixel map and said reference scene pixel map;
- and
- create a projector pixel set for said first step, said projector pixel set representing said at least one difference identified between said first current scene pixel map and said reference scene pixel map, said controller being further configured to, in said training mode, in respect of each subsequent step of said sequence of assembly steps:
- cause said projector to illuminate a respective current scene in said work zone by projecting at least one projector image onto said work zone, wherein said at least one projector image is defined by projector pixels;
- cause said camera to capture at least one captured image of said respective current scene in said work zone illuminated by said at least one projector image, wherein said at least one captured image is defined by camera pixels;
- map the camera pixels of said at least one captured image to the projector pixels of said at least one projector image to create a respective current scene pixel map that defines a correspondence between said camera pixels and said projector pixels for the respective subsequent step of said sequence of assembly steps;
- compare said respective current scene pixel map with a preceding scene pixel map for a preceding step of said sequence of assembly steps to identify at least one difference between said respective current scene pixel map and said preceding scene pixel map;
- and
- create a projector pixel set for the respective subsequent step, said projector pixel set representing said at least one difference identified between said respective current scene pixel map and said preceding scene pixel map,
- said controller being further configured to, in a guidance mode or in a verification mode, in respect of said first step:
- cause said projector to illuminate said work zone using said projector pixel set for said first step to indicate, by illumination of said work zone, said at least one difference identified between said first current scene pixel map and said reference scene pixel map,
- said controller being further configured to, in said guidance more or in said verification mode, in respect of each subsequent step of said sequence of assembly steps:
- cause said projector to illuminate said work zone using said projector pixel set for the respective subsequent step to indicate, by illumination of said work zone, said at least one difference identified between said respective current scene pixel map and said preceding scene pixel map.
17 more elements
Dependencies are inferred from the claim text.