System and method for advanced lens geometry fitting for imaging devices

A method comprising:

• at a computing device in communication with a projector comprising a non-planar lens, the projector configured for projection onto a object:
• using an initial model of the non-planar lens that relates a position of projected points on the object to pixel points at an image modulator of the projector, determining, at the computing device, at least one initial estimate of intrinsic parameters of the projector using the initial model;
• determining, at the computing device, at least one initial estimate of extrinsic parameters of the projector using the at least one initial estimate of the intrinsic parameters;
• iteratively evaluating, at the computing device, an error function that includes a comparison between the pixel points and a transformation of the projected points to the pixel points, an initial transformation determined using the at least one initial estimate of the intrinsic parameters and the at least one initial estimate of the extrinsic parameters, and iterative transformations including one or more of:
• varying one or more nonlinear terms used in the initial model of the non-planar lens, in one or more iterations;
• increasing a number of the one or more nonlinear terms used in the initial model of the non-planar lens in one or more of the iterations;
• varying intrinsic parameters of the projector;
• and
• varying extrinsic parameters of the projector;
• when the error function, of one or more iterations, one or more of converges, reaches a minimum, and is less than a threshold value:
• store current value of the intrinsic parameters of the projector and the extrinsic parameters of the projector as pose data;
• and,
• controlling, at the computing device, the projector to project images onto the object based on the pose data.

A non-transitory computer-readable medium storing a computer program, wherein execution of the computer program is for:

• at a computing device in communication with a projector comprising a non-planar lens, the projector configured for projection onto a object:
• using an initial model of the non-planar lens that relates a position of projected points on the object to pixel points at an image modulator of the projector, determining, at the computing device, at least one initial estimate of intrinsic parameters of the projector using the initial model;
• determining, at the computing device, at least one initial estimate of extrinsic parameters of the projector using the at least one initial estimate of the intrinsic parameters;
• iteratively evaluating, at the computing device, an error function that includes a comparison between the pixel points and a transformation of the projected points to the pixel points, an initial transformation determined using the at least one initial estimate of the intrinsic parameters and the at least one initial estimate of the extrinsic parameters, and iterative transformations including one or more of:
• varying one or more nonlinear terms used in the initial model, in one or more iterations;
• increasing a number of the one or more nonlinear terms used in the initial model of the non-planar lens in one or more of the iterations;
• varying intrinsic parameters of the projector;
• and varying extrinsic parameters of the projector;
• when the error function, of one or more iterations, one or more of converges, reaches a minimum, and is less than a threshold value:
• store current value of the intrinsic parameters of the projector and the extrinsic parameters of the projector as pose data;
• and,
• controlling, at the computing device, the projector to project images onto the object based on the pose data.