System and method for object visualization during an ophthalmic procedure

A system for visualizing an object in an ophthalmic surgical suite, the system comprising:

• a single optical sensor configured to obtain an input image from an ophthalmic procedure;
• a controller in communication with the single optical sensor, wherein the controller is configured to:
• receive an input image from the ophthalmic surgical suite from at least one sensor;
• identify an object in the input image;
• select an object representation corresponding to the object identified in the input image;
• determine a 6D pose estimation for the object in the input image by:
• creating a first set of generated 6D pose images each illustrating the object representation in one of a plurality of first coordinates, wherein the first coordinates each define a longitudinal and rotational position for the object representation;
• identifying a first match between the first set of generated 6D pose images and the object in the input image, wherein the first match includes the least variation between the object and the corresponding one of the first set of generated 6D pose images;
• and
• selecting the 6D pose estimation for the object based on coordinates of the first match;
• and
• augment the input image based on the 6D pose estimation.

A non-transitory computer-readable medium embodying programmed instructions which, when executed by a processor, are operable for performing a method comprising:

• receiving an input image of an ophthalmic surgical suite from at least one sensor;
• identifying an object in the input image;
• selecting an object representation corresponding to the object identified in the input image;
• determining a 6D pose estimation for the object in the input image by:
• creating a first set of generated 6D pose images each illustrating the object representation in one of a plurality of first coordinates, wherein the first coordinates each define a longitudinal and rotational position for the object representation;
• identifying a first match between the first set of generated 6D pose images and the object in the input image, wherein the first match includes the least variation between the object and the corresponding one of the first set of generated 6D pose images;
• and
• selecting the 6D pose estimation for the object based on coordinates of the first match;
• and
• augmenting the input image based on the 6D pose estimation.