Light field processor system

A method performed by a wearable ophthalmic device including a head-mounted light field display, the method comprising:

• receiving light from surroundings of the device that is captured by at least one outward facing head-mounted light field camera of the device;
• determining, based on the light received by the at least one outward facing head-mounted light field camera, left numerical light field image data describing images to be displayed to a left eye of a user of the device and right numerical light field image data describing images to be displayed to a right eye of the user;
• generating modified numerical light field image data by computationally introducing at least one shift to at least one of the left numerical light field image data or the right numerical light field image data based on a convergence point of the left eye and the right eye of the user;
• and
• generating a physical light field that corresponds to the modified numerical light field image data and that is displayed using the head-mounted light field display, wherein the physical light field displays images for viewing by the user,
• wherein the at least one shift includes at least one lateral shift of a location of at least one of the images displayed, wherein the images include sets of images to be presented to the left eye and the right eye respectively, wherein the method further comprises determining a gaze direction of at least one of the left eye and the right eye, and wherein the at least one lateral shift adjusts a position of at least one of the sets of images to be centered within a field of view of the corresponding eye based on the respective gaze direction of the eye.

Non-transitory computer-readable storage media storing instructions which, when executed by at least one processor, instruct the at least one processor to perform actions comprising:

• receiving light from surroundings of a wearable ophthalmic device that includes a head-mounted light field display, wherein the light is captured by at least one outward facing head-mounted light field camera of the device;
• determining, based on the light received by the at least one outward facing head-mounted light field camera, left numerical light field image data describing images to be displayed to a left eye of a user of the device and right numerical light field image data describing images to be displayed to a right eye of the user;
• generating modified numerical light field image data by computationally introducing at least one shift to at least one of the left numerical light field image data or the right numerical light field image data based on a convergence point of the left eye and the right eye of the user;
• and
• generating a physical light field that corresponds to the modified numerical light field image data and that is displayed using the head-mounted light field display, wherein the physical light field displays images for viewing by the user,
• wherein the at least one shift includes at least one lateral shift of a location of at least one of the images displayed, wherein the images include sets of images to be presented to the left eye and the right eye respectively, wherein the actions further comprise determining a gaze direction of at least one of the left eye and the right eye, and wherein the at least one lateral shift adjusts a position of at least one of the sets of images to be centered within a field of view of the corresponding eye based on the respective gaze direction of the eye.