Systems and methods for generating defocus blur effects

One or more computer-readable non-transitory storage media embodying software for using a machine-learning model to generate images with defocus-blur effects based on in-focus input images and corresponding depth maps, wherein the software is operable when executed to:

• receive current eye-tracking data associated with a user of a head-mounted display;
• dynamically adjust a focal length of the head-mounted display based on the current eye-tracking data;
• generate an in-focus image of a scene and a corresponding depth map of the scene;
• generate a circle-of-confusion map for the scene based on the depth map, wherein the circle-of-confusion map encodes a desired focal surface in the scene;
• generate, using the machine-learning model, an output image with a synthesized defocus-blur effect by processing the in-focus image, the corresponding depth map, and the circle-of-confusion map of the scene;
• and
• display the output image with the synthesized defocus-blur effect to the user via the head-mounted display having the adjusted focal length.

A system for using a machine-learning model to generate images with defocus-blur effects based on in-focus input images and corresponding depth maps, the system comprising:

• one or more processors;
• and one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to:
• receive current eye-tracking data associated with a user of a head-mounted display;
• dynamically adjust a focal length of the head-mounted display based on the current eye-tracking data;
• generate an in-focus image of a scene and a corresponding depth map of the scene;
• generate a circle-of-confusion map for the scene based on the depth map, wherein the circle-of-confusion map encodes a desired focal surface in the scene;
• generate, using the machine-learning model, an output image with a synthesized defocus-blur effect by processing the in-focus image, the corresponding depth map, and the circle-of-confusion map of the scene;
• and
• display the output image with the synthesized defocus-blur effect to the user via the head-mounted display having the adjusted focal length.