# US 12,008,708 B2 · Method and data processing system for creating or adapting individual images based on properties of a light ray within a lens > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,008,708 B2 - Document ID: US12008708B2 - Status: Granted - Kind: B2 - Application number: 17/159,506 - Filed: 2021-01-27 - Published: 2021-05-20 - Granted: 2024-06-11 - Earliest claimed: 2018-07-27 - Assignees: Carl Zeiss AG - Applicants: Carl Zeiss AG - Inventors: Michael Wick; Christian Wojek; Vladan Blahnik; Torsten Sievers - Web page: https://patentgrep.com/patent/US12008708B2 ## CPC - G06T 15/503: {Blending, e.g. for anti-aliasing} - G06T 15/205: {Image-based rendering} - G06T 15/506: {Illumination models} - H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method for creating a second series of individual images with a first series of individual images, the individual images of the first or the second series of individual images having been captured with an objective, includes determining the entrance pupil and the field of vision of the objective for the individual images of the first series and creating or adapting the individual images of the second series in accordance with the entrance pupil and the field of vision of the objective of the individual image in question of the first series. ## Claims ### Claim 1 A method for creating a second series of individual images with a first series of individual images, wherein individual images of the first or the second series of individual images were recorded with a lens, the method comprising: determining properties of a light ray within the lens for the individual images of the first series of individual images; and creating or adapting the individual images of the second series of individual images by taking account of properties of the light ray within the lens of a respective individual image of the first series of individual images, wherein determining properties of the light ray is effected for a first lens, and wherein creating or adapting the individual images of the second series of individual images is effected by additionally taking account of the properties of a light ray within a second lens. ### Claim 2 (depends on 1) The method as claimed in claim 1, wherein determining properties of the light ray within the lens comprises determining an entrance pupil and a field of view of the lens for the individual images of the first series of individual images; and/or wherein creating or adapting the individual images of the second series of individual images is effected taking account of the entrance pupil and the field of view of the lens of the respective individual image of the first series of individual images. ### Claim 3 (depends on 2) The method as claimed in claim 2, wherein creating or adapting comprises performing a point spread function and/or an optical transfer function and/or a ray function. ### Claim 4 (depends on 1) The method as claimed in claim 1, further comprising: combining an image content of the first series of individual images and the image content of the second series of individual images, wherein the combining comprises adapting the image content of the individual images of the second series of individual images to the image content of the individual images of the first series of individual images or creating the individual images of the second series of individual images, in each case taking account of an entrance pupil and a field of view of the lens of the respective individual image of the first series of individual images. ### Claim 5 (depends on 4) The method as claimed in claim 4, wherein adapting or creating the individual images comprises: besides taking account of the entrance pupil and the field of view, taking account of at least one of a position of an exit pupil, a depth of field, vignetting, a distortion, a bokeh, a chromatic aberration, a focus, a position of lens elements within the lens, an aperture, an exposure duration, a color appearance, and a reflection within the lens. ### Claim 6 (depends on 1) The method as claimed in claim 1, wherein creating the individual images of the second series of individual images comprises creating the individual images with rendering a virtual scene. ### Claim 7 (depends on 1) The method as claimed in claim 1, wherein adapting the individual images of the second series of individual images is preceded by creating the individual images of the second series with the lens for a camera. ### Claim 8 (depends on 1) The method as claimed in claim 1, wherein: determining properties of the light ray comprises recording one or more imaging parameters of the lens during capturing of the first series of individual images; and adapting or creating the individual images of the second series of individual images comprises adapting or creating the individual images of the second series of individual images with imaging parameters. ### Claim 9 (depends on 8) The method as claimed in claim 8, wherein the individual images of the second series of individual images are created with the imaging parameters of the lens in real time. ### Claim 10 (depends on 1) The method as claimed in claim 1, wherein determining properties of the light ray comprises recording a temporal series of imaging parameters. ### Claim 11 (depends on 10) The method as claimed in claim 10, further comprising at least one of: planning a capturing of the first series of individual images based on the recording of the temporal series of imaging parameters; and capturing the first series of individual images with the recording of the temporal series of imaging parameters. ### Claim 12 (depends on 1) The method as claimed in claim 1, wherein the method is provided to be performed in at least one of cinematography, photography, computer games, medical imaging, security applications, face recognition, computer-based simulations, virtual reality, and industrial metrology. ### Claim 13 (depends on 1) A data processing system comprising means for carrying out the method as claimed in claim 1. ### Claim 14 A non-transitory computer-readable storage medium encoded with a computer program comprising instructions which, when executed on a data processing system, cause the data processing system to: determine properties of a light ray within a lens by determining a size, a shape, and/or a location of an exit pupil of the lens for a predetermined group of image points; input an object space function; create a point spread function and/or input an optical transfer function and/or create a ray function; and create or adapt an image by taking account of the properties of the light ray, wherein the properties of the light ray are determined for a first lens, and wherein the image is created or adapted by additionally taking account of the properties of a light ray within a second lens.