# US 2021/0243347 A1 · Generating static images with an event camera > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0243347 A1 - Document ID: US20210243347A1 - Status: Published application - Kind: A1 - Application number: 17/235,175 - Filed: 2021-04-20 - Published: 2021-08-05 - Earliest claimed: 2017-09-28 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Aleksandr M. Movshovich; Arthur Yasheng Zhang - Web page: https://patentgrep.com/patent/US20210243347A1 ## CPC - H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability} - H04N 23/72: Combination of two or more compensation controls - H04N 23/60: Control of cameras or camera modules - H04N 23/71: Circuitry for evaluating the brightness variation - H04N 23/74: by influencing the scene brightness using illuminating means - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract In accordance with some embodiments, a method is performed at an image processing device with a processor and non-transitory memory. The method includes triggering light emission, over a first emission duration, having a characterizing intensity as a function of time. The method further includes obtaining respective pixel events, from an event camera, corresponding to reflections of the light emission during the first emission duration, each respective pixel event corresponding to a breach of a respective comparator threshold indicative of a brightness level, each respective pixel event characterized by a respective electrical threshold value and a timestamp at which the respective electrical threshold value was breached. The method also includes generating a static image by determining a plurality of luminance estimation values from the respective pixel events, wherein the plurality of luminance estimation values respectively correspond to an amount of reflected light received by portions of the event camera. ## Claims ### Claim 1 A method comprising: at a device with a processor and non-transitory memory: obtaining, from an event camera, a plurality of events, wherein each of the plurality of events includes a timestamp indicating a time at which a respective threshold value was breached; determining, based on the plurality of pixel events, a plurality of luminance estimation values corresponding to an amount of light received by portions of the event camera; and generating a static image of a scene based on the plurality of luminance estimation values. ### Claim 2 (depends on 1) The method of claim 1, wherein each of the plurality of events further includes a threshold indicator indicating the respective threshold value. ### Claim 3 (depends on 1) The method of claim 1, wherein each of the plurality of events further includes a location indicator indicating a location of a pixel element of the event camera. ### Claim 4 (depends on 3) The method of claim 3, wherein generating the static image of the scene includes arranging the luminance estimation values based on the location indicators. ### Claim 5 (depends on 1) The method of claim 1, further comprising receiving an illumination signal characterizing a change in illumination of the scene, wherein determining the plurality of luminance estimation values is based on the illumination signal. ### Claim 6 (depends on 5) The method of claim 5, wherein the illumination signal is received from an ambient light sensor. ### Claim 7 (depends on 5) The method of claim 5, wherein the illumination signal characterizes a control signal provided to a controllable light source that emits light based on the control signal. ### Claim 8 (depends on 5) The method of claim 5, wherein determining the plurality of luminance estimation values includes fitting the pixel events to curves based on the illumination signal. ### Claim 9 (depends on 8) The method of claim 8, wherein the curves based on the illumination signal are similarly shaped. ### Claim 10 (depends on 8) The method of claim 8, wherein determining the plurality of luminance estimation values includes estimating respective asymptotic limits of the curves based on the illumination signal. ### Claim 11 (depends on 1) The method of claim 1, wherein the plurality of events includes a first event associated with a first pixel element of the event camera and a first respective threshold value and a second event associated with the first pixel element of the event camera and a second respective threshold value different than the first respective threshold value. ### Claim 12 A device comprising: an event camera to generate a plurality of events, wherein each of the plurality of events includes a timestamp indicating a time at which a respective threshold value was breached; and an image processor to determine, based on the plurality of pixel events, a plurality of luminance estimation values corresponding to an amount of light received by portions of the event camera and to generate a static image of a scene based on the plurality of luminance estimation values. ### Claim 13 (depends on 12) The device of claim 12, wherein the image processor is further to receive an illumination signal characterizing a change in illumination of the scene, wherein the image processor is to determine the plurality of luminance estimation values based on the illumination signal. ### Claim 14 (depends on 13) The device of claim 13, further comprising an ambient light sensor to generate the illumination signal. ### Claim 15 (depends on 13) The device of claim 13, further comprising a controllable light source that emits light based on a control signal characterized by the illumination signal. ### Claim 16 (depends on 13) The device of claim 13, wherein the image processor is to determine the plurality of luminance estimation values by fitting the pixel events to curves based on the illumination signal. ### Claim 17 (depends on 16) The device of claim 16, wherein the curves based on the illumination signal are similarly shaped. ### Claim 18 (depends on 16) The device of claim 16, wherein determining the plurality of luminance estimation values includes estimating respective asymptotic limits of the curves based on the illumination signal. ### Claim 19 (depends on 1) The device of claim 1, wherein the plurality of events includes a first event associated with a first pixel element of the event camera and a first respective threshold value and a second event associated with the first pixel element of the event camera and a second respective threshold value different than the first respective threshold value. ### Claim 20 A non-transitory computer-readable storage medium having instructions stored thereon which, when executed by one or more processors of a device, cause the device to: obtain, from an event camera, a plurality of events, wherein each of the plurality of events includes a timestamp indicating a time at which a respective threshold value was breached; determine, based on the plurality of pixel events, a plurality of luminance estimation values corresponding to an amount of light received by portions of the event camera; and generate a static image of a scene based on the plurality of luminance estimation values.