HDR/WDR image time stamps for sensor fusion

An apparatus to determine timestamp information, the apparatus comprising:

• an image sensor configured to capture a plurality of sub-frames of a scene, wherein each sub-frame comprises an image of the scene captured using an exposure time that is different from at least one other exposure time of at least one other sub-frame of the plurality of sub-frames;
• and
• at least one processor coupled to the image sensor and configure to:
• receive, from the image sensor, for each of the plurality of sub-frames, sub-pixel image data corresponding to a first portion of an image frame;
• determine composite image data corresponding to the first portion of the image frame based on values of the received sub-pixel image data for the plurality of sub-frames;
• identify an indicator based on the sub-frames corresponding to the received sub-pixel image data used to determine the composite image data;
• and
• determine timestamp information, based on the identified indicator, wherein the timestamp information corresponds to the composite image data based upon timing information for the plurality of sub-frames,
• wherein determining the composite image data comprises blending values of the sub-pixel image data of one or more sub-frames of the plurality of sub-frames using one or more blending parameters, each blending parameter corresponding to a sub-frame of the plurality of sub-frames, and indicating a degree to which the sub-pixel image data corresponding to the sub-frame is used to determine the composite image data, and wherein the indicator indicates at least a portion of the one or more blending parameters.

A method for determining timestamp information for wide dynamic range composite images, comprising:

• receiving, from an image sensor, sub-pixel image data corresponding to a first portion of an image frame for each of a plurality of sub-frames, each sub-frame comprising an image of a scene captured using an exposure time that is different from at least one other exposure time of at least one other sub-frame of the plurality of sub-frames;
• determining composite image data corresponding to the first portion of the image frame based on values of the received sub-pixel image data for the plurality of sub-frames and by selecting, from the plurality of sub-frames, a particular sub-frame to be associated with the composite image data based on luminosity values of the sub-pixel image data of the plurality of sub-frames;
• identifying an indicator based on the sub-frames corresponding to the received sub-pixel image data used to determine the composite image data;
• and
• determining timestamp information, based on the identified indicator, wherein the timestamp information corresponds to the composite image data based upon timing information for the plurality of sub-frames.

A method for determining timestamp information for wide dynamic range composite images, comprising:

• receiving, from an image sensor, sub-pixel image data corresponding to a first portion of an image frame for each of a plurality of sub-frames, each sub-frame comprising an image of a scene captured using an exposure time that is different from at least one other exposure time of at least one other sub-frame of the plurality of sub-frames;
• determining composite image data corresponding to the first portion of the image frame based on values of the received sub-pixel image data for the plurality of sub-frame;
• identifying an indicator based on the sub-frames corresponding to the received sub-pixel image data used to determine the composite image data;
• and
• determining timestamp information based on the identified indicator by:
• identifying timing information associated with the plurality of sub-frames, wherein the timing information comprises initial timing information associated with the plurality of sub-frames and a rolling shutter angle associated with the image sensor;
• determining sub-pixel timing information for each of the plurality of sub-frames, based upon the initial timing information associated with the plurality of sub-frames, a location of the first portion of the image frame, and the rolling shutter angle associated with the image sensor;
• and
• determining a timestamp associated with an image value, based upon sub-pixel timing information and the indicator associated with the image value, wherein the timestamp information corresponds to the composite image data based upon timing information for the plurality of sub-frames.