Image processing based on object categorization

A method of image processing, the method comprising:

• receiving image data captured by an image sensor;
• determining that a first object image region of a plurality of object image regions in the image data depicts a first object category of a plurality of object categories;
• and that a second object image region of the plurality of object image regions in the image data depicts a second object category of the plurality of object categories to generate a category map associated with the image data;
• identifying a plurality of confidence levels corresponding to a plurality of confidence image regions of a confidence map associated with the image data, wherein each confidence level of the plurality of confidence levels identifies a confidence associated with a categorization in the category map that a corresponding confidence image region of the plurality of confidence image regions depicts one of the plurality of object categories;
• generating, based on the category map and the confidence map, a plurality of modifiers for a predetermined setting for an image signal processor (ISP) tuning parameter, the plurality of modifiers identifying a first deviation from the predetermined setting for a first intersection, wherein the first intersection is an intersection of the first object image region and a first confidence image region, the first confidence image region corresponding to a first confidence level, the plurality of modifiers identifying a second deviation from the predetermined setting for a second intersection, wherein the second intersection is an intersection of the first object image region and a second confidence image region, the second confidence image region corresponding to a second confidence level, the plurality of modifiers identifying a third deviation from the predetermined setting for a third intersection, wherein the third intersection is an intersection of the second object image region and a third confidence image region;
• and
• generating an image based on the image data using the ISP tuning parameter at least in part by applying different settings for the ISP tuning parameter to different portions of the image data, the different settings for the ISP tuning parameter being based on the one or more plurality of modifiers, the different portions of the image data including a plurality of intersections of different object image regions of the plurality of object image regions and different confidence image regions of the plurality of confidence image regions, the plurality of intersections including at least the first intersection, the second intersection, and the third intersection.

A non-transitory computer readable storage medium having embodied thereon a program that is executable by a processor to perform a method of image processing, the method comprising:

• receiving image data captured by an image sensor;
• determining that a first object image region of a plurality of object image regions in the image data depicts a first object category of a plurality of object categories;
• and that a second object image region of the plurality of object image regions in the image data depicts a second object category of the plurality of object categories to generate a category map associated with the image data;
• identifying a plurality of confidence levels corresponding to a plurality of confidence image regions of a confidence map associated with the image data, wherein each confidence level of the plurality of confidence levels identifies a confidence associated with a categorization in the category map that a corresponding confidence image region of the plurality of confidence image regions depicts one of the plurality of object categories;
• generating, based on the category map and the confidence map, a plurality of modifiers for a predetermined setting for an image signal processor (ISP) tuning parameter, the plurality of modifiers identifying a first deviation from the predetermined setting for a first intersection, wherein the first intersection is an intersection of the first object image region and a first confidence image region, the first confidence image region corresponding to a first confidence level, the plurality of modifiers identifying a second deviation from the predetermined setting for a second intersection, wherein the second intersection is an intersection of the first object image region and a second confidence image region, the second confidence image region corresponding to a second confidence level, the plurality of modifiers identifying a third deviation from the predetermined setting for a third intersection, wherein the third intersection is an intersection of the second object image region and a third confidence image region;
• and
• generating an image based on the image data using the ISP tuning parameter at least in part by applying different settings for the ISP tuning parameter to different portions of the image data, the different settings for the ISP tuning parameter being based on the plurality of modifiers, the different portions of the image data including a plurality of intersections of different object image regions of the plurality of object image regions and different confidence image regions of the plurality of confidence image regions, the plurality of intersections including at least the first intersection, the second intersection, and the third intersection.