Infrared-based processing of an image

A device, comprising:

• a processor;
• and
• a memory coupled to the processor and storing instructions that, when executed by the processor, cause the device to perform operations comprising:
• receiving a first image frame and a corresponding set of infrared measurement values;
• dividing the first image frame into a plurality of portions based on the values included in the set of infrared measurement values, the plurality of portions including a first portion illuminated by a first light source and a second portion illuminated by a second light source, the first portion having infrared measurement values of the corresponding set of infrared measurement values that are below a first threshold, and the second portion having infrared measurement values of the corresponding set of infrared measurement values that are above the first threshold;
• and
• based on the division, processing the first image frame by applying a first white balancing to the first portion and applying a second white balancing to the second portion.

A non-transitory computer-readable medium storing instructions that, when executed by a processor of a device, cause the device to perform operations comprising:

• receiving a first image frame and a corresponding set of infrared measurement values;
• dividing the first image frame into a plurality of portions based on the values included in the set of infrared measurement values, the plurality of portions including a first portion illuminated by a first light source and a second portion illuminated by a second light source, the first portion having infrared measurement values of the corresponding set of infrared measurement values that are below a first threshold, and the second portion having infrared measurement values of the corresponding set of infrared measurement values that are above the first threshold;
• and
• based on the division, processing the first image frame as a unit by applying a first white balancing to the first portion and applying a second white balancing to the second portion.

A device, comprising:

• a first image sensor;
• a first multi-point infrared (IR) detector;
• a processor coupled to the first image sensor and to the first multi-point IR detector;
• and
• a memory coupled to the processor,
• wherein the processor is configured to perform steps comprising:
• receiving a first image frame from the first image sensor and a corresponding set of infrared measurement values from the first multi-point IR detector;
• dividing the first image frame into a plurality of portions based on the values included in the set of infrared measurement values, the plurality of portions including a first portion illuminated by a first light source and a second portion illuminated by a second light source, the first portion having infrared measurement values of the corresponding set of infrared measurement values that are below a first threshold, and the second portion having infrared measurement values of the corresponding set of infrared measurement values that are above the first threshold;
• and
• based on the division, processing the first image frame as a unit by applying a first white balancing to the first portion and applying a second white balancing to the second portion.