Probabilistic true color estimate for real-time camera applications
AssigneeLenovo (United States) Inc.
InventorsRafael Marius Radkowski, Chunbo Song, Angela Vivian Dcosta
Life of this patent
Estimating the term…
Abstract
A system maintains stable image colors of a user, such as face tones, when the user is at a computer display device and the user's image is transmitted to other persons, such as in an online meeting. The system adjusts the user's image based on factors such as the light, color and brightness of the computer display device, foreground light and color, background light and color, and light incident on the user and background.
Claims20
A process comprising:
- capturing a screenshot from a computer display device, the screenshot comprising one or more computer applications;
- receiving a computer display brightness of the computer display device;
- analyzing screenshot light, screenshot color, and the computer display brightness to generate a computer display brightness distribution and a computer display color distribution;
- capturing a camera image of a user positioned at the computer display device;
- separating a foreground including the user from a background in the camera image;
- analyzing background brightness and background color in the camera image to generate a background brightness distribution and a background color distribution;
- analyzing foreground brightness and foreground color in the camera image to generate a foreground brightness distribution and a foreground color distribution;
- analyzing light incident upon the user and light incident on the background in the camera image to generate a normal map;
- estimating an appearance of a physical feature of the user as a function of the computer display brightness distribution, the computer display color distribution, the background brightness distribution, the background color distribution, the foreground brightness distribution, the foreground color distribution, the normal map and a database trained using physical features of a plurality of persons in a plurality of lighting conditions at the computer display device;
- computing a color correction map as a function of the estimation of the physical feature of the user;
- and
- adjusting an appearance of the physical feature of the user in an output image using the color correction map.
A non-transitory machine-readable medium comprising instructions that when executed by a processor execute a process comprising:
- capturing a screenshot from a computer display device, the screenshot comprising one or more computer applications;
- receiving a computer display brightness of the computer display device;
- analyzing screenshot light, screenshot color, and the computer display brightness to generate a computer display brightness distribution and a computer display color distribution;
- capturing a camera image of a user positioned at the computer display device;
- separating a foreground including the user from a background in the camera image;
- analyzing background brightness and background color in the camera image to generate a background brightness distribution and a background color distribution;
- analyzing foreground brightness and foreground color in the camera image to generate a foreground brightness distribution and a foreground color distribution;
- analyzing light incident upon the user and light incident on the background in the camera image to generate a normal map;
- estimating an appearance of a physical feature of the user as a function of the computer display brightness distribution, the computer display color distribution, the background brightness distribution, the background color distribution, the foreground brightness distribution, the foreground color distribution, the normal map and a database trained using physical features of a plurality of persons in a plurality of lighting conditions at the computer display device;
- computing a color correction map as a function of the estimation of the physical feature of the user;
- and
- adjusting an appearance of the physical feature of the user in an output image using the color correction map.
A system comprising:
- a computer processor;
- a memory coupled to the computer processor;
- wherein the computer processor and the memory are operable for:
- capturing a screenshot from a computer display device, the screenshot comprising one or more computer applications;
- receiving a computer display brightness of the computer display device;
- analyzing screenshot light, screenshot color, and the computer display brightness to generate a computer display brightness distribution and a computer display color distribution;
- capturing a camera image of a user positioned at the computer display device;
- separating a foreground including the user from a background in the camera image;
- analyzing background brightness and background color in the camera image to generate a background brightness distribution and a background color distribution;
- analyzing foreground brightness and foreground color in the camera image to generate a foreground brightness distribution and a foreground color distribution;
- analyzing light incident upon the user and light incident on the background in the camera image to generate a normal map;
- estimating a physical feature of the user as a function of the computer display brightness distribution, the computer display color distribution, the background brightness distribution, the background color distribution, the foreground brightness distribution, the foreground color distribution, the normal map and a database trained using physical features of a plurality of persons in a plurality of lighting conditions at the computer display device;
- computing a color correction map as a function of the estimation of the physical feature of the user;
- and
- adjusting an appearance of the physical feature of the user in an output image using the color correction map.
Dependencies are inferred from the claim text.