# US 2019/0377969 A1 · Systems and methods for generating skin tone profiles > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0377969 A1 - Document ID: US20190377969A1 - Status: Published application - Kind: A1 - Application number: 16/114,555 - Filed: 2018-08-28 - Published: 2019-12-12 - Earliest claimed: 2018-06-06 - Assignees: Perfect Corp. - Applicants: Perfect Corp. - Inventors: Chia-Chen Kuo; Ho-Chao Huang - Web page: https://patentgrep.com/patent/US20190377969A1 ## CPC - G06V 40/16: Human faces, e.g. facial parts, sketches or expressions - G06Q 30/0282: Rating or review of business operators or products - G06T 7/74: {involving reference images or patches} - G06T 7/90: Determination of colour characteristics - G06V 40/168: {Feature extraction; Face representation} - A45D 44/005: {for selecting or displaying personal cosmetic colours or hairstyle} - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - A45D: HAIRDRESSING OR SHAVING EQUIPMENT (wigs, toupees or the like A41G3/00, A41G5/00; hairdressers' chairs A47C1/04; hair cutting appliances, razors B26B); EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING ## Abstract A computing device with a digital camera obtains a reference image depicting at least one reference color and calibrates parameters of the digital camera based on the at least one reference color. The computing device captures, by the digital camera, a digital image of an individual utilizing the calibrated parameters. The computing device defines a region of interest in a facial region of the individual depicted in the digital image captured by the digital camera. The computing device generates a skin tone profile for pixels within the region of interest and displays a predetermined makeup product recommendation based on the skin tone profile. ## Claims ### Claim 1 A method implemented in a computing device having a digital camera, comprising: obtaining a reference image depicting at least one reference color; calibrating parameters of the digital camera based on the at least one reference color; capturing, by the digital camera, a digital image of an individual utilizing the calibrated parameters; defining a region of interest in a facial region of the individual depicted in the digital image captured by the digital camera; generating a skin tone profile for pixels within the region of interest; and displaying a predetermined makeup product recommendation based on the skin tone profile. ### Claim 2 (depends on 1) The method of claim 1, wherein the reference image is depicted on one of the following objects: a white balance card, a color checker, a banknote, a credit card, photocopy paper, tissue paper, a mobile phone, a non-glossy white object. ### Claim 3 (depends on 2) The method of claim 2, wherein the object depicting the reference image is located at a predefined distance from the digital camera. ### Claim 4 (depends on 1) The method of claim 1, wherein the parameters of the digital camera comprise at least one of: white balance level; exposure compensation; and gamma correction. ### Claim 5 (depends on 1) The method of claim 1, wherein defining the region of interest in the facial region comprises: determining a color distance between pixels in the facial region and one or more predetermined target skin tones; and designating pixels within a threshold color distance of the one or more predetermined target skin tones as part of the region of interest. ### Claim 6 (depends on 1) The method of claim 1, wherein defining the region of interest in the facial region comprises: identifying locations of predetermined feature points within the facial region; and defining a boundary of the region of interest based on the locations of the predetermined feature points. ### Claim 7 (depends on 1) The method of claim 1, wherein generating the skin tone profile for the pixels within the region of interest comprises: generating a luminance histogram for the pixels within the region of interest; removing predetermined portions of the luminance histogram to generate a target histogram portion; determining a dominant color value based on the target histogram portion; and generating the skin tone profile based on the determined dominant color value. ### Claim 8 (depends on 7) The method of claim 7, wherein determining the dominant color value based on the target histogram portion comprises one of: calculating a mean of the target histogram; calculating a peak of the target histogram; calculating a weighted average of the target histogram; or calculating a mean based on a mean-shift clustering algorithm of the target histogram. ### Claim 9 (depends on 1) The method of claim 1, wherein generating the skin tone profile for the pixels within the region of interest comprises: extracting an illumination layer and a reflectance layer from the pixels within the region of interest; and generating the skin tone profile based on the reflectance layer. ### Claim 10 (depends on 1) The method of claim 1, wherein generating the skin tone profile for the pixels within the region of interest comprises one of: converting a detected skin tone from a first color space to a second color space based on a predefined transformation matrix; or mapping a detected skin tone from a first classification to a second classification based on a predefined lookup table. ### Claim 11 A system, comprising: a digital camera; a memory storing instructions; a processor coupled to the memory and configured by the instructions to at least: obtain a reference image depicting at least one reference color; calibrate parameters of the digital camera based on the at least one reference color; capture, by the digital camera, a digital image of an individual utilizing the calibrated parameters; define a region of interest in a facial region of the individual depicted in the digital image captured by the digital camera; generate a skin tone profile for pixels within the region of interest; and display a predetermined makeup product recommendation based on the skin tone profile. ### Claim 12 (depends on 11) The system of claim 11, wherein the reference image is depicted on one of the following objects: a white balance card, a color checker, a banknote, a credit card, photocopy paper, tissue paper, a mobile phone, a non-glossy white object. ### Claim 13 (depends on 11) The system of claim 11, wherein the parameters of the digital camera comprise at least one of: white balance level; exposure compensation; and gamma correction. ### Claim 14 (depends on 11) The system of claim 11, wherein the processor defines the region of interest in the facial region by: determining a color distance between pixels in the facial region and one or more predetermined target skin tones; and designating pixels within a threshold color distance of the one or more predetermined target skin tones as part of the region of interest. ### Claim 15 (depends on 11) The system of claim 11, wherein the processor defines the region of interest in the facial region by: identifying locations of predetermined feature points within the facial region; and defining a boundary of the region of interest based on the locations of the predetermined feature points. ### Claim 16 (depends on 11) The system of claim 11, wherein the processor generates the skin tone profile for the pixels within the region of interest by: generating a luminance histogram for the pixels within the region of interest; removing predetermined portions of the luminance histogram to generate a target histogram portion; determining a dominant color value based on the target histogram portion; and generating the skin tone profile based on the determined dominant color value. ### Claim 17 (depends on 11) The system of claim 11, wherein the processor generates the skin tone profile for the pixels within the region of interest by: extracting an illumination layer and a reflectance layer from the pixels within the region of interest; and generating the skin tone profile based on the reflectance layer. ### Claim 18 A non-transitory computer-readable storage medium storing instructions to be implemented by a computing device having a processor, wherein the instructions, when executed by the processor, cause the computing device to at least: obtain a reference image depicting at least one reference color; calibrate parameters of a digital camera based on the at least one reference color; capture, by the digital camera, a digital image of an individual utilizing the calibrated parameters; define a region of interest in a facial region of the individual depicted in the digital image captured by the digital camera; and generate a skin tone profile for pixels within the region of interest; and display a predetermined makeup product recommendation based on the skin tone profile. ### Claim 19 (depends on 18) The non-transitory computer-readable storage medium of claim 18, wherein the reference image is depicted on one of the following objects: a white balance card, a color checker, a banknote, a credit card, photocopy paper, tissue paper, a mobile phone, a non-glossy white object. ### Claim 20 (depends on 18) The non-transitory computer-readable storage medium of claim 18, wherein the parameters of the digital camera comprise at least one of: white balance level; exposure compensation; and gamma correction. ### Claim 21 (depends on 18) The non-transitory computer-readable storage medium of claim 18, wherein the processor defines the region of interest in the facial region by: determining a color distance between pixels in the facial region and one or more predetermined target skin tones; and designating pixels within a threshold color distance of the one or more predetermined target skin tones as part of the region of interest. ### Claim 22 (depends on 18) The non-transitory computer-readable storage medium of claim 18, wherein the processor defines the region of interest in the facial region by: identifying locations of predetermined feature points within the facial region; and defining a boundary of the region of interest based on the locations of the predetermined feature points. ### Claim 23 (depends on 18) The non-transitory computer-readable storage medium of claim 18, wherein the processor generates the skin tone profile for the pixels within the region of interest by: generating a luminance histogram for the pixels within the region of interest; removing predetermined portions of the luminance histogram to generate a target histogram portion; determining a dominant color value based on the target histogram portion; and generating the skin tone profile based on the determined dominant color value.