# US 2021/0279911 A1 · Color engine > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0279911 A1 - Document ID: US20210279911A1 - Status: Published application - Kind: A1 - Application number: 17/208,939 - Filed: 2021-03-22 - Published: 2021-09-09 - Earliest claimed: 2017-07-03 - Assignees: StyleRiser Inc. - Applicants: StyleRiser Inc. - Inventors: Margrit Sieglinde Hunsmann; Mark Hunsmann; Glen Kenneth Brown - Web page: https://patentgrep.com/patent/US20210279911A1 ## CPC - G06Q 30/0621: {by configuring or customising goods or services} - G06T 7/90: Determination of colour characteristics - G01J 3/463: {Colour matching} - G01J 3/50: using electric radiation detectors - G06Q 30/0623: {by investigating goods or services} - G06V 40/168: {Feature extraction; Face representation} - G01J 2003/466: {Coded colour; Recognition of predetermined colour; Determining proximity to predetermined colour} - G01J 2003/467: {Colour computing} - G06T 2207/10024: Color image - G06T 2207/30201: Face - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract In some examples, a method includes using at least one processor, accessing image data representing an image of a face of a user, identifying a facial feature of the user using the image data, using the at least one processor, automatically matching the facial feature to a matched pattern of a plurality of patterns, based on configured pattern lookup rules, identifying a product depiction, from a plurality of product depictions stored in product database, based on the matched pattern of the plurality of patterns, and causing display of the product depiction on a user interface. ## Claims ### Claim at position 1 1-21. (canceled) ### Claim 22 A method comprising: using at least one processor, accessing image data representing an image of a face of a user; identifying a facial feature of the user using the image data; using the at least one processor, automatically matching the facial feature to a matched pattern of a plurality of patterns, based on configured pattern lookup rules; identifying a product depiction, from a plurality of product depictions stored in a product database, based on the matched pattern of the plurality of patterns; and causing display of the product depiction on a user interface. ### Claim 23 (depends on 22) The method of claim 22, comprising, using the at least one processor, automatically identifying a base color of the face using the image data, and identifying the product depiction, from the plurality of product depictions stored in a product database, based on the base color and the matched pattern of the plurality of patterns. ### Claim 24 (depends on 22) The method of claim 22, wherein the identifying of the product depiction is performed using a product color of the product depiction. ### Claim 25 (depends on 24) The method of claim 24, comprising: using the at least one processor, automatically matching the base color of the face to a color palette based on a configured color lookup rule; and identifying the product depiction, from the plurality of product depictions, based on the product color of the product depiction being included in the color palette. ### Claim 26 (depends on 22) The method of claim 22, comprising selecting a plurality of image samples included in a region of the image representing the facial feature of the user, each image sample in the plurality of image samples including a minimum number of pixels. ### Claim 27 (depends on 26) The method of claim 26, comprising identifying a color temperature of each image sample in the plurality of image samples, a base color of the face of the user being identified based on one or more colors identified for image samples in the plurality of image samples. ### Claim 28 (depends on 27) The method of claim 27, wherein the base color of the face of the user is automatically identified, using the at least one processor, as an average of the one or more colors identified for the image samples in the plurality of image samples. ### Claim 29 (depends on 28) The method of claim 28, wherein the identifying of the base color of the face comprises: identifying a second color temperature of the base color of the face, and; automatically identifying a color palette having a third color temperature corresponding to the second color temperature of the base color of the face. ### Claim 30 (depends on 29) The method of claim 29, further comprising: identifying a color temperature of each of the image samples of the plurality of image samples; and identify the second color temperature of the base color of the face based on one or more color temperatures identified for the image samples in the plurality of image samples. ### Claim 31 (depends on 27) The method of claim 27, further comprising, for each particular image sample in the plurality of image samples: determining an average color temperature of the particular image sample; and selecting, from among pixels of the particular image sample, selected pixels having a color whose distance from an average color of the particular image sample is below a threshold, a color of the particular image sample being identified based on the colors of the selected pixels. ### Claim 32 (depends on 31) The method of claim 31, wherein the color of the particular image sample is identified as an average of the colors of the selected pixels. ### Claim 33 A computing apparatus comprising: a processor; and a memory storing instructions that, when executed by at least one processor, configure the apparatus to: access image data representing an image of a face of a user; identify a facial feature of the user using the image data; automatically match the facial feature to a matched pattern of a plurality of patterns, based on configured pattern lookup rules; identify a product depiction, from a plurality of product depictions stored in a product database, based on the matched pattern of the plurality of patterns; and cause display of the product depiction on a user interface. ### Claim 34 (depends on 33) The computing apparatus of claim 33, wherein the instructions further configure the apparatus to: automatically identify a base color of the face using the image data, and identify the product depiction, from the plurality of product depictions stored in a product database, based on the base color and the matched pattern of the plurality of patterns. ### Claim 35 (depends on 36) The computing apparatus of claim 36, wherein the instructions further configure the apparatus to: identify a color temperature of each image sample in the plurality of image samples, a base color of the face of the user being identified based on one or more colors identified for image samples in the plurality of image samples. ### Claim 36 (depends on 33) The computing apparatus of claim 33, wherein the instructions further configure the apparatus to: select a plurality of image samples included in a region of the image representing the facial feature of the user, each image sample in the plurality of image samples including a minimum number of pixels. ### Claim 37 (depends on 38) The computing apparatus of claim 38, wherein the instructions further configure the apparatus to: automatically match the base color of the face to a color palette based on a configured color lookup rule; and identify the product depiction, from the plurality of product depictions, based on the product color of the product depiction being included in the color palette. ### Claim 38 (depends on 33) The computing apparatus of claim 33, wherein the identifying of the product depiction is performed use a product color of the product depiction. ### Claim 39 (depends on 35) The computing apparatus of claim 35, wherein the base color of the face of the user is automatically identified as an average of the one or more colors identified for the image samples in the plurality of image samples. ### Claim 40 (depends on 35) The computing apparatus of claim 35, wherein the instructions further configure the apparatus, for each particular image sample in the plurality of image samples to: determine an average color temperature of the particular image sample; and select, from among pixels of the particular image sample, selected pixels having a color whose distance from an average color of the particular image sample is below a threshold, a color of the particular image sample being identified based on the colors of the selected pixels. ### Claim 41 A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to: access image data representing an image of a face of a user; identify a facial feature of the user using the image data; automatically match the facial feature to a matched pattern of a plurality of patterns, based on configured pattern lookup rules; identify a product depiction, from a plurality of product depictions stored in a product database, based on the matched pattern of the plurality of patterns; and cause display of the product depiction on a user interface.