# US 2021/0241494 A1 · System and method of lipstick bulktone and application evaluation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241494 A1
- Document ID: US20210241494A1
- Status: Published application
- Kind: A1
- Application number: 17/161,930
- Filed: 2021-01-29
- Published: 2021-08-05
- Earliest claimed: 2020-01-31
- Assignees: L'oreal
- Applicants: L'oreal
- Inventors: Yue QIAO; Kelsey NORWOOD; Anke HADASCH; Gisela PERRUNA
- Web page: https://patentgrep.com/patent/US20210241494A1

## CPC

- G06T 7/90: Determination of colour characteristics
- G06Q 30/0631: {Recommending goods or services}
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T 2207/10024: Color image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30201: Face
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

A method for predicting applied lipstick color includes extracting reference hue information from one or more digital images of a plurality of lip-tone cards, each lip-tone card including a plurality of lip-tone swatches, a white swatch, and a black swatch; extracting applied hue information from one or more digital images of a plurality of lip-tone cards coated with lipstick; and generating a predicted applied lipstick color based on the extracted applied hue information and one or more inputs indicative of a lipstick selection.

## Claims

### Claim 1

A method of predicting applied lipstick color, comprising:
extracting reference hue information from one or more digital images of a plurality of lip-tone cards, each lip-tone card including a plurality of lip-tone swatches, a white swatch, and a black swatch;
extracting applied hue information from one or more digital images of a plurality of lip-tone cards coated with lipstick; and
generating a predicted applied lipstick color based on the extracted applied hue information and one or more inputs indicative of a lipstick selection.

### Claim 2 (depends on 1)

The method of predicting applied lipstick color of claim 1, wherein generating the predicted applied lipstick color includes generating a predicted applied lipstick color based on the extracted applied hue information, the one or more inputs indicative of a lipstick selection, and user lip hue information.

### Claim 3 (depends on 1)

The method of predicting applied lipstick color of claim 1, further comprising:
extracting user lip hue information from one or more digital images; and
generating the predicted applied lipstick color based on the extracted applied hue information, the one or more inputs indicative of a lipstick selection, and the extracted user lip hue information.

### Claim 4 (depends on 3)

The method of predicting applied lipstick color of claim 3, further comprising:
generating one or more instances on a virtual display of a lipstick product predicted to result in a hue, on the user, that is within a predetermined threshold of the hue of the lipstick selection, based on the extracted applied hue information, the one or more inputs indicative of a lipstick selection, and the extracted user lip hue information.

### Claim 5 (depends on 3)

The method of predicting applied lipstick color of claim 3, further comprising:
generating one or more instances on a virtual display of a predicted resulting lipstick hue associated with the one or more inputs indicative of a lipstick selection, on the user, based on the extracted applied hue information, the one or more inputs indicative of a lipstick selection, and the extracted user lip hue information.

### Claim 6 (depends on 1)

The method of predicting applied lipstick color of claim 1, further comprising:
determining a hue of the one or more inputs indicative of a lipstick selection.

### Claim 7 (depends on 1)

The method of predicting applied lipstick color of claim 1, further comprising:
determining a lipstick having a hue that is within a predetermined threshold of the hue of the one or more inputs indicative of a lipstick selection.

### Claim 8 (depends on 3)

The method of predicting applied lipstick color of claim 3, further comprising:
determining a first liptone swatch of the plurality of lip-tone swatch having the hue that is within a predetermined threshold of the hue of the lips of the user.

### Claim 9 (depends on 7)

The method of predicting applied lipstick color of claim 7, further comprising:
determining, based the applied lipstick color corresponding to the lipstick, a recommended lipstick.

### Claim 10 (depends on 1)

The method of predicting applied lipstick color of claim 1, further comprising:
transmitting one or more of
predicted applied lipstick color information of a product based on the lipstick selection; and
lipstick product recommendation information regarding a product predicted to result in a hue, on the user, that is within a predetermined threshold of product having a hue of the lipstick selection.
