# US 10,311,284 B2 · Creation of representative content based on facial analysis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,311,284 B2
- Document ID: US10311284B2
- Status: Granted
- Kind: B2
- Application number: 15/497,423
- Filed: 2017-04-26
- Published: 2017-08-10
- Granted: 2019-06-04
- Earliest claimed: 2014-04-28
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: David Lee; Chunkit Jacky Chan; Doug Ricard; Stacia Scott; Allison Light
- Web page: https://patentgrep.com/patent/US10311284B2

## CPC

- G06V 40/16: Human faces, e.g. facial parts, sketches or expressions
- G06V 40/161: {Detection; Localisation; Normalisation}
- G06V 40/168: {Feature extraction; Face representation}
- G06V 40/174: {Facial expression recognition}
- G06V 40/193: {Preprocessing; Feature extraction}
- C07C 1/00: Preparation of hydrocarbons from one or more compounds, none of them being a hydrocarbon
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- C07C: ACYCLIC OR CARBOCYCLIC COMPOUNDS

## Abstract

Technologies for analyzing various features detected in a face detected in an image. Such features may include at least the eyes, eyebrows, node, and mouth of a face. Such analyzing may include scoring aspects of these features. Such scores may be weighted. The analysis may be used to determine expressions and/or poses of the face, as well as indicate if the face is smiling, frowning, or neutral. An overall quality score for the face may also be determined and provided based on the aforementioned analysis as well as whether or not the face is near an edge of the image or cut-off in the image. Finally, a face signature may be determined that uniquely identifies the face, at least within the scope of the analyzed features. Such face signatures may be used to detect a similar face in other images.

## Claims

### Claim 1

A method performed on a computing device, the method comprising:
assigning a face identifier to a first face detected in a first image, the first face belonging to a person;
generating, by the computing device, a set of facial feature descriptors based on an analysis of the first face detected in the first image and on the face identifier of the first face, each of the facial feature descriptors corresponding to an analyzed physical feature of the first face detected in the first image; and
generating, by the computing device and based on the set of facial feature descriptors, a face signature that uniquely identifies a second face detected in a second image as belonging to the same person.

### Claim 2 (depends on 1)

The method of claim 1 further comprising:
generating, by the computing device and based on the set of facial feature descriptors, a quality score of the first face.

### Claim 3 (depends on 2)

The method of claim 2 where the quality score is determined based partially on the location of the first face within the first image.

### Claim 4 (depends on 2)

The method of claim 2 where the quality score is based partially on the amount of the first face in the first image.

### Claim 5 (depends on 1)

The method of claim 1 further comprising:
generating, by the computing device and based on the set of facial feature descriptors, an expression of the first face.

### Claim 6 (depends on 1)

The method of claim 1 further comprising:
generating, by the computing device and based on the set of facial feature descriptors, a pose of the first face.

### Claim 7

A computing device comprising:
a processor;
memory coupled to the processor;
a program module that is stored in the memory and that, based on execution by the processor, configures the computing device to perform actions comprising:
assigning a face identifier to a first face detected in a first image, the first face belonging to a person;
generating, by the computing device, a set of facial feature descriptors based on an analysis of the first face detected in the first image and on the face identifier of the first face, each of the facial feature descriptors corresponding to an analyzed physical feature of the first face detected in the first image; and
generating, by the computing device and based on the set of facial feature descriptors, a face signature that uniquely identifies a second face detected in a second image as belonging to the same person.

### Claim 8 (depends on 7)

The computing device of claim 7, the actions further comprising:
generating, by the computing device and based on the set of facial feature descriptors, a quality score of the first face.

### Claim 9 (depends on 8)

The computing device of claim 8 where the quality score is determined based partially on the location of the first face within the first image.

### Claim 10 (depends on 8)

The computing device of claim 8 where the quality score is based partially on the amount of the first face in the first image.

### Claim 11 (depends on 7)

The computing device of claim 7, the actions further comprising:
generating, by the computing device and based on the set of facial feature descriptors, an expression of the first face.

### Claim 12 (depends on 7)

The computing device of claim 7, the actions further comprising:
generating, by the computing device and based on the set of facial feature descriptors, a pose of the first face.

### Claim 13

At least one computer-readable media storing computer-executable instructions that, when executed by a computing device, cause the computing device to perform actions comprising:
assigning a face identifier to a first face detected in a first image, the first face belonging to a person;
generating, by the computing device, a set of facial feature descriptors based on an analysis of the first face detected in the first image and on the face identifier of the first face, each of the facial feature descriptors corresponding to an analyzed physical feature of the first face detected in the first image; and
generating, by the computing device and based on the set of facial feature descriptors, a face signature that uniquely identifies a second face detected in a second image as belonging to the same person.

### Claim 14 (depends on 13)

The at least one computer-readable media of claim 13, the actions further comprising:
generating, by the computing device and based on the set of facial feature descriptors, a quality score of the detected face.

### Claim 15 (depends on 14)

The at least one computer-readable media of claim 14 where the quality score is determined based partially on the location of the first face within the first image.

### Claim 16 (depends on 14)

The at least one computer-readable media of claim 14 where the quality score is based partially on the amount of the first face in the first image.

### Claim 17 (depends on 13)

The at least one computer-readable media of claim 13, the actions further comprising:
generating, by the computing device and based on the set of facial feature descriptors, an expression of the first face.

### Claim 18 (depends on 13)

The at least one computer-readable media of claim 13, the actions further comprising:
generating, by the computing device and based on the set of facial feature descriptors, a pose of the first face.