# US 2017/0286452 A1 · Representative image selection for image management using face recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0286452 A1
- Document ID: US20170286452A1
- Status: Published application
- Kind: A1
- Application number: 15/086,642
- Filed: 2016-03-31
- Published: 2017-10-05
- Earliest claimed: 2016-03-31
- Assignees: Adobe Systems Incorporated
- Applicants: Adobe Systems Incorporated
- Inventors: Angad Kumar Gupta; Alok Kumar Singh; Ram Prasad Purumala
- Web page: https://patentgrep.com/patent/US20170286452A1

## CPC

- G06F 16/58: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F 16/51: Indexing; Data structures therefor; Storage structures
- G06F 16/583: using metadata automatically derived from the content
- G06F 16/5838: {using colour}
- G06F 18/28: Determining representative reference patterns, e.g. by averaging or distorting; Generating dictionaries
- G06T 7/33: using feature-based methods
- G06V 10/772: Determining representative reference patterns, e.g. averaging or distorting patterns; Generating dictionaries
- G06V 10/993: {Evaluation of the quality of the acquired pattern}
- G06V 40/172: {Classification, e.g. identification}
- G06T 2207/30168: Image quality inspection
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A technique for selecting a representative image from a group of digital images includes extracting data representing an image of a face of a person from each image in the group using a face recognition algorithm, determining a score for each image based on one or more quality parameters that are satisfied for the respective image, and selecting the image having the highest score as the representative image for the group. The quality parameters may be based on any quantifiable characteristics of the data. Each of these quality parameters may be uniquely weighted, so as to define the relative importance of one parameter with respect to another. The score for determining the representative image of the group may be obtained by adding together the weights corresponding to each quality parameter that is satisfied for a given image. Once selected, the representative image may be displayed in a graphical user interface.

## Claims

### Claim 1

A computer-implemented method for selecting a representative image from a group of digital images of a same person, the method comprising:
extracting, by a computing device and using a face recognition algorithm, data representing an image of a face of the person from each image in the group;
determining, by the computing device and using the data, a score for each image in the group based on one or more quality parameters that are satisfied for the respective image; and
selecting, by the computing device, an image in the group having the highest score as the representative image for the group.

### Claim 2 (depends on 1)

The method of claim 1, further comprising displaying the representative image in a graphical user interface of a display device, wherein the graphical user interface is configured to provide user access to the images in the group.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
adding, by the computing device, an image to the group;
extracting, by the computing device and using a face recognition algorithm, data representing an image of a face of the person from the newly added image;
determining, by the computing device and using the data, a score for the newly added image based on the one or more quality parameters that are satisfied for the newly added image; and
selecting, by the computing device and subsequent to adding the image to the group, an image in the group having the highest score as a new representative image for the group.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
removing, from the group and by the computing device, the image in the group having the highest score; and
selecting, by the computing device and subsequent to removing the image from the group, an image in the group having the highest score as a new representative image for the group.

### Claim 5 (depends on 1)

The method of claim 1, wherein the score for each image in the group is determined by adding together weights associated with each of the quality parameters that are satisfied for the respective image.

### Claim 6 (depends on 5)

The method of claim 5, wherein each of the weights is a unique number in a sequence of numbers.

### Claim 7 (depends on 6)

The method of claim 6, wherein the sequence includes 2, 4, 8, 16, 32, 64, 128 and 256.

### Claim 8 (depends on 1)

The method of claim 1, wherein the quality parameters include at least one of:
image exposure is good;
color/gray scale profile;
eyes of subject are open;
mouth of the person is closed;
the person is not wearing eyeglasses;
the person is not wearing a hat;
the person is facing a camera;
the entire face of the person is visible;
focus of the image is good;
sharpness of facial features is good;
image resolution is high;
age of the image is low; and
only one face appears in the image.

### Claim 9 (depends on 1)

The method of claim 1, wherein the face of the person appears in every image in the group.

### Claim 10

A system for selecting a representative image from a group of digital images of the same person, the system comprising:
a storage; and
a computer processor operatively coupled to the storage, the computer processor configured to execute instructions stored in the storage to perform a process and further configured to:
extract, using a face recognition algorithm, data representing an image of a face of the person from each image in the group;
determine, using the data, a score for each image in the group based on one or more quality parameters that are satisfied for the respective image; and
select an image in the group having the highest score as the representative image for the group.

### Claim 11 (depends on 10)

The system of claim 10, further comprising a display device operatively coupled to the computer processor and configured to display the representative image in a graphical user interface, wherein the graphical user interface is configured to provide user access to the images in the group.

### Claim 12 (depends on 10)

The system of claim 10, wherein the computer processor is further configured to:
add an image of the person to the group;
extract, using a face recognition algorithm, data representing an image of a face of the person from the newly added image;
determine, using the data, a score for the newly added image based on the one or more quality parameters that are satisfied for the newly added image; and
select, subsequent to adding the image to the group, an image in the group having the highest score as a new representative image for the group.

### Claim 13 (depends on 10)

The system of claim 10, wherein the computer processor is further configured to:
remove, from the group, the image in the group having the highest score; and
select, subsequent to removing the image from the group, an image in the group having the highest score as a new representative image for the group.

### Claim 14 (depends on 10)

The system of claim 10, wherein the score for each image in the group is determined by adding together weights associated with each of the quality parameters that are satisfied for the respective image.

### Claim 15 (depends on 14)

The system of claim 14, wherein each of the weights is a unique number in a sequence of numbers.

### Claim 16 (depends on 15)

The system of claim 15, wherein the sequence includes 2, 4, 8, 16, 32, 64, 128 and 256.

### Claim 17 (depends on 10)

The system of claim 10, wherein the quality parameters include at least one of:
image exposure is good;
color/gray scale profile;
eyes of subject are open;
mouth of the person is closed;
the person is not wearing eyeglasses;
the person is not wearing a hat;
the person is facing a camera;
the entire face of the person is visible;
focus of the image is good;
sharpness of facial features is good;
image resolution is high;
age of the image is low; and
only one face appears in the image.

### Claim 18

A non-transitory computer program product having instructions encoded thereon that when executed by one or more computer processors cause the one or more computer processors to perform a process comprising:
extracting, using a face recognition algorithm, data representing an image of a face of a person from each image in the group;
determining, using the data, a score for each image in the group based on one or more quality parameters that are satisfied for the respective image; and
selecting an image in the group having the highest score as the representative image for the group.

### Claim 19 (depends on 18)

The non-transitory computer program product of claim 18, wherein the process further comprises displaying the representative image in a graphical user interface of a display device, wherein the graphical user interface is configured to provide user access to the images in the group.

### Claim 20 (depends on 18)

The non-transitory computer program product of claim 18, wherein the score for each image in the group is determined by adding together weights associated with each of the quality parameters that are satisfied for the respective image.
