# US 2018/0025218 A1 · Classification and organization of consumer digital images using workflow, and face detection and recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0025218 A1
- Document ID: US20180025218A1
- Status: Published application
- Kind: A1
- Application number: 15/721,387
- Filed: 2017-09-29
- Published: 2018-01-25
- Earliest claimed: 2004-01-22
- Assignees: FotoNation Limited
- Applicants: FotoNation Limited
- Inventors: Eran STEINBERG; Peter CORCORAN; Yury PRILUTSKY; Petronel BIGIOI; Mihai CIUC; Stefanita CIUREL; Constantin VERTAN
- Web page: https://patentgrep.com/patent/US20180025218A1

## CPC

- G06V 20/647: {by matching two-dimensional images to three-dimensional objects}
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 18/23: Clustering techniques
- G06V 10/763: {Non-hierarchical techniques, e.g. based on statistics of modelling distributions}
- G06V 40/167: {using comparisons between temporally consecutive images}
- G06V 40/173: {face re-identification, e.g. recognising unknown faces across different face tracks}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Techniques for identifying a person in a target image are described. According to one of the techniques, identifying a person in a target image involves displaying, within a graphical user interface, an image that depicts one or more faces. One or more faces are automatically detected within the image. A user provides input that selects a face of the one or more faces to be a currently-selected face. A set of images are selected from a collection of images, where the set of images includes images that closely match the currently-selected face. Concurrently with display of the currently-selected face, each image in the set of images is displayed. Within the graphical user interface, a control is provided. The control enables a user to select a target image from the set of images. In response to detecting that the user has selected a target image using the control, the currently-selected face is associated with a person to which the target image corresponds.

## Claims

### Claim 1

A method comprising:
displaying, within a graphical user interface, an image that depicts one or more faces;
detecting one or more faces within the image;
receiving user input that selects a face of the one or more faces to be a currently-selected face;
selecting a set of images, from a collection of images, that closely match the currently-selected face,
concurrently with display of the currently-selected face, displaying each image in the set of images;
providing, within the graphical user interface, a control that enables a user to select a target image from the set of images; and
in response to detecting that the user has selected a target image using said control, associating the currently-selected face with a person to which the target image corresponds;
wherein the method is performed by one or more computing devices.

### Claim 2 (depends on 1)

The method of claim 1, wherein the detecting step includes displaying a visual indication of a boundary around the one or more faces.

### Claim 3 (depends on 2)

The method of claim 2, further comprising concurrently displaying an originally-acquired image with the image that depicts one or more faces with a visual indication of a boundary around the one or more faces.

### Claim 4 (depends on 1)

The method of claim 1, wherein each image in the set of images has been associated with a different person.

### Claim 5 (depends on 1)

The method of claim 1, wherein displaying each image in the set of images includes displaying an indication of degree of match between each image and the currently-selected face.

### Claim 6 (depends on 1)

The method of claim 1, wherein displaying each image in the set of images includes displaying each image in an order that reflects a degree of match between each image and the currently-selected face.

### Claim 7 (depends on 1)

The method of claim 1 wherein each image of the set of images comprises a face image, created from an original digitally acquired image including a face by performing the steps of:
identifying a group of pixels that correspond to a face within the original digitally acquired image;
selecting a portion of the original image to include the group of pixels;
automatically generating a new image with values of pixels based on the selected portion.

### Claim 8 (depends on 1)

The method of claim 1, further comprising generating an option to create a new face for identifying a new person based on the currently-selected face.

### Claim 9 (depends on 8)

The method of claim 8, further comprising in response to receiving input that selects the option to create the new face, allowing a user to enter a handle to identify the new person.

### Claim 10 (depends on 1)

The method of claim 1, wherein the selecting step includes selecting set of images of known persons within a database.

### Claim 11

One or more non-transitory computer-readable media storing instructions which, when executed by one or more hardware processors, cause performance of a method comprising:
displaying, within a graphical user interface, an image that depicts one or more faces;
detecting one or more faces within the image;
receiving user input that selects a face of the one or more faces to be a currently-selected face;
selecting a set of images, from a collection of images, that closely match the currently-selected face,
concurrently with display of the currently-selected face, displaying each image in the set of images;
providing, within the graphical user interface, a control that enables a user to select a target image from the set of images; and
in response to detecting that the user has selected a target image using said control, associating the currently-selected face with a person to which the target image corresponds;
wherein the method is performed by one or more computing devices.

### Claim 12 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein the detecting step includes displaying a visual indication of a boundary around the one or more faces.

### Claim 13 (depends on 12)

The one or more non-transitory computer-readable media of claim 12, further comprising concurrently displaying an originally-acquired image with the image that depicts one or more faces with a visual indication of a boundary around the one or more faces.

### Claim 14 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein each image in the set of images has been associated with a different person.

### Claim 15 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein displaying each image in the set of images includes displaying an indication of degree of match between each image and the currently-selected face.

### Claim 16 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein displaying each image in the set of images includes displaying each image in an order that reflects a degree of match between each image and the currently-selected face.

### Claim 17 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein each image of the set of images comprises a face image, created from an original digitally acquired image including a face by performing the steps of:
identifying a group of pixels that correspond to a face within the original digitally acquired image;
selecting a portion of the original image to include the group of pixels;
automatically generating a new image with values of pixels based on the selected portion.

### Claim 18 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, further comprising generating an option to create a new face for identifying a new person based on the currently-selected face.

### Claim 19 (depends on 18)

The one or more non-transitory computer-readable media of claim 18, further comprising in response to receiving input that selects the option to create the new face, allowing a user to enter a handle to identify the new person.

### Claim 20 (depends on 11)

The one or more non-transitory computer-readable media of claim 11, wherein the selecting step includes selecting set of images of known persons within a database.
