# US 2016/0350588 A1 · Filter and shutter based on image emotion content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0350588 A1
- Document ID: US20160350588A1
- Status: Published application
- Kind: A1
- Application number: 15/234,763
- Filed: 2016-08-11
- Published: 2016-12-01
- Earliest claimed: 2013-08-02
- Assignees: Emotient, Inc.
- Applicants: Emotient, Inc.
- Inventors: Javier MOVELLAN; Ken DENMAN; Joshua SUSSKIND
- Web page: https://patentgrep.com/patent/US20160350588A1

## CPC

- G06V 40/174: {Facial expression recognition}
- H04N 23/61: based on recognised objects
- H04N 23/611: where the recognised objects include parts of the human body
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A computer-implemented (including method implemented using laptop, desktop, mobile, and wearable devices) method for image filtering. The method includes analyzing each image to generate a content vector for the image; applying an interest operator to the content vector, the interest operator being based on a plurality of pictures with desirable characteristics, thereby obtaining an interest index for the image; comparing the interest index for the image to an interest threshold; and taking one or more actions or abstaining from one or more actions based on a result of the step of comparing. Also, related systems and articles of manufacture.

## Claims

### Claim at position 1

-20. (canceled)

### Claim 21

A method for image filtering, the method comprising:
analyzing, by a computer, a first collection of images using a plurality of classifiers corresponding to one of a plurality of characteristics;
generating, by the computer, a content vector for each image in the first collection of images, wherein the content vector comprises a plurality of values, wherein each value corresponds to a classifier of the plurality of classifiers;
receiving a selection of one or more images in the first collection of images; and
determining desired characteristics of the plurality of characteristics based on the content vectors for each image of the selected one or more images.

### Claim 22 (depends on 21)

The method of claim 21, further comprising:
obtaining an additional image;
generating a content vector for the additional image; and
determining a level of interest of the additional image using the generated content vector for the additional image and the determined desired characteristics.

### Claim 23 (depends on 22)

The method of claim 22, further comprising:
taking one or more actions based on the determined level of interest;
wherein the one or more actions comprises one or more selected from a group consisting of: amending metadata associated with the additional image to indicate the determined level of interest, store the additional image in a particular directory, display the image, and erase the image.

### Claim 24

The method of 21, wherein the selection of the one or more images is received from a first user, wherein the first user is associated with first user characteristics, and wherein the method further comprises:
comparing the first user characteristics to second user characteristics associated with a second user; and
determining desired characteristics of the plurality of characteristics for the second user based on the content vectors for each image of the selected one or more images and the comparison of the first user characteristic and the second user characteristics.

### Claim 25 (depends on 21)

The method of claim 21, wherein the plurality of characteristics are associated with characteristics related to emotional content in the expressions.

### Claim 26 (depends on 21)

The method of claim 21, wherein determining desired characteristics of the plurality of characteristics comprises:
applying an interest operator to the cot vector to obtain an interest index for the image represented by the content vector; and
comparing, by the computer, the interest index for the image to an interest threshold to obtain a result.

### Claim 27 (depends on 21)

The method of claim 21, further comprising:
modifying metadata for the selected one or more images to indicate presence of the desired characteristics.

### Claim 28

A computer readable medium comprising computer readable code which, when executed by one or more processors, causes the one or more processors to:
analyze a first collection of images using a plurality of classifiers corresponding to one of a plurality of characteristics;
generate a content vector for each image in the first collection of images, wherein the content vector comprises a plurality of values, wherein each value corresponds to a classifier of the plurality of classifiers;
receive a selection of one or more images in the first collection of images; and
determine desired characteristics of the plurality of characteristics based on the content vectors for each image of the selected one or more images.

### Claim 29 (depends on 28)

The computer readable medium of claim 28, wherein the computer readable code further causes the one or more processors to:
obtain an additional image;
generate a content vector for the additional image; and
determine a level of interest of the additional image using the generated content vector for the additional image and the determined desired characteristics.

### Claim 30 (depends on 29)

The computer readable medium of claim 29, wherein the computer readable code further causes the one or more processors to:
take one or more actions based on the determined level of interest,
wherein the one or more actions comprises one or more selected from a group consisting of: amending metadata associated with the additional image to indicate the determined level of interest, store the additional image in a particular directory, display the image, and erase the image.

### Claim 31

The computer readable medium of 28, wherein the selection of the one or more images is received from a first user, wherein the first user is associated with first user characteristics, and wherein the computer readable code further causes the one or more processors to:
compare the first user characteristics to second user characteristics associated with a second user; and
determine desired characteristics of the plurality of characteristics for the second user based on the content vectors for each image of the selected one or more images and the comparison of the first user characteristic and the second user characteristics.

### Claim 32

The computer readable medium of 28, wherein the plurality of charactetistics are associated with characteristics related to emotional content in the expressions.

### Claim 33

The computer readable medium of 28, wherein determining desired characteristics of the plurality of characteristics comprises:
applying an interest operator to the content vect r o obtain an interest index for the image represented by the content vector; and
comparing, by the computer, the interest index for the image to an interest threshold to obtain a result.

### Claim 34

The computer readable medium of 28, wherein the rcadoh|ecVdcfbrthcr causes the one or more processors to:
modify metadata for the selected one or more images to indicate presence of the desired charactetistics.

### Claim 35

A system for image filtering, comprising:
one or more processors; and
a memory coupled to the one or more processors and comprising computer readable code which, when executed by the one or more processors, causes the system to:
analyze a first collection of images using a plurality of classifiers corresponding to one of a plurality of characteristics,
generate a content vector for each image in the first collection of images, wherein the content vector comprises a plurality of values, wherein each value corresponds to a classifier of the plurality of classifiers;
receive a selection of one or more images in the first collection of images; and
determine desired characteristics of the plurality of characteristics based on the content vectors for each image of the selected one or more images.

### Claim 36 (depends on 35)

The system of claim 35, wherein the compu ereadable code further causes the system to:
obtain an additional image;
generate a content vector for the additional image; and
determine a level of interest of the additional image using the generated content vector for the additional image and the determined desired characteristics.

### Claim 37 (depends on 36)

The system of claim 36, wherein the compute eadable code further causes system to:
take one or more actions based on the determined level of interest,
wherein the one or more actions comprises one or more selected from a group consisting of: amending metadata associated with the additional image to indicate the determined level of interest, store the additional image in a particular directory, display the image, and erase the image.

### Claim 38 (depends on 35)

The system of claim 35, wherein the selection of the one or more images is received from a first user, wherein the first user is associated with first user characteristics, and wherein the computer readable code further causes the system to:
compare the first user characteristics to second user characteristics associated with a second user; and
determine desired characteristics of the plurality of characteristics for the second user based on the content vectors for each image of the selected one or more images and the comparison of the first user characteristic and the second user characteristics.

### Claim 39 (depends on 35)

The system of claim 35, wherein the plurality of characteristics are associated with characteristics related to emotional content in the expressions.

### Claim 40 (depends on 35)

The system of claim 35, wherein determining desired characteristics of the plura of characteristics comprises:
applying an interest operator to the content vector to obtain an interest index for the image represented by the content vector; and
comparing, by the computer, the interest index for the image to an interest threshold to obtain a result.
