# US 2015/0104082 A1 · Image processing apparatus and control method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0104082 A1
- Document ID: US20150104082A1
- Status: Published application
- Kind: A1
- Application number: 14/321,037
- Filed: 2014-07-01
- Published: 2015-04-16
- Earliest claimed: 2013-10-15
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Sang-yoon KIM; Ki-jun JEONG; Eun-heui JO
- Web page: https://patentgrep.com/patent/US20150104082A1

## CPC

- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- G06V 10/993: {Evaluation of the quality of the acquired pattern}
- G06V 40/16: Human faces, e.g. facial parts, sketches or expressions
- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An image processing apparatus includes: a processor configured to process an image photographed by the camera and determine a user face within the image; and a controller configured to control the processor to determine whether same user faces appear in a plurality of video frames by tracing one or more user faces within the respective video frames included in the image.

## Claims

### Claim 1

An image processing apparatus comprising:
a processor configured to process an image photographed by a camera and determine a user face within the image; and
a controller configured to control the processor to determine whether same user faces appear in a plurality of video frames by tracing one or more user faces within the respective video frames included in the image.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, further comprising a storage configured to store at least one profile of a preset face,
wherein the controller extracts a feature vector of a user face from the video frame, determines similarity by comparing a first feature vector of the user face with a second feature vector of the at least one profile stored in the storage, and
performs analysis of the user face based on a determined history of similarities with regard to the respective video frame.

### Claim 3 (depends on 2)

The image processing apparatus according to claim 2, wherein the controller determines that the user face corresponds to the at least one profile if a number of user faces being determined as corresponding to the at least one profile is higher than a preset value.

### Claim 4 (depends on 3)

The image processing apparatus according to claim 3, wherein the controller updates the at least one profile with the first feature vector if it is determined that the user face corresponds to the at least one profile.

### Claim 5 (depends on 2)

The image processing apparatus according to claim 2, wherein the controller determines that the user face does not correspond to a previously stored profile and is new if a number of user faces being determined as corresponding to the at least one profile is lower than a preset value.

### Claim 6 (depends on 5)

The image processing apparatus according to claim 5, wherein the controller stores the first feature vector and registers a new profile with the first feature vector if it is determined that a user face is new.

### Claim 7 (depends on 2)

The image processing apparatus according to claim 2, wherein the controller determines that the user face corresponds to the at least one profile if similarity between the first feature vector and the second feature vector is higher than a preset level.

### Claim 8 (depends on 2)

The image processing apparatus according to claim 2, wherein the controller determines reliability about recognition of respective facial structures, and extracts the feature vector of the user face if the reliability is equal to or higher than a preset level.

### Claim 9 (depends on 1)

The image processing apparatus according to claim 1, wherein the controller, based on data of video frame regions respectively forming faces detected within one video frame, traces the same user face in subsequent video frames.

### Claim 10

A method of controlling an image processing apparatus, the method comprising:
receiving an image; and
determining whether same user faces appear in a plurality of video frames by tracing one or more user faces within the respective video frames included in the image.

### Claim 11 (depends on 10)

The method according to claim 10, wherein the determining whether the same user faces appear comprises:
extracting a feature vector of a user face from the video frame;
determining similarity by comparing a first feature vector of the user face with a second feature vector of at least one profile of a preset face, and
performing analysis of the user face based on a determined history of similarities with regard to the respective video frame.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the performing analysis of the user face comprises:
determining that the user face corresponds to the at least one profile if a number of user faces being determined as corresponding to the profile is higher than a preset value.

### Claim 13 (depends on 12)

The method according to claim 12, wherein the performing the analysis of the user face comprises:
updating the at least one profile with the first feature vector if it is determined that the user face corresponds to the at least one profile.

### Claim 14 (depends on 11)

The method according to claim 11, wherein the performing the analysis comprises:
determining that the user face does not correspond to the previously stored profile and is new if a number of user faces being determined as corresponding to the at least one profile, is lower than a preset value.

### Claim 15 (depends on 14)

The method according to claim 14, wherein the performing the analysis of the user face comprises:
registering a new profile with the first feature vector if it is determined that user face is new.

### Claim 16 (depends on 11)

The method according to claim 11, wherein the determining the similarity comprises:
determining that the user face corresponds to the at least one profile if similarity between the first feature vector and the second feature vector is higher than a preset level.

### Claim 17 (depends on 11)

The method according to claim 11, wherein the extracting the feature vector of the user face comprises:
determining reliability of recognition of respective facial structures with regard to the user face detected in the video frame, and extracting the feature vector of the user face if the reliability is equal to or higher than a preset level.

### Claim 18 (depends on 10)

The method according to claim 10, wherein the determining whether the same user faces appear in the respective video frames comprises:
tracing the same user face in subsequent video frames, based on data of video frame regions respectively forming faces detected within one video frame.

### Claim 19 (depends on 1)

The image processing apparatus according to claim 1, further comprising the camera.

### Claim 20 (depends on 10)

The method according to claim 10, wherein the image is photographed by a camera of the image processing apparatus.
