# US 10,311,613 B2 · Electronic device for processing image and method for controlling thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,311,613 B2
- Document ID: US10311613B2
- Status: Granted
- Kind: B2
- Application number: 15/240,547
- Filed: 2016-08-18
- Published: 2017-03-23
- Granted: 2019-06-04
- Earliest claimed: 2015-09-23
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Dong-Il Son; Chi-Hyun Cho; Chang-Ryong Heo
- Web page: https://patentgrep.com/patent/US10311613B2

## CPC

- G06V 20/70: Labelling scene content, e.g. deriving syntactic or semantic representations
- G06T 11/60: Creating or editing images; Combining images with text
- G06V 20/20: in augmented reality scenes
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- H04N 21/00: Selective content distribution, e.g. interactive television or video on demand [VOD] (real-time bi-directional transmission of motion video data H04N7/14 {; broadcast or conference over packet switching networks H04L12/18})
- H04N 21/2743: Video hosting of uploaded data from client
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An electronic device is provided. The electronic device includes a processor and a memory electrically connected with the processor, wherein the memory may store instructions executed to enable the processor to obtain an image and output a message generated based on additional information and an image analysis result obtained by analyzing the obtained image.

## Claims

### Claim 1

An electronic device comprising:
at least one processor; and
a memory storing instructions which, when executed by the at least one processor, causes the electronic device to:
obtain an image,
identify at least one person of the obtained image by analyzing at least one face object in the obtained image,
identify at least one recipient of the obtained image,
identify a relationship between the identified at least one person and the identified at least one recipient, the relationship comprising at least one of a family relationship or a friend relationship,
generate a message associated with the obtained image based on the identified relationship, and
output the message.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the identified relationship includes information independent from the analysis of the obtained image.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein the identified relationship includes at least one of a relationship between a sender of the obtained image and a recipient of the obtained image, a relationship between the sender of the obtained image and the subject, or a relationship between the recipient of the obtained image and the subject.

### Claim 4 (depends on 2)

The electronic device of claim 2, wherein the identified relationship includes information from a first application that is different from a second application outputting the message.

### Claim 5 (depends on 4)

The electronic device of claim 4, wherein the instructions further causes the electronic device to:
identify metadata of the obtained image, and
obtain the information from the second application based on the metadata.

### Claim 6 (depends on 1)

The electronic device of claim 1,
wherein the identified relationship includes information related to at least a portion of the analysis, and
wherein the message is generated based on additional information.

### Claim 7 (depends on 6)

The electronic device of claim 6, wherein the instructions further causes the electronic device to:
obtain a result of identifying a first object of the obtained image,
wherein the additional information corresponds to the result of the identifying of the first object.

### Claim 8 (depends on 7)

The electronic device of claim 7, wherein the instructions further causes the electronic device to:
identify a shape of the first object, and
compare an object template with the shape of the first object,
wherein, when a similarity of the object template is equal to or greater than a predetermined threshold value, the additional information corresponds to object-related information of the shape of the first object.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the instructions further causes the electronic device to:
obtain a different image from the obtained image,
identify the object template from the different image,
store the object template, and
store information related to the object template as the object-related information.

### Claim 10 (depends on 1)

The electronic device of claim 1, further comprising a camera configured to capture an image of the user,
wherein the instructions further causes the electronic device to identify the user based on data from the camera, and
wherein the message is further generated based on additional information corresponding to a result of the identifying of the user.

### Claim 11

A method for controlling an electronic device, the method comprising:
obtaining an image;
identifying at least one person of the obtained image by analyzing at least one face object in the obtained image;
identifying at least one recipient of the obtained image;
identifying a relationship between the identified at least one person and the identified at least one recipient, the identified relationship comprising at least one of a family relationship or a friend relationship;
generating a message associated with the obtained image based on the identified relationship; and
outputting the message.

### Claim 12 (depends on 11)

The method of claim 11, wherein the identified relationship includes information independent from the analysis of the obtained image.

### Claim 13 (depends on 12)

The method of claim 12, wherein the identified relationship includes at least one of a relationship between a sender of the obtained image and a recipient of the obtained image, a relationship between the sender of the obtained image and the subject, or a relationship between the recipient of the obtained image and the subject.

### Claim 14 (depends on 12)

The method of claim 12, wherein the identified relationship includes information from a first application that is different from a second application outputting the message.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
identifying metadata of the obtained image; and
obtaining information from the second application based on the metadata.

### Claim 16 (depends on 11)

The method of claim 11,
wherein the identified relationship includes information related to at least a portion of the analysis, and
wherein the message is generated based on additional information.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
obtaining a result of identifying a first object of the obtained image,
wherein the additional information corresponds to the result of the identifying of the first object.

### Claim 18 (depends on 17)

The method of claim 17, further comprising:
identifying a shape of the first object; and
comparing an object template with the shape of the first object,
wherein, when a similarity of the object template is equal to or greater than a predetermined threshold value, the additional information corresponds to object-related information of the shape of the first object.