# US 2014/0192081 A1 · Method and apparatus for laying out image using image recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0192081 A1
- Document ID: US20140192081A1
- Status: Published application
- Kind: A1
- Application number: 14/132,727
- Filed: 2013-12-18
- Published: 2014-07-10
- Earliest claimed: 2013-01-07
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Hyung-Joo JIN; Jae-Myoung LEE; Chul-Ho JANG
- Web page: https://patentgrep.com/patent/US20140192081A1

## CPC

- G06V 30/416: Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors
- G06T 3/02: Affine transformations (for image registration G06T3/147; for image mosaicing G06T3/4038)
- G06T 3/04: Context-preserving transformations, e.g. by using an importance map (panospheric to cylindrical image transformations G06T3/12)
- H04N 23/611: where the recognised objects include parts of the human body
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of laying out an image using image recognition is provided. The method includes operations of recognizing, from an original image, a subject part of an original image corresponding to at least a partial area of the original image, cropping the subject part, and displaying the subject part in a predetermined area.

## Claims

### Claim 1

A method of laying out an image using image recognition, the method comprising:
recognizing, from an original image, a subject part that corresponds to at least a partial area of the original image;
cropping the subject part of the original image out of the original image; and
displaying the cropped subject part in a predetermined area.

### Claim 2 (depends on 1)

The method of claim 1, further comprising, after the cropping of the subject part of the original image out of the original image:
producing the cropped subject part as a thumbnail for the original image to which the cropped subject part belongs; and
displaying the thumbnail in a predetermined area.

### Claim 3

A method of laying out an image using image recognition, the method comprising:
recognizing, from an original image, a subject part of the original image based on predetermined criteria in response to a predetermined user command while the original image is displayed in a screen; and
determining where to display at least one of the subject part of the original image and text such that the subject part is not obscured by the text, taking into account at least one of a size and a location of the text to be displayed with the original image in the screen.

### Claim 4 (depends on 3)

The method of claim 3, further comprising determining the size of at least one of the subject part of the original image and the text to be displayed such that the subject part is not obscured by the text, taking into account at least one of the size and the location of the text to be displayed with the original image in the screen.

### Claim 5 (depends on 3)

The method of claim 3, wherein the determining of where to display at least one of the subject part of the original image and text comprises:
determining whether the text to be displayed is expected to overlap with the subject part of the original image based on the size and the location of the text to be displayed;
determining whether the entire or partial subject part of the original image is expected to be obscured if the display location of the original image is moved as far as the size of the text to be displayed away from the location of the text to be displayed, if the text to be displayed is expected to overlap with the subject part of the original image;
establishing a virtual area that contains the subject part of the original image and does not contain a location in which to display the text, cropping another area than the virtual area, and moving a display of the original image in the virtual image away from the location in which to display the text; and
displaying the text in an empty area produced by cropping the other area than the virtual area.

### Claim 6 (depends on 5)

The method of claim 5, further comprising, if it is determined that the entire or partial subject part of the original image is not expected to be obscured:
moving a display location where the original image is displayed away from the location in which to display the text; and
displaying the text in an empty space produced by moving the display location where the original image is displayed.

### Claim 7 (depends on 5)

The method of claim 5, further comprising, if it is determined that the text to be displayed is not expected to overlap with the subject part of the original image, displaying the text to be displayed in a predetermined area so that the text overlaps with the original image.

### Claim 8

A method of laying out an image using image recognition, the method comprising:
displaying a list of at least one caller Identification (ID) in a screen when a contact mode is run;
displaying an original image for a caller ID in full screen if the caller ID is selected from among the at least one caller ID in the list;
recognizing, from the original image, a subject part that corresponds to at least a partial area of the original image displayed in full screen based on a predetermined criterion if a predetermined user command is input;
cropping the recognized subject part; and
displaying the cropped subject part in a predetermined area in the screen.

### Claim 9 (depends on 8)

The method of claim 8, wherein the displaying of the original image for the caller ID in full screen comprises:
producing items for the caller ID as respective icons; and
displaying the icons in a predetermined area.

### Claim 10 (depends on 8)

The method of claim 8, wherein the displaying of the cropped subject part in the predetermined area in the screen comprises displaying items for the caller ID in a predetermined area in the screen.

### Claim 11 (depends on 9)

The method of claim 9, wherein the items include at least one of the caller ID's name, phone number, and e-mail address.

### Claim 12 (depends on 8)

The method of claim 8, further comprising, after the recognizing of the subject part of the original image, displaying the original image only to disclose the recognized subject part in a predetermined area in the screen.

### Claim 13 (depends on 12)

The method of claim 12, further comprising, if a touch including drag or flick is made on the original image displayed only to disclose the recognized subject part in a predetermined area in the screen, changing what is disclosed in the original image while the displayed original image is dragged or flicked.

### Claim 14 (depends on 8)

The method of claim 8, wherein the recognizing of the subject part comprises:
recognizing objects contained in the original image except a background of the original image; and
setting up at least one of the objects as the subject part.

### Claim 15 (depends on 14)

The method of claim 14, wherein the recognizing of objects contained in the original image except a background of the original image and setting up at least one of the objects as the subject part comprises:
recognizing respective objects contained in the original image;
establishing a candidate area for the subject part including all of the recognized objects;
determining the subject part by comparing a size of the candidate area with a predetermined reference size; and
changing the size of the candidate area to fit the reference size.

### Claim 16 (depends on 15)

The method of claim 15, wherein the determining of the subject part by comparing a size of the candidate area with a predetermined reference size and the changing of the size of the candidate area to fit the reference size comprises determining the subject part by establishing an area including the candidate area to fit the reference size, if the size of the candidate area is less than the reference size.

### Claim 17 (depends on 15)

The method of claim 15, wherein the determining of the subject part by comparing a size of the candidate area with a predetermined reference size and the changing of the size of the candidate area to fit the reference size comprises:
establishing an area that includes a center of the candidate area to fit the reference size, if the size of the candidate area is greater than the reference size;
detecting an object having a largest recognized area from among the recognized objects, if any of the objects is contained in the area that includes the center of the candidate area;
establishing an area that includes the detected object having the largest recognized area to fit the reference size; and
determining the area to be the subject part.

### Claim 18 (depends on 17)

The method of claim 17, further comprising, if any of the objects is contained in the area that includes the center of the candidate area, determining the area that includes the center of the candidate area to be the subject part.

### Claim 19 (depends on 15)

The method of claim 15, wherein the recognizing of respective objects contained in the original image comprises:
recognizing only a face of a person if one of the objects contained in the original image is the person; and
recognizing only a face of an animal if the objects contained in the original image do not contain any human being but an animal.

### Claim 20 (depends on 8)

The method of claim 8, wherein the recognizing of the subject part comprises establishing the subject part to be an area in a predetermined reference size centered at a center of the original image.

### Claim 21

An apparatus for laying out an image using image recognition, the apparatus comprising:
a display unit for displaying a running screen of an application program and a menu state; and
a controller for controlling layout operations of recognizing a subject part of an original image corresponding to at least a partial area of the original image, for cropping the subject part out of the original image, and for displaying the cropped subject part in a predetermined area.

### Claim 22 (depends on 21)

The apparatus of claim 21, wherein the controller recognizes, from the original image, the subject part of the original image based on predetermined criteria in response to a predetermined user command while the original image is displayed in a screen, and
determines the size of at least one of the subject part of the original image and the text to be displayed such that the subject part is not obscured by the text, taking into account at least one of a size and a location of the text to be displayed with the original image in the screen.

### Claim 23 (depends on 21)

The apparatus of claim 21, wherein the controller displays a list of at least one caller Identification (ID) in a screen when a contact mode is run,
displays an original image for a caller ID in full screen if the caller ID is selected from among the at least one caller ID in the list,
recognizes from the original image a subject part that corresponds to at least a partial area of the original image displayed in full screen based on a predetermined criterion if a predetermined user command is input,
crops the recognized subject part, and
displays the cropped subject part in a predetermined area in the screen.

### Claim 24 (depends on 1)

A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one processor to perform the method of claim 1.
