# US 12,118,032 B2 · Electronic device for searching content and control method therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,118,032 B2
- Document ID: US12118032B2
- Status: Granted
- Kind: B2
- Application number: 17/059,000
- Filed: 2019-05-10
- Published: 2021-08-26
- Granted: 2024-10-15
- Earliest claimed: 2018-05-29
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Eun-Ae Cho; Jinhyun Kim; Gihoon Park
- Web page: https://patentgrep.com/patent/US12118032B2

## CPC

- G06F 16/583: using metadata automatically derived from the content
- G06F 16/55: Clustering; Classification
- G06F 16/5854: {using shape and object relationship}
- G06T 11/203
- G06V 10/74: Image or video pattern matching; Proximity measures in feature spaces
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method for controlling an electronic device is disclosed. The method for controlling an electronic device comprises the steps of: receiving a sketch drawn by a user; acquiring at least one machine-generated image on the basis of the sketch by using an artificial intelligence model learned by an artificial intelligence algorithm; displaying the acquired at least one machine-generated image; receiving a user command for selecting one of at least one displayed machine-generated image, and searching for at least one piece of content corresponding to the image selected according to the user command; and providing the searched for at least one piece of content.

## Claims

### Claim 1

A method for controlling an electronic device, the method comprising:
receiving a sketch drawn by a user;
obtaining at least one machine-generated image for each of a plurality of different image categories based on the sketch using an artificial intelligence model for image generating trained by an artificial intelligence algorithm;
simultaneously displaying the at least one obtained machine-generated image for each of the image categories;
receiving a user command for selecting one machine-generated image from the simultaneous display of the at least one displayed machine-generated image for each of the image categories and searching for at least one content corresponding to the selected image among a plurality of contents; and
providing the at least one searched content,
wherein the image categories comprise a nature category, a building category, and a person category.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the searching comprises:
searching for the at least one content corresponding to the selected image from among the plurality of contents stored in the electronic device.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the obtaining comprises:
obtaining the at least one machine-generated image for each of the plurality of different image categories by inputting classification information regarding the plurality of image categories and the sketch to the artificial intelligence model.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the artificial intelligence model is trained by a generative adversarial network (GAN) or a variational auto-encoder (VAE).

### Claim 5 (depends on 1)

The method according to claim 1, wherein the searching comprises:
searching for the at least one content corresponding to the selected image using an artificial intelligence model for content search trained by the artificial intelligence algorithm.

### Claim 6 (depends on 5)

The method according to claim 5, further comprising:
receiving a content selection for selecting from among the at least one provided content; and
retraining the artificial intelligence model for content search based on the selected content.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the receiving the sketch drawn by the user comprises:
receiving a signal corresponding to a movement of a remote controller and obtaining information regarding the sketch based on the received signal.

### Claim 8

An electronic device comprising:
memory storing computer executable instructions;
a display; and
at least one processor, wherein one or more of the at least one processor is configured to execute the computer executable instructions to:
obtain at least one machine-generated image for each of a plurality of different image categories based on a sketch drawn by a user using an artificial intelligence model for image generating trained by an artificial intelligence algorithm,
control the display to simultaneously display the at least one obtained machine-generated image for each of the image categories,
receive a user command for selecting one machine-generated image from the simultaneous display of the at least one displayed machine-generated image for each of the image categories, and search for at least one content corresponding to the selected image among a plurality of contents, and
provide the at least one searched content,
wherein the image categories comprise a nature category, a building category, and a person category.

### Claim 9 (depends on 8)

The device according to claim 8, wherein one or more of the at least one processor is configured to search for the at least one content corresponding to the selected image from among the plurality of contents stored in the electronic device.

### Claim 10 (depends on 9)

The device according to claim 9, wherein one or more of the at least one processor is configured to obtain the at least one machine-generated image for each of the plurality of different image categories by inputting classification information regarding the plurality of image categories and the sketch to the artificial intelligence model.

### Claim 11 (depends on 8)

The device according to claim 8, wherein the artificial intelligence model is trained by a generative adversarial network (GAN) or a variational auto-encoder (VAE).

### Claim 12 (depends on 8)

The device according to claim 8, wherein one or more of the at least one processor is configured to search for the at least one content corresponding to the selected image using an artificial intelligence model for content search trained by the artificial intelligence algorithm.

### Claim 13 (depends on 8)

The device according to claim 8, wherein one or more of the at least one processor is configured to:
receive a content selection for selecting from among the at least one provided content; and
retrain the artificial intelligence model for content search based on the selected content.

### Claim 14 (depends on 8)

The device according to claim 8, wherein one or more of the at least one processor is configured to receive a signal corresponding to a movement of a remote controller and obtain information regarding the sketch based on the received signal.
