# US 2020/0401616 A1 · Image search device, image search method, electronic device and control method therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401616 A1
- Document ID: US20200401616A1
- Status: Published application
- Kind: A1
- Application number: 16/970,977
- Filed: 2019-01-23
- Published: 2020-12-24
- Earliest claimed: 2018-03-09
- Assignees: OMRON Corporation
- Applicants: OMRON Corporation
- Inventors: Ayana TSUJI; Kiyoaki TANAKA; Takahiro TAKAYAMA; Lizhou ZHANG
- Web page: https://patentgrep.com/patent/US20200401616A1

## CPC

- G06F 16/532: Query formulation, e.g. graphical querying
- G06F 16/535: Filtering based on additional data, e.g. user or group profiles
- G06F 16/538: Presentation of query results
- G06F 16/583: using metadata automatically derived from the content
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An image search device receives an image search request from a user, selects from a plurality of images a first group of images that match search conditions based on the search request, selects from the first group of images a second group of images based on a score calculated by a predetermined evaluation formula, and outputs information about the second group of images as a search result. The disclosed and recited embodiments may increase the score for an image in the first group of images to the extent of positive engagement by many people on the predetermined internet service and increase the score to the extent that the image is less similar to other images in the first group of images.

## Claims

### Claim 1

An image search device comprising a processor configured with a program to perform operations comprising:
operation as a search request receiving unit for receiving an image search request;
operation as a first selection unit for selecting from a plurality of images a first group of images that matches a search condition that is based on the search request;
operation as a second selection unit for selecting from the first group of images a second group of images on the basis of a score calculated by a predetermined evaluation formula; and
operation as a result output unit for outputting information about the second group of images as a search result; wherein
each of the plurality of images comprises an image capable of being subjected to evaluative engagement through a predetermined internet service; and
the predetermined evaluation formula is configured to increase the score for an image in the first group of images to the extent of positive engagement through the predetermined internet service and to increase the score to the extent that the image is less similar to other images in the first group of images.

### Claim 2 (depends on 1)

The image search device according to claim 1, wherein:
the processor is configured with the program to perform operations further comprising:
operation as a selection information receiving unit for receiving information of a selected image in response to the user selecting the image from the second group of images; and
operation as a third selection unit for selecting from the first group of images a third group of images similar to the selected image; and
the result output unit outputs information about the third group of images as a second search result.

### Claim 3 (depends on 1)

The image search device according to claim 1, further comprising a database that pre-categorizes and stores the plurality of images or the locator information thereof; wherein:
the search condition includes information indicating the category; and
operation as the first selection unit comprises selecting from the database a group of images belonging to a category that matches the search condition as the first group of images.

### Claim 4 (depends on 3)

The image search device according to claim 3, wherein
the database pre-ranks, per category, groups of images belonging to the category on the basis of the scores, and
operation as the second selection unit comprises selecting a predetermined number of top-ranked images from the first group of images as the second group of images.

### Claim 5 (depends on 1)

The image search device according to claim 1, wherein
the search request comprises an input image, and
operation as the search request receiving unit comprises recognizing an element in the input image and determines the search condition on the basis of the element recognized.

### Claim 6 (depends on 1)

The image search device according to claim 1, wherein
the search request contains location information, and
operation as the search request receiving unit comprises determining the search condition on the basis of the location information.

### Claim 7 (depends on 1)

An electronic device connected via a network to an image search device according to claim 1, the electronic device comprising a processor configured with a program to perform operations comprising:
operation as a transmitting unit for sending an image search request to the image search device;
operation as a receiving unit for receiving a search result for the search request from the image search device; and
operation as a display control unit for displaying the second group of images on a display device on the basis of the search result received.

### Claim 8 (depends on 2)

An electronic device connected via a network to an image search device according to claim 2, the electronic device comprising a processor configured with a program to perform operations comprising:
operation as a transmitting unit for sending an image search request to the image search device;
operation as a receiving unit for receiving a search result for the search request from the image search device;
operation as a display control unit for displaying the second group of images on a display device on the basis of the search result received; and
operation as a selection instruction receiving unit for receiving a selection instruction from the user to select one image from the second group of images; wherein
when the selection instruction receiving unit receives a selection instruction, the processor is configured with the program to perform operations such that operation as:
the transmitting unit-comprises sending information about the selected image to the image search device; the receiving unit comprises receiving the second search result from the image search device, and the display control unit comprises displaying the third group of images similar to the selected image on a display device on the basis of the second search result received.

### Claim 9 (depends on 5)

An electronic device connected via a network to an image search device according to claim 5, the electronic device comprising a processor configured with a program to perform operations comprising:
operation as an imaging unit;
operation as a transmitting unit for sending a search request containing an image taken by the imaging unit as the input image to the image search device;
operation as a receiving unit for receiving a search result for the search request from the image search device; and
operation as a display control unit for displaying the second group of images on a display device on the basis of the search result received.

### Claim 10 (depends on 9)

The electronic device according to claim 9; wherein the processor is configured with the program to perform operations such that:
the transmitting unit comprises sending a preview image taken by the imaging unit to the image search device as the input image; and
the display control unit comprises displaying the second group of images on the display device along the preview image.

### Claim 11 (depends on 9)

The electronic device according to claim 9, wherein the processor is configured with the program to perform operations further comprising operation as a processing unit for processing an image taken by the imaging unit while or after the second group of images is displayed to lower the similarity thereof with the second group of images.

### Claim 12 (depends on 6)

An electronic device connected via a network to an image search device according to claim 6, the electronic device comprising a processor configured with a program to perform operations comprising:
operation as a position detection unit;
operation as a transmitting unit for sending a search request containing current location information detected by the position detection unit as the location information to the image search device;
operation as a receiving unit for receiving a search result for the search request from the image search device; and
operation as a display control unit for displaying the second group of images on a display device on the basis of the search result received.

### Claim 13

An image search method comprising:
receiving an image search request from a user;
selecting from a plurality of images a first group of images that matches a search condition that is based on the search request;
selecting a second group of images from the first group of images on the basis of a score calculated by a predetermined evaluation formula; and
outputting information about the second group of images as a search result; wherein
each of the plurality of images comprises an image capable of being subjected to evaluative engagement through a predetermined internet service, and
the predetermined evaluation formula is configured to increase the score for an image in the first group of images to the extent of positive engagement through the predetermined internet service and to increase the score to the extent that the image is less similar to other images in the first group of images.

### Claim 14 (depends on 13)

A non-transitory computer readable storage medium storing a program for causing a computer to execute the image search method according to claim 13.

### Claim 15 (depends on 1)

A control method for an electronic device connected via a network to the image search device according to claim 1, the control method comprising:
sending an image search request to the image search device;
receiving a search result for the search request from the image search device; and
displaying the second group of images on the basis of the search result received.

### Claim 16 (depends on 2)

A control method for an electronic device connected via a network to an image search device according to claim 2, the control method comprising:
sending an image search request to the image search device;
receiving a search result for the search request from the image search device;
displaying the second group of images on the basis of the search result received;
receiving a selection instruction from the user to select one image from the second group of images;
sending information about the selected image to the image search device when said selection instruction is received;
receiving the second search result from the image search device; and
displaying the third group of images similar to the selected image on the basis of the second search result received.

### Claim 17 (depends on 5)

A control method for an electronic device connected via a network to an image search device according to claim 5, the control method comprising:
taking an image;
sending a search request containing the image taken as an input image to the image search device;
receiving a search result for the search request from the image search device; and
displaying the second group of images on the basis of the search result received.

### Claim 18 (depends on 6)

A control method for an electronic device connected via a network to an image search device according to claim 6, the control method comprising:
detecting current location information;
sending a search request containing the current location information detected as the location information to the image search device;
receiving a search result for the search request from the image search device; and
displaying the second group of images one the basis of the search result received.

### Claim 19 (depends on 15)

A non-transitory computer readable storage medium storing a program for causing a computer to execute a control method for an electronic device according to claim 15.
