# US 2021/0174540 A1 · Image recognition apparatus using an object image data, image recognition method using an object image data, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174540 A1
- Document ID: US20210174540A1
- Status: Published application
- Kind: A1
- Application number: 16/768,724
- Filed: 2018-11-29
- Published: 2021-06-10
- Earliest claimed: 2017-12-01
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Kota IWAMOTO; Soma SHIRAISHI; Hideo YOKOI; Tsugunori TAKATA
- Web page: https://patentgrep.com/patent/US20210174540A1

## CPC

- G06T 7/73: using feature-based methods
- G06T 7/74: {involving reference images or patches}
- G06V 10/10: Image acquisition (document image scanning and transmission H04N1/00; control of digital cameras H04N23/60)
- G07G 1/0063: {with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration}
- G09G 5/38: with means for controlling the display position
- G06F 3/147: using display panels
- G06Q 20/201: {Price look-up processing, e.g. updating}
- G06Q 20/208: {Input by product or record sensing, e.g. weighing or scanner processing}
- G06T 2207/30204: Marker
- G09G 2340/0464: Positioning
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G07G: REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

According to the some non-limiting embodiments, there is provided an information processing apparatus including a display control unit 13 that causes a display provided on a surface on which an object is placed, to display a first image including a predetermined display element, and a conversion rule generation unit 15 that acquires a second image generated by an imaging apparatus having an imaging range including the display and generates a conversion rule for converting coordinates in the image of the imaging apparatus into coordinates in the display, by using a detection result of the display element in the second image.

## Claims

### Claim 1

An information processing apparatus comprising:
a display including a display surface on which information is displayed, wherein a product is placed on the display surface;
at least one memory configured to store instructions; and
at least one processor configured to execute the instructions to:
display a first image including a predetermined display element;
acquires acquire a second image captured by a camera, the second image including the display;
generate a coordinate conversion rule for converting coordinates in a third image into coordinates in the display by using a detection result of the display element in the second image;
determine a placement position of the product on the display based on the coordinate conversion; and
display information indicating the placement position.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1,
wherein the at least one processor is further configured to:
acquire a position of the display element in the first image and a position of the display element in the second image, and
generate the coordinate conversion rule based on a correspondence relation between the position of the display element in the first image and the position of the display element in the second image.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2,
wherein the display element includes a shape different from repetition of a specific pattern.

### Claim 4 (depends on 2)

The information processing apparatus according to claim 2,
wherein the display element is a lattice-like pattern.

### Claim 5 (depends on 2)

The information processing apparatus according to claim 2,
wherein the display element includes a plurality of marks indicating positions of a plurality of vertexes of an area to which the coordinate conversion rule is applied on the display, respectively.

### Claim 6 (depends on 1)

The information processing apparatus according to claim 1,
wherein
display the display element to be displayed in at least a portion of the area to which the coordinate conversion rule is applied on the display.

### Claim 7 (depends on 6)

The information processing apparatus according to claim 6,
wherein the area to which the coordinate conversion rule is applied on the display is a portion of the display.

### Claim 8

A display position adjustment method comprising:
displaying a first image including a predetermined display element;
acquiring a second image captured by a camera, the second image including the display;
generating a coordinate conversion rule for converting coordinates in a third image into coordinates in the display by using a detection result of the display element in the second image;
determining a placement position of a product placed on the display based on the coordinate conversion; and
displaying information indicating the placement position.

### Claim 9 (depends on 8)

The display position adjustment method executed by a computer according to claim 8, the method further comprising:
acquiring a position of the display element in the first image and a position of the display element in the second image; and
generating the coordinate conversion rule based on a correspondence relation between the position of the display element in the first image and the position of the display element in the second image.

### Claim 10 (depends on 9)

The display position adjustment method according to claim 9,
wherein the display element includes a shape different from repetition of a specific pattern.

### Claim 11 (depends on 9)

The display position adjustment method according to claim 9,
wherein the display element is a lattice-like pattern.

### Claim 12 (depends on 9)

The display position adjustment method according to claim 9,
wherein the display element is a plurality of marks indicating positions of a plurality of vertexes of an area to which the coordinate conversion rule is applied on the display, respectively.

### Claim 13 (depends on 8)

The display position adjustment method executed by a computer according to claim 8, the method further comprising:
causing the first image comprising the display element to be displayed in at least a portion of the area to which the coordinate conversion rule is applied on the display.

### Claim 14 (depends on 13)

The display position adjustment method according to claim 13,
wherein the area to which the coordinate conversion rule is applied on the display is a portion of the display.

### Claim 15

A non-transitory computer-readable storage medium storing a instructions to cause a computer to execute operations comprising:
displaying a first image including a predetermined display element;
acquiring a second image captured by a camera, the second image including the display;
generating a coordinate conversion rule for converting coordinates in a third image into coordinates in the display by using a detection result of the display element in the second image;
determining a placement position of a product placed on the display based on the coordinate conversion; and
displaying information indicating the placement position.

### Claim 16 (depends on 1)

The information processing apparatus according to claim 1,
wherein the at least one processor further configured to:
identify the product based on the second image.

### Claim 17 (depends on 1)

The information processing apparatus according to claim 1,
wherein the at least one processor further configured to:
display the predetermined display element on a vertex of the first image.
