# US 2021/0241356 A1 · Information processing apparatus, control method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241356 A1
- Document ID: US20210241356A1
- Status: Published application
- Kind: A1
- Application number: 17/052,909
- Filed: 2019-04-22
- Published: 2021-08-05
- Earliest claimed: 2018-05-21
- Assignees: NEC Platforms, Ltd.
- Applicants: NEC Platforms, Ltd.
- Inventors: Reo MASUDA
- Web page: https://patentgrep.com/patent/US20210241356A1

## CPC

- G06Q 30/0635: {replenishment orders; recurring orders}
- G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06N 5/04: Inference or reasoning models
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G07G 1/0063: {with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration}
- G06Q 20/208: {Input by product or record sensing, e.g. weighing or scanner processing}
- G07G 1/01: Details for indicating
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G07G: REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS

## Abstract

A product registration apparatus (10) is an apparatus which is operated for a product registration work of registering a product as a settlement target. A display apparatus (20) is provided in the product registration apparatus (10). A plurality of selection images (30) are displayed on the display apparatus (20). When a selection image (30) is operated, a product corresponding to the selection image (30) is registered as the settlement target. An information processing apparatus (2000) generates, for each customer, information (inference information) indicating a product inferred to be purchased by the customer. The inference information is generated based on a behavior of each of a plurality of customers. The inference information generated for a customer indicates identification information of the customer and identification information of the product inferred to be purchased by the customer in association with each other. The information processing apparatus (2000) uses a plurality of pieces of inference information to control the display of the selection images (30) on the display apparatus (20) used for the product registration work for the customer.

## Claims

### Claim 1

An information processing apparatus comprising:
a generation unit that generates, based on a behavior of each of a plurality of customers, inference information in which identification information of the customer and identification information of a product inferred to be purchased by the customer are associated with each other; and
a display control unit that displays selection information for registering the product as a settlement target on a display apparatus used for a product registration work of registering the product purchased by a target customer as the settlement target, by using a plurality of pieces of the inference information.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1,
wherein for each product indicated in each of the plurality of pieces of inference information, the display control unit computes an evaluation value representing a level of a probability that the product is purchased by the target customer, and controls display of the selection information by using the computed evaluation value.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2,
wherein when the number of pieces of selection information displayed on the display apparatus is assumed as n, the display control unit displays the selection information of each product included in a top n of an order of magnitudes of the evaluation values on the display apparatus.

### Claim 4 (depends on 2)

The information processing apparatus according to claim 2,
wherein the display control unit
acquires layout information indicating a priority for each display position on the display apparatus capable of displaying the selection information, and
displays the selection information of a product having a larger evaluation value at a display position on the display apparatus having a higher priority in the layout information.

### Claim 5 (depends on 2)

The information processing apparatus according to claim 2,
wherein the identification information of the customer indicated by the inference information is a feature value of the customer, and
the display control unit
computes a feature value of the target customer, from a first captured image generated by imaging the target customer when the product registration work is performed for the target customer, and
computes a similarity between the feature value of the customer indicated by the inference information and the feature value of the target customer computed by using the first captured image to determine the evaluation value of each product indicated in the inference information by using the similarity.

### Claim 6 (depends on 5)

The information processing apparatus according to claim 5,
wherein the generation unit, when or before and after a product is taken out from a display place, includes the identification information of the product taken out from the display place in the inference information of the customer included in a second captured image generated by imaging the display place.

### Claim 7 (depends on 6)

The information processing apparatus according to claim 6,
wherein the feature value of the customer includes at least one of a feature of a front side of the customer, a feature of a back side of the customer, and a feature of an object which the customer carries.

### Claim 8 (depends on 2)

The information processing apparatus according to claim 2,
wherein the display control unit
identifies at least a part of products registered in the product registration work, by using a third captured image generated by imaging the product registered in the product registration work for the target customer before the registration, and
computes the evaluation value of the identified product by using a predetermined value.

### Claim 9 (depends on 2)

The information processing apparatus according to claim 2,
wherein a reader is provided at a place or a periphery of the place at which the product registration work is performed for the target customer, the reader being capable of reading identification information of at least one product by using short-range wireless communication, and
the display control unit computes, by using a predetermined value, the evaluation value of the product of which the identification information is read by the reader.

### Claim 10 (depends on 2)

The information processing apparatus according to claim 2,
wherein the display control unit identifies a product which has been already registered in the product registration work for the target customer, corrects the evaluation value of the product, and updates the display of the selection information on the display apparatus by using the corrected evaluation value.

### Claim 11 (depends on 9)

The information processing apparatus according to claim 9,
wherein a communication range of the reader includes a place at which the product registration work is performed for the target customer, and a place at which the product registration work is performed for another customer, and
the display control unit identifies a product registered as a product purchased by the other customer, corrects the evaluation value of the product, and updates the display of the selection information on the display apparatus by using the corrected evaluation value.

### Claim 12

A control method executed by a computer, the method comprising:
generating, based on a behavior of each of a plurality of customers, inference information in which identification information of the customer and identification information of a product inferred to be purchased by the customer are associated with each other; and
displaying selection information for registering the product as a settlement target on a display apparatus used for a product registration work of registering the product purchased by a target customer as the settlement target, by using a plurality of pieces of the inference information.

### Claim 13 (depends on 12)

The control method according to claim 12,
wherein in the displaying, for each product indicated in each of the plurality of pieces of inference information, an evaluation value representing a level of a probability that the product is purchased by the target customer is computed, and display of the selection information is controlled by using the computed evaluation value.

### Claim 14 (depends on 13)

The control method according to claim 13,
wherein when the number of pieces of selection information displayed on the display apparatus is assumed as n, in the displaying, the selection information of each product included in a top n of an order of magnitudes of the evaluation values is displayed on the display apparatus.

### Claim 15 (depends on 13)

The control method according to claim 13,
wherein in the displaying,
layout information indicating a priority for each display position on the display apparatus capable of displaying the selection information is acquired, and
selection information of a product having a larger evaluation value is displayed at a display position on the display apparatus having a higher priority in the layout information.

### Claim 16 (depends on 13)

The control method according to claim 13,
wherein the identification information of the customer indicated by the inference information is a feature value of the customer, and
wherein in the displaying,
a feature value of the target customer is computed, from a first captured image generated by imaging the target customer when the product registration work is performed for the target customer, and
a similarity between the feature value of the customer indicated by the inference information and the feature value of the target customer computed by using the first captured image is computed to determine an evaluation value of each product indicated in the inference information by using the similarity.

### Claim 17 (depends on 16)

The control method according to claim 16,
wherein the identification information of the customer indicated by the inference information is a feature value of the customer, and
in the generating, when or before and after a product is taken out from a display place, the identification information of the product taken out from the display place is included in the inference information of the customer included in a second captured image generated by imaging the display place.

### Claim 18 (depends on 17)

The control method according to claim 17,
wherein the feature value of the customer includes at least one of a feature of a front side of the customer, a feature of a back side of the customer, and a feature of an object which the customer carries.

### Claim 19 (depends on 13)

The control method according to claim 13,
wherein in the displaying,
at least a part of products registered in the product registration work are determined, by using a third captured image generated by imaging the product registered in the product registration work for the target customer before the registration, and
the evaluation value of the determined product is computed by using a predetermined value.

### Claim at position 20

20-22. (canceled)

### Claim 23

A non-transitory computer-readable storage medium storing a program causing a computer to execute a control method comprising:
generating, based on a behavior of each of a plurality of customers, inference information in which identification information of the customer and identification information of a product inferred to be purchased by the customer are associated with each other; and
displaying selection information for registering the product as a settlement target on a display apparatus used for a product registration work of registering the product purchased by a target customer as the settlement target, by using a plurality of pieces of the inference information.
