# US 2021/0343201 A1 · Signage control system and non-transitory computer-readable recording medium for recording signage control program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0343201 A1
- Document ID: US20210343201A1
- Status: Published application
- Kind: A1
- Application number: 17/245,485
- Filed: 2021-04-30
- Published: 2021-11-04
- Earliest claimed: 2020-05-01
- Assignees: AWL, Inc.
- Applicants: AWL, Inc.
- Inventors: Yasuhiro TSUCHIDA
- Web page: https://patentgrep.com/patent/US20210343201A1

## CPC

- G06Q 30/0246: {Traffic}
- G06Q 30/0269: {based on user profile or attribute}
- G06V 10/764: using classification, e.g. of video objects
- G06V 20/53: {Recognition of crowd images, e.g. recognition of crowd congestion}
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- G06V 40/161: {Detection; Localisation; Normalisation}
- G06V 40/176: {Dynamic expression}
- G09F 19/00: Advertising or display means not otherwise provided for
- G09F 27/005: {Signs associated with a sensor}
- G06V 40/178: {estimating age from face image; using age information for improving recognition}
- G09F 2027/001: {Comprising a presence or proximity detector}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09F: DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS

## Abstract

A signage control system comprises: a primary estimation circuitry to use signage-side images and surveillance-side images to estimate a person feature, attributes and behavior of each person captured in these frame images; a storage device to associate and store results of estimations of the person feature, the attributes and the behavior of each specific person; an estimation result linkage circuitry to use the person feature stored in the storage device to link the results of estimations based on the frame images from multiple ones of the cameras for the same person so as to generate a group of estimation results for each person; and a content change circuitry to change a content displayed on the signage to another based on the attributes of each person expected to be in a position where such person can visually recognize the content on the signage, and based on preceding behavior of such person.

## Claims

### Claim 1

A signage control system comprising a signage, a signage-side camera to capture images in front of the signage and at least one surveillance camera to capture a given capture area, wherein the signage control system further comprises:
a primary estimation circuitry configured to use signage-side images which are frame images from the signage-side camera and surveillance-side images which are frame images from the at least one surveillance camera so as to estimate a person feature of each person in these frame images, and also estimate attributes and behavior of the each person captured in these frame images;
a storage device configured to associate and store results of estimations of the person feature, the attributes and the behavior of each specific person as estimated by the primary estimation circuitry using the frame images from each specific one of the signage-side cameras and the at least one surveillance camera;
an estimation result linkage circuitry configured to use the person feature stored in the storage device to link the results of estimations based on the frame images from multiple ones of the cameras for the same person so as to generate a group of estimation results for each person; and
a content change circuitry configured to change a content displayed on the signage to another based on the attributes of each person who is expected to be in a position where such person can visually recognize the content on the signage, and also based on preceding behavior of such person before then, the attributes and the preceding behavior being contained in the group of estimation results generated by the estimation result linkage circuitry.

### Claim 2 (depends on 1)

The signage control system according to claim 1, further comprising an arrival time estimation circuitry configured to estimate arrival time of each person captured in the frame images captured by the at least one surveillance camera at which such person is expected to arrive at the position where such person can visually recognize the content on signage,
wherein for each person who is expected to arrive at the position where such person can visually recognize the content on the signage as a result of the estimation using the arrival time estimation circuitry, the content change circuitry operates so that, at a time point based on estimated arrival time of such person at which such person is expected to arrive at the position where such person can visually recognize the content on the signage as estimated by the arrival time estimation circuitry, the content change circuitry changes the content displayed on the signage to another based on the attributes and the preceding behavior of such person which are contained in the group of estimation results generated by the estimation result linkage circuitry.

### Claim 3 (depends on 2)

The signage control system according to claim 2,
wherein based on the person feature stored in the storage device for each person who is expected to arrive at the position where such person can visually recognize the content as a result of the estimation using the arrival time estimation circuitry, the estimation result linkage circuitry links the estimation results based on the frame images from the multiple ones of the cameras for the same person so as to generate the group of estimation results for each person.

### Claim 4 (depends on 2)

The signage control system according to claim 2,
wherein from a motion vector of each person captured in the surveillance-side images, and from the time point at which such person appears in the surveillance-side images, the arrival time estimation circuitry estimates the arrival time of such person at which such person is expected to arrive at the position where such person can visually recognize the content on the signage.

### Claim 5 (depends on 2)

The signage control system according to claim 2,
wherein if the number of persons, at a specific time, who are expected to be in the position where such persons can visually recognize the content on the signage is determined to be plural as a result of the estimation using the arrival time estimation circuitry, the content change circuitry displays, on the signage, a content matching a common attribute for these plural persons in the attributes estimated by the primary estimation circuitry for these plural persons.

### Claim 6 (depends on 5)

The signage control system according to claim 5,
wherein the content change circuitry displays a predetermined standard content on the signage if the number of persons, at a specific time point, who are expected to be in the position where such persons can visually recognize the content on the signage is determined to be plural as a result of the estimation using the arrival time estimation circuitry, and if a common attribute for these plural persons is absent in the attributes estimated by the primary estimation circuitry for these plural persons.

### Claim 7 (depends on 1)

The signage control system according to claim 1,
wherein the attributes are gender and age.

### Claim 8

A non-transitory computer-readable recording medium for recording a signage control program to cause a computer to execute a process including the steps of:
using signage-side images which are frame images from the signage-side camera and surveillance-side images which are frame images from the at least one surveillance camera so as to estimate a person feature of each person in these frame images, and also estimate attributes and behavior of the each person captured in these frame images;
associating and storing results of estimations of the person feature, the attributes and the behavior of each specific person using the frame images from each specific one of the signage-side cameras and the at least one surveillance camera;
using the person feature stored in the storage device to link the results of estimations based on the frame images from multiple ones of the cameras for the same person so as to generate a group of estimation results for each person; and
changing a content displayed on the signage to another based on the attributes of each person who is expected to be in a position where such person can visually recognize the content on the signage, and also based on preceding behavior of such person before then, the attributes and the preceding behavior being contained in the group of estimation results.
