# US 2013/0158963 A1 · Systems and methods for improving visual attention models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0158963 A1
- Document ID: US20130158963A1
- Status: Published application
- Kind: A1
- Application number: 13/808,205
- Filed: 2011-06-27
- Published: 2013-06-20
- Earliest claimed: 2010-07-07
- Assignees: 3M Innovative Properties Company
- Inventors: Brian E. Brooks; Brian J. Stankiewicz; Brian L. Linzie
- Web page: https://patentgrep.com/patent/US20130158963A1

## CPC

- G06V 10/451: {with interaction between the filter responses, e.g. cortical complex cells}
- G06F 30/20: Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30)
- G06T 7/11: Region-based segmentation
- G06T 2207/10024: Color image
- G06T 2207/30201: Face
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems and methods for improving visual attention models use effectiveness assessment from an environment as feedback to improve visual attention models. The effectiveness assessment uses data indicative of a particular behavior, which is related to visual attention allocation, received from the environment to assess relative effectiveness of the environment on influencing the particular behavior.

## Claims

### Claim 1

A method of evaluating a visual attention model, comprising:
receiving visual representations of at least a portion of two environments that differ from each other on a visual dimension;
receiving output generated by applying the visual attention model on the visual representations of the at least a portion of the two environments;
assessing the relative effectiveness of the two environments on influencing a particular human behavior based on data indicative of the particular human behavior received from the two environments, wherein the particular human behavior is inferentially related to attention allocation; and
comparing the assessed relative effectiveness to the output generated by the visual attention model.

### Claim 2 (depends on 1)

The method of claim 1, further comprising modifying the visual attention model when the assessed relative effectiveness is inconsistent with the output generated by the visual attention model.

### Claim 3 (depends on 1)

The method of claim 1, wherein the particular human behavior is indirectly inferentially related to attention allocation.

### Claim 4 (depends on 1)

The method of claim 1, wherein the data indicative of the particular human behavior comprises at least one of point-of-sale data and motion sensor data.

### Claim 5 (depends on 1)

The method of claim 1, wherein the output generated by the visual attention model comprises at least one of a saliency map, relative saliency numbers, sequence numbers, probability of a region being attended within a given time period, and length of time to which a region is attended.

### Claim 6 (depends on 1)

The method of claim 1, further comprising selecting two environments with similar output generated by the visual attention model on the visual representations of the at least of a portion of two environments.

### Claim 7

(canceled)

### Claim 8 (depends on 2)

The method of claim 2, wherein the visual dimension is represented in the visual attention model, and wherein modifying the visual attention model comprises modifying a parameter of the visual attention model related to the visual dimension.

### Claim 9 (depends on 8)

The method of claim 8, wherein modifying a parameter of the visual attention model comprises modifying a weight factor for the visual dimension represented in the visual attention model.

### Claim at position 10

10-14. (canceled)

### Claim 15

A visual attention model improvement system, comprising:
a module for receiving visual representations of at least a portion of two environments that differ from each other on a visual dimension;
a module for receiving output generated by applying the visual attention model on the visual representations of the at least a portion of the two environments;
a module for assessing the relative effectiveness of the two environments on influencing a particular human behavior based on data indicative of the particular human behavior received from the two environments, wherein the particular human behavior is inferentially related to attention allocation; and
a processing unit for comparing the assessed relative effectiveness to the output generated by the visual attention model.

### Claim 16 (depends on 15)

The system of claim 15, wherein the processing unit modifies the visual attention model when the assessed relative effectiveness is inconsistent with the output generated by the visual attention model.

### Claim 17 (depends on 15)

The system of claim 15, wherein the particular human behavior is indirectly inferentially related to attention allocation.

### Claim at position 14

18-20. (canceled)

### Claim 21 (depends on 16)

The system of claim 16, wherein the visual dimension is represented in the visual attention model.

### Claim 22 (depends on 21)

The system of claim 21, wherein modifying the visual attention model comprises modifying a parameter of the visual attention model related to the visual dimension.

### Claim 23 (depends on 22)

The system of claim 22, wherein modifying a parameter of the visual attention model comprises modifying a weight factor for the visual dimension represented in the visual attention model.

### Claim 24 (depends on 16)

The system of claim 16, wherein modifying the visual attention model comprises adding a parameter related to the visual dimension to the visual attention model.

### Claim 25 (depends on 15)

The system of claim 15, wherein the visual dimension comprises at least one of color, luminance, orientation, font, edges, motion, faces, intensity, distance from fovea, spatial bias, prior-knowledge influence, and task-based influence.

### Claim at position 20

26-28. (canceled)

### Claim 29

A visual attention model improvement system, comprising:
a module for receiving visual representation of at least a portion of an environment;
a module for receiving output generated by applying the visual attention model on the visual representation of the at least a portion of the environment;
a module for assessing the relative effectiveness of the environment on influencing the particular human behavior based on data indicative of a particular human behavior received from the environment, wherein the particular human behavior is inferentially related to attention allocation; and
a processing unit for comparing the assessed relative effectiveness to the output generated by the visual attention model.

### Claim 30 (depends on 29)

The system of claim 29, wherein the processing unit modifies the visual attention model when the assessed relative effectiveness is inconsistent with the output generated by the visual attention model.

### Claim 31 (depends on 29)

The system of claim 29, wherein the environment is an environment having a sign.

### Claim 32

(canceled)
