# US 2014/0208226 A1 · Cognitive load assessment for digital documents

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0208226 A1
- Document ID: US20140208226A1
- Status: Published application
- Kind: A1
- Application number: 13/995,514
- Filed: 2011-12-30
- Published: 2014-07-24
- Earliest claimed: 2011-12-30
- Assignees: Intel Corporation
- Inventors: Kenton M. Lyons
- Web page: https://patentgrep.com/patent/US20140208226A1

## CPC

- G06F 16/9577: {Optimising the visualization of content, e.g. distillation of HTML documents}
- A61B 5/16: Devices for psychotechnics (using teaching or educational appliances G09B1/00 - G09B7/00); Testing reaction times {; Devices for evaluating the psychological state}
- A61B 5/163: {by tracking eye movement, gaze, or pupil change}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06Q 30/0201: Market modelling; Market analysis; Collecting market data
- A61B 3/112: {for measuring diameter of pupils}
- A61B 3/113: for determining or recording eye movement
- A61B 2503/24: Computer workstation operators
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

An embodiment of the invention includes a system that tracks a user's pupillary response to content located on a web page. The system then determines a cognitive load for the user that is based on the measured response. Cognitive load refers to the total amount of mental activity imposed on working memory in any one instant. Further, the system may aggregate the cognitive load data for one user over time, for many different users, and/or for many different users over time. The cognitive load may be determined for different portions of a displayed page, such as a document object model (DOM) included on the page. The cognitive load may be specified for different elements that make up the DOM. Also, cognitive load may be apportioned over several different DOM elements at one moment in time or over a period of time. Other embodiments are described herein.

## Claims

### Claim 1

At least one storage medium having instructions stored thereon for causing a system to perform a method comprising:
processing a first user's pupil activity, using the at least one processor, to determine the first user's first cognitive load for first and second hierarchical elements of a hierarchical user interface (UI) model included on a first page that displays the first and second elements in a first spatial orientation to one another;
processing the first user's pupil activity, using the at least one processor, to determine the first user's second cognitive load for the first and second elements of the first UI model included on a second page that displays the first and second elements in a second spatial orientation to one another that is unequal to the first orientation;
storing the first user's first and second cognitive loads in at least one machine accessible medium coupled to the at least one processor; and
determining a single aggregate cognitive load for one of the first and second elements of the first UI model based on both of the first user's first and second cognitive loads.

### Claim 2 (depends on 1)

The at least one medium of claim 1, the method comprising:
processing a second user's pupil activity, using the at least one processor, to determine the second user's first cognitive load for the first and second elements of the first UI model included on the first page;
processing the second user's pupil activity, using the at least one processor, to determine the second user's second cognitive load for the first and second elements of the first UI model included on the second page;
storing the second user's first and second cognitive loads in the at least one machine accessible medium coupled to the at least one processor; and
determining the single aggregate cognitive load based on both of the first user's first and second cognitive loads and further based on both of the second user's first and second cognitive loads.

### Claim 3 (depends on 1)

The at least one medium of claim 1, wherein each of the first and second elements has a parent node and a child node.

### Claim 4 (depends on 1)

The at least one medium of claim 1, wherein the first UI model includes a first document object model (DOM) and both of the first and second elements are included in a single hierarchal level of the first DOM.

### Claim 5 (depends on 1)

The at least one medium of claim 1, wherein:
each of the first and second elements has a parent node but no child node; and
processing the first user's pupil activity to determine the first user's first cognitive load includes one of (a) calculating the first cognitive load based on data acquired via a processing system, and (b) receiving the first user's first cognitive load from the processing system after the first cognitive load was calculated on the processing system.

### Claim 6 (depends on 1)

The at least one medium of claim 1, wherein on the first page the first element includes a first child node including first content and on the second page the first element includes a second child node including second content unequal to the first content.

### Claim 7 (depends on 1)

The at least one medium of claim 1, the method comprising attributing first and second portions of the first user's first cognitive load respectively to the first and second elements of the first UI model included on the first page.

### Claim 8 (depends on 1)

The at least one medium of claim 1, the method comprising:
attributing a first portion of the first user's first cognitive load to the first element of the first UI model included on the first page at a first time period; and
attributing a second portion of the first user's first cognitive load to the first element of the first UI model included on the first page at a second time period that immediately follows the first time period.

### Claim 9 (depends on 1)

The at least one medium of claim 1, the method comprising:
attributing a first portion of the first user's first cognitive load to the first element of the first UI model included on the first page at a first time period;
attributing a second portion of the first user's first cognitive load to the first element of the first UI model included on the first page at a second time period that immediately follows the first time period;
attributing a third portion of the first user's first cognitive load to the second element of the first UI model included on the first page at the first time period; and
attributing a fourth portion of the first user's first cognitive load to the second element of the first UI model included on the first page at the second time period that immediately follows the first time period.

### Claim 10

(canceled)

### Claim 11

An apparatus comprising:
at least one processor;
control logic, coupled to the at least one processor, to:
process a first user's pupil activity, using the at least one processor, to determine the first user's first cognitive load for first and second hierarchical elements of a first hierarchical user interface (UI) model included on a first page that displays the first and second elements in a first spatial orientation to one another;
process the first user's pupil activity, using the at least one processor, to determine the first user's second cognitive load for the first and second elements of the first UI model included on a second page that displays the first and second elements in a second spatial orientation to one another that is unequal to the first orientation; and
determine a single aggregate cognitive load for one of the first and second elements of the first UI model based on both of the first user's first and second cognitive loads.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the control logic is to:
process a second user's pupil activity, using the at least one processor, to determine the second user's first cognitive load for the first and second elements of the first UI model included on the first page;
process the second user's pupil activity, using the at least one processor, to determine the second user's second cognitive load for the first and second elements of the first UI model included on the second page; and
determine the single aggregate cognitive load based on both of the first user's first and second cognitive loads and further based on both of the second user's first and second cognitive loads.

### Claim 13 (depends on 11)

The apparatus of claim 11, wherein each of the first and second elements has a parent node and a child node.

### Claim 14 (depends on 11)

The apparatus of claim 11, wherein the first UI model includes a first document object model (DOM) and both of the first and second elements are included in a single hierarchal level of the first DOM.

### Claim 15 (depends on 11)

The apparatus of claim 11, wherein each of the first and second elements has a parent node but no child node.

### Claim 16 (depends on 11)

The apparatus of claim 11, wherein on the first page the first element includes a first child node including first content and on the second page the first element includes a second child node including second content unequal to the first content.

### Claim 17 (depends on 11)

The apparatus of claim 11, wherein the control logic is to attribute first and second portions of the first user's first cognitive load respectively to the first and second elements of the first UI model included on the first page.

### Claim 18 (depends on 11)

The apparatus of claim 11, wherein the control logic is to:
attribute a first portion of the first user's first cognitive load to the first element of the first UI model included on the first page at a first time period; and
attribute a second portion of the first user's first cognitive load to the first element of the first UI model included on the first page at a second time period that immediately follows the first time period.

### Claim 19 (depends on 11)

The apparatus of claim 11, wherein the control logic is to:
attribute a first portion of the first user's first cognitive load to the first element of the first UI model included on the first page at a first time period;
attribute a second portion of the first user's first cognitive load to the first element of the first UI model included on the first page at a second time period that immediately follows the first time period;
attribute a third portion of the first user's first cognitive load to the second element of the first UI model included on the first page at the first time period; and
attribute a fourth portion of the first user's first cognitive load to the second element of the first UI model included on the first page at the second time period that immediately follows the first time period.

### Claim 20

(canceled)
