# US 2021/0240968 A1 · Computing device attention determination

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0240968 A1
- Document ID: US20210240968A1
- Status: Published application
- Kind: A1
- Application number: 17/049,193
- Filed: 2018-08-30
- Published: 2021-08-05
- Earliest claimed: 2018-08-30
- Assignees: Hewlett-Packard Development Company, L.P.
- Applicants: Hewlett-Packard Development Company, L.P.
- Inventors: King Sui Kei; Alexander Wayne Clark
- Web page: https://patentgrep.com/patent/US20210240968A1

## CPC

- G06V 40/161: {Detection; Localisation; Normalisation}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06N 20/00: Machine learning
- G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships}
- G06V 40/174: {Facial expression recognition}
- G06V 40/193: {Preprocessing; Feature extraction}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

In one example in accordance with the present disclosure, an attention analysis system is described. The attention analysis system includes a database. The database includes 1) images indicative that users are paying attention to corresponding computing devices and 2) images indicative that users are not paying attention to corresponding computing devices. The system also includes an analyzer to extract multiple user position characteristics from a stream of images of a user disposed in front of a computing device. A comparer of the system determines, by comparing the stream of images of the user to the images in the database, whether the user is paying attention to the computing device.

## Claims

### Claim 1

An attention determining system, comprising:
a database comprising:
images indicative that users are paying attention to corresponding computing devices; and
images indicative that users are not paying attention to corresponding computing devices;
a machine-learning analyzer to extract multiple user position characteristics from a stream of images of a user disposed in front of a computing device; and
a comparer to determine, by comparing the stream of images of the user to the images in the database, whether the user is paying attention to the computing device.

### Claim 2 (depends on 1)

The system of claim 1, further comprising an aggregator to generate an output, based on comparisons of multiple streams of images relating to multiple users with the images in the database, indicative of an aggregate level of attention of the multiple users.

### Claim 3 (depends on 2)

The system of claim 2, further comprising an identifier to identify patterns in the aggregate level of attention.

### Claim 4 (depends on 1)

The system of claim 1, wherein the user is a student in a classroom and an output of the comparer for the student is provided to an instructor.

### Claim 5

A method, comprising:
collecting from a computing device, a stream of images of a user disposed in front of the computing device;
extracting multiple user position characteristics from the stream of images;
comparing the stream of images to a database comprising:
images indicative that users are paying attention to corresponding computing devices; and
images indicative that users are not paying attention to corresponding computing devices; and
determining, based on the comparison, whether the user is paying attention to the computing device.

### Claim 6 (depends on 5)

The method of claim 5, wherein the user position characteristics comprise at least one of:
user eye position information;
user head position information; and
user body position information.

### Claim 7 (depends on 5)

The method of claim 5:
further comprising collecting information regarding a user interaction with the computing device; and
wherein determining whether the user is paying attention to the computing device is further based on collected information regarding the user interaction with the computing device.

### Claim 8 (depends on 5)

The method of claim 5, wherein comparing the stream of images to the database is performed over a period of time.

### Claim 9 (depends on 5)

The method of claim 5:
further comprising collecting information regarding a noise level around the computing device; and
wherein determining whether the user is paying attention to the computing device is further based on the noise level around the computing device.

### Claim 10 (depends on 5)

The method of claim 5, wherein determining, based on the comparison, whether the user is paying attention to the computing device comprises determining with which of 1) the images indicative that users are paying attention to corresponding computing devices and 2) the images indicative that users are not paying attention to corresponding computing devices, the stream of images has more shared characteristics.

### Claim 11

A tangible machine-readable storage medium encoded with instructions executable by a processor, the machine-readable storage medium comprising:
instructions to collect from multiple computing devices, a corpus of images comprising:
images indicative that users are paying attention to corresponding computing devices; and
images indicative that users are not paying attention to corresponding computing devices;
instructions to collect from a computing device, a stream of images of a user disposed in front of the computing device;
instructions to extract multiple user position characteristics from the stream of images;
instructions to compare the stream of images to the corpus of images;
instructions to collect information regarding a user interaction with the computing device;
instructions to, based on a comparison of the stream of images to the corpus of images and the information regarding the user interaction with the computing device, determine whether the user is paying attention to the computing device; and
instructions to provide notice regarding whether the user is paying attention to the computing device.

### Claim 12 (depends on 11)

The tangible machine-readable storage medium of claim 11, wherein the user interaction with the computing device comprises interaction with a user input device of the computing device.

### Claim 13 (depends on 11)

The tangible machine-readable storage medium of claim 11, wherein the user interaction with the computing device comprises a change in information displayed on a display of the computing device.

### Claim 14 (depends on 11)

The tangible machine-readable storage medium of claim 11, further comprising instructions to transmit results of the determination of whether the user is paying attention to the computing device to a server.

### Claim 15 (depends on 11)

The tangible machine-readable storage medium of claim 11, wherein notice is provided to at least one of:
a user of the computing device; or
an administrator of the computing device.
