# US 10,871,821 B1 · Systems and methods for presenting and modifying interactive content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,871,821 B1
- Document ID: US10871821B1
- Status: Granted
- Kind: B1
- Application number: 15/282,520
- Filed: 2016-09-30
- Granted: 2020-12-22
- Earliest claimed: 2015-10-02
- Assignees: Massachusetts Mutual Life Insurance Company
- Applicants: Massachusetts Mutual Life Insurance Company
- Inventors: Michal Knas
- Web page: https://patentgrep.com/patent/US10871821B1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G06Q 30/0282: Rating or review of business operators or products
- G06Q 40/08: Insurance
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 2203/011: Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- G09G 2354/00: Aspects of interface with display user
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Disclosed herein are systems and methods for presenting and modifying intelligent interactive content. The methods may include receiving user input on a first device from a first user to present content to a second user on a second device. The method may include providing the second device with the content data, presenting the content to the second user, monitoring the second user's reaction to the content using eye-tracking sensor, and generating feedback data. The method may include providing the feedback data to the first device, presenting feedback to the first user and modifying the content of the for the first and the second user according to the second user's reaction.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving, by a server, an input submitted by a first user on a first portion of a user interface of a control device;
generating, by the server, first content data based on the input wherein the first content data is configured for presentation on a remotely-located content display device;
transmitting, by the server, the first content data to the content display device for display on a display screen of the content display device;
generating and transmitting an instruction, by the server, to collect visual behavior data of a second user sensed by a sensor of the content display device when the content display device is displaying the first content data;
generating, by the server, feedback data based on the visual behavior data of the second user sensed by the sensor of the content display device;
determining, by the server, a relationship between the feedback data and the first content data displayed on the content display device;
generating and transmitting a second instruction to display, by the server on a second portion of the user interface of the control device, information within the display screen of the content display device, wherein a visual identifier is presented on the second portion based on the feedback data indicating one or more portions of the display screen not being viewed by the second user;
upon the first user interacting with the visual identifier, generating, by the server, second content data based on the relationship and configured for presentation on the display screen of the content display device, wherein the second content data comprises content that is different from the information displayed in the one or more portions of the display screen; and
transmitting, by the server, the second content data to the content display device, whereby the content display device displays the second content data instead of the first content data.

### Claim 2 (depends on 1)

The method according to claim 1, wherein displaying comprises presenting an overlay of feedback data on a representation of the first content data.

### Claim 3 (depends on 1)

The method according to claim 1, wherein determining the relationship between the feedback data and the first content data comprises determining a focus of a gaze of the second user with respect to the display screen based on the visual behavior data, and displaying comprises presenting the visual identifier representing the focus of the gaze of the second user with respect to the display screen.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the first content data presented to the content display device is segmented, and wherein processing comprises associating the feedback data with the segments of the first content data.

### Claim 5 (depends on 1)

The method according to claim 1, wherein displaying the visual identifier occurs substantially in real-time.

### Claim 6 (depends on 5)

The method according to claim 5, wherein displaying the visual identifier is limited to a most recent historical period of time of the feedback data.

### Claim 7 (depends on 1)

The method according to claim 1, wherein collecting behaviors comprises extracting behaviors from the second user captured using an eye-tracking sensor communicatively coupled to the content display device.

### Claim 8 (depends on 1)

The method according to claim 1, wherein the feedback data comprises information characterizing an interest of the second user in one or more segments of the first content data displayed on the content display device as interested, not interested, or indifferent.

### Claim 9 (depends on 1)

The method according to claim 1, where in the feedback data is in form of a graphical representation.

### Claim 10 (depends on 1)

The method according to claim 1, wherein the input comprises instructions to display at least one of insurance product recommendations derived from sales illustrations for an insurance product, text associated with the demographics of a potential client for the insurance product, or images associated with the demographics of a potential client for the insurance product.

### Claim 11 (depends on 1)

The method according to claim 1, wherein the input comprises instructions to display the first content data including at least one of an instruction for a position on the content display device, content data size or visual emphasis of the first content data.

### Claim 12 (depends on 1)

The method according to claim 1, wherein the feedback data comprises a score associated with one or more segments of the first content data displayed on the content display device.

### Claim 13 (depends on 1)

The method according to claim 1, wherein the server determines if the first user interacting with the control device selects to continue to present the first content data on the content display device based on the feedback data via a prompt on the user interface.

### Claim 14 (depends on 7)

The method according to claim 7, wherein the eye-tracking sensor extracts information about the eye movement of the second user and duration of the gaze of the second user within a boundary associated with one or more segments of the first content data.

### Claim 15 (depends on 7)

The method according to claim 7, wherein the server collects non-ocular interactions of the second user with the first content data displayed on the content display device.

### Claim 16

A system comprising:
a content display device having a display;
a control device having a display and being located remotely from the content display device configured to:
generate second content data based on feedback data and configured for presentation on the content display device; and
transmit the second content data to the content display device for display on the content display device;
a sensor communicatively coupled to the content display device;
a communication network; and
an analytics server comprising a processing unit, the analytics server configured to:
receive an input submitted by a first user on a first portion of a user interface of the control device;
generate first content data based on the input and configured for presentation on the content display device;
transmit the content data to the content display device for display on a display screen of the content display device;
generate and transmit an instruction to collect visual behavior data of a second user sensed by the sensor of the content display device when the content display device is displaying the first content data;
generate feedback data based on the visual behavior data of the second user sensed by the sensor of the content display device;
determine a relationship between the feedback data and the first content data displayed on the content display device;
generate and transmit a second instruction to display on a second portion of the user interface of the control device information within the display screen of the content display device, wherein a visual identifier is presented on the second portion based on the feedback data indicating one or more portions of the display screen not being viewed by the second user; and
upon the first user interacting with the visual identifier, transmitting the second content data to the content display device, whereby the content display device displays the second content data instead of the first content data, and wherein the second content data comprises content that is different from the information displayed in the one or more portions of the display screen.

### Claim 17 (depends on 16)

The system according to claim 16, wherein displaying comprises presenting an overlay of feedback data on a representation of the first content data.

### Claim 18 (depends on 16)

The system according to claim 16, wherein determining the relationship between the feedback data and the first content data comprises determining a focus of a gaze of the second user with respect to the display screen based on the visual behavior data, and displaying comprises presenting the visual identifier representing the focus of the gaze of the second user with respect to the display screen.

### Claim 19 (depends on 16)

The system according to claim 16, wherein displaying the visual identifier occurs substantially in real-time.

### Claim 20 (depends on 16)

The system according to claim 16, wherein collecting behaviors comprises extracting behaviors from the second user captured using the sensor communicatively coupled to the content display device.
