# US 2023/0419133 A1 · Ensemble-based multimedia asset recommendation system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0419133 A1
- Document ID: US20230419133A1
- Status: Published application
- Kind: A1
- Application number: 18/231,642
- Filed: 2023-08-08
- Published: 2023-12-28
- Earliest claimed: 2014-07-28
- Applicants: Iris.Tv, Inc.
- Inventors: Thomas J. SULLIVAN; Joel SPITALNIK
- Web page: https://patentgrep.com/patent/US20230419133A1

## CPC

- G06N 5/04: Inference or reasoning models
- G06F 16/438: Presentation of query results
- G06F 16/48: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F 16/9535: Search customisation based on user profiles and personalisation
- G06Q 30/0263: {based upon Internet or website rating}
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

An asset to be displayed during an online engagement is identified. A mixture of multimedia assets that include any combination of: audio, video, text, or image, are selected to be displayed simultaneously with the asset. Each multimedia asset selected based at least on a relationship between the multimedia asset and the asset to be displayed during the online engagement. A presentation screen is created that includes the selected multimedia assets and the asset to be displayed during the online engagement based on display parameters of a receiving device.

## Claims

### Claim 1

A computer-implemented method comprising:
determining, by one or more computing processors and based at least partially on user interaction data collected by a user computing device operated by a user, a selected anchor media content item is to be rendered next with the user computing device to the user;
selecting, by the one or more computing processors and based at least in part on pairwise comparisons with one or more features of the selected anchor media content item, one or more additional media content items from a plurality of media content items related to the selected anchor media content item, wherein the one or more features of the selected anchor media content item include a specific feature identifying whether the selected anchor media content item is a non-video file, wherein a similarity matrix comprising matrix values generated from the pairwise comparisons is used to select the one or more additional media content items for co-displaying with the anchor media content item on an image display of the user computing device;
generating, by the one or more computing processors, a computer display page by arranging the anchor media content item and one or more additional media content items into the computer display page;
causing, by the one or more computer processors, the computer display page to be sent to the user computer device for display on the image display of the user computing device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the anchor media content item and one or more additional media content items displayed on the computer display page are arranged using the display parameters of the user computing device.

### Claim 3 (depends on 1)

The method of claim 1, wherein the one or more additional media content items are selected based on a relationship between each media content item among the one or more additional media content items and the anchor media content item.

### Claim 4 (depends on 1)

The method of claim 1, wherein each media content item among the one or more additional media content items is selected based on a relationship between said each media content item and each other media content item among the one or more additional media content items.

### Claim 5 (depends on 1)

The method of claim 1, wherein the anchor media content item and the one or more additional media content items include at least one media content item that is textual and at least another media content item that is non-textual.

### Claim 6 (depends on 1)

The method of claim 1, wherein the one or more additional media content items are selected based on a common theme.

### Claim 7 (depends on 1)

The method of claim 1, wherein at least a portion of the one or more additional media content items is selected and arranged in the electronic display page based on human sensing modes.

### Claim 8

A system, comprising:
one or more computing processors; and
one or more non-transitory computer-readable media storing instructions, which when executed by the one or more computing processors, cause the one or more computing processors to perform:
determining, by the one or more computing processors and based at least partially on user interaction data collected by a user computing device operated by a user, a selected anchor media content item is to be rendered next with the user computing device to the user;
selecting, by the one or more computing processors and based at least in part on pairwise comparisons with one or more features of the selected anchor media content item, one or more additional media content items from a plurality of media content items related to the selected anchor media content item, wherein the one or more features of the selected anchor media content item include a specific feature identifying whether the selected anchor media content item is a non-video file, wherein a similarity matrix comprising matrix values generated from the pairwise comparisons is used to select the one or more additional media content items for co-displaying with the anchor media content item on an image display of the user computing device;
generating, by the one or more computing processors, a computer display page by arranging the anchor media content item and one or more additional media content items into the computer display page;
causing, by the one or more computer processors, the computer display page to be sent to the user computer device for display on the image display of the user computing device.

### Claim 9 (depends on 8)

The system of claim 8, wherein the anchor media content item and one or more additional media content items displayed on the computer display page are arranged using the display parameters of the user computing device.

### Claim 10 (depends on 8)

The system of claim 8, wherein the one or more additional media content items are selected based on a relationship between each media content item among the one or more additional media content items and the anchor media content item.

### Claim 11 (depends on 8)

The system of claim 8, wherein each media content item among the one or more additional media content items is selected based on a relationship between said each media content item and each other media content item among the one or more additional media content items.

### Claim 12 (depends on 8)

The system of claim 8, wherein the anchor media content item and the one or more additional media content items include at least one media content item that is textual and at least another media content item that is non-textual.

### Claim 13 (depends on 8)

The system of claim 8, wherein the one or more additional media content items are selected based on a common theme.

### Claim 14 (depends on 8)

The system of claim 8, wherein at least a portion of the one or more additional media content items is selected and arranged in the electronic display page based on human sensing modes.

### Claim 15

One or more non-transitory computer-readable media storing one or more sequences of instructions, which when executed by one or more computing processors, cause the one or more computing processors to perform:
determining, by the one or more computing processors and based at least partially on user interaction data collected by a user computing device operated by a user, a selected anchor media content item is to be rendered next with the user computing device to the user;
selecting, by the one or more computing processors and based at least in part on pairwise comparisons with one or more features of the selected anchor media content item, one or more additional media content items from a plurality of media content items related to the selected anchor media content item, wherein the one or more features of the selected anchor media content item include a specific feature identifying whether the selected anchor media content item is a non-video file, wherein a similarity matrix comprising matrix values generated from the pairwise comparisons is used to select the one or more additional media content items for co-displaying with the anchor media content item on an image display of the user computing device;
generating, by the one or more computing processors, a computer display page by arranging the anchor media content item and one or more additional media content items into the computer display page;
causing, by the one or more computer processors, the computer display page to be sent to the user computer device for display on the image display of the user computing device.

### Claim 16 (depends on 15)

The media of claim 15, wherein the anchor media content item and one or more additional media content items displayed on the computer display page are arranged using the display parameters of the user computing device.

### Claim 17 (depends on 15)

The media of claim 15, wherein the one or more additional media content items are selected based on a relationship between each media content item among the one or more additional media content items and the anchor media content item.

### Claim 18 (depends on 15)

The media of claim 15, wherein each media content item among the one or more additional media content items is selected based on a relationship between said each media content item and each other media content item among the one or more additional media content items.

### Claim 19 (depends on 15)

The media of claim 15, wherein the anchor media content item and the one or more additional media content items include at least one media content item that is textual and at least another media content item that is non-textual.

### Claim 20 (depends on 15)

The media of claim 15, wherein the one or more additional media content items are selected based on a common theme.

### Claim 21 (depends on 15)

The media of claim 15, wherein at least a portion of the one or more additional media content items is selected and arranged in the electronic display page based on human sensing modes.
