# US 2015/0149261 A1 · Measuring quality of content items presented by a digital magazine server

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0149261 A1
- Document ID: US20150149261A1
- Status: Published application
- Kind: A1
- Application number: 14/089,564
- Filed: 2013-11-25
- Published: 2015-05-28
- Earliest claimed: 2013-11-25
- Assignees: Flipboard, Inc.
- Applicants: Flipboard, Inc.
- Inventors: Andrew David Walkingshaw; Xiaoyu Fei
- Web page: https://patentgrep.com/patent/US20150149261A1

## CPC

- G06Q 10/06395: {Quality analysis or management}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

A digital magazine server determines a quality score for content items receiving less than a threshold amount of interactions from digital magazine server users. A distribution of quality scores for a content item is determined from quality scores of content items having one or more characteristics matching characteristics of the content item. As users interact with a content item, the distribution of quality scores is modified to reflect the received interaction. The digital magazine server may use the distribution for a content item to determine a quality score for the content item having a specified confidence or the confidence of the content item having a specified quality score.

## Claims

### Claim 1

A method of assessing quality of one or more content items for presentation by a digital magazine server, the method comprising:
receiving a content item;
determining a characteristic associated with the received content item;
identifying a set of content items previously presented to one or more users of the digital magazine server based at least in part on the characteristic associated with the received content item;
determining a number of interactions indicating preference for each content item in the set of content items;
determining a quality score for each content item in the set of content items, the quality score for a content item in the set of content items determined at least in part on a number of interactions indicating preference for the content item in the set of content items;
generating a distribution of quality scores for the received content item based on the determined quality scores for the content items in the set of content items;
receiving an interaction for the received content item;
determining a quality score for the received content item based at least in part on the interaction;
generating a modified distribution of quality scores for the received content item by modifying the distribution of quality scores for the received content item to include the quality score of the received content item;
receiving a query for quality of the received content item; and
determining the quality of the received content item based at least in part on the modified distribution of quality scores for the received content item.

### Claim 2 (depends on 1)

The method of claim 1, wherein an interaction indicating preference for a content item in the set of content items comprises a user of the digital magazine server accessing the content item for at least a threshold time interval.

### Claim 3 (depends on 1)

The method of claim 1, wherein the interaction for the received content item comprises an interaction indicating preference for the received content item.

### Claim 4 (depends on 3)

The method of claim 3, wherein the interaction indicating preference for the received content item comprises at least a threshold number of users of the digital magazine server accessing the received content item within a specified time interval.

### Claim 5 (depends on 3)

The method of claim 3, wherein an interaction indicating preference for the received content item is selected from a group consisting of: receiving an input from a user of the digital magazine server to save the received content item, receiving an input from the user of the digital magazine server to share the received content item with an additional user of the digital magazine server, and any combination thereof.

### Claim 6 (depends on 1)

The method of claim 1, wherein the quality score for the received content item is determined based on a ratio of a number of interactions indicating preference for the received content item to a normalization factor.

### Claim 7 (depends on 6)

The method of claim 6, wherein the normalization factor comprises a total number of interactions with the received content item.

### Claim 8 (depends on 6)

The method of claim 6, wherein the normalization factor comprises a total number of interactions with content items in the set of content items.

### Claim 9 (depends on 1)

The method of claim 1, wherein determining the quality score for the received content item based at least in part on the interaction comprises:
determining a total number of interactions indicating preference based on a number of interactions indicating preference for the received content item and the number of interactions indicating preference for content items in the set of content items; and
determining a ratio of the total number of interactions indicating preference and a normalization factor.

### Claim 10 (depends on 9)

The method of claim 9, wherein the normalization factor comprises a combination of a number of interactions with the received content item and a number of interactions with content items in the set of content items.

### Claim 11 (depends on 9)

The method of claim 9, wherein the normalization factor comprises a total number of interactions with content items in the set of content items.

### Claim 12 (depends on 9)

The method of claim 9, wherein the normalization factor comprises a total number of interactions with the content item in the set of content items.

### Claim 13 (depends on 1)

The method of claim 1, wherein the quality score for a content item in the set of content items is determined based on a ratio of the number of interactions indicating preference for the content item in the set of content items to a normalization factor.

### Claim 14 (depends on 1)

The method of claim 1, wherein a query for quality of the received content item comprises a specified quality score and a specified confidence.

### Claim 15

A method of assessing quality of one or more content items included in a digital magazine, the method comprising:
receiving a content item;
determining a characteristic associated with the received content item;
identifying a set of content items previously presented to one or more users of a digital magazine server based at least in part on the characteristic associated with the received content item;
determining a number of interactions indicating preference for each content item in the set of content items;
determining a quality score for each content item in the set of content items, the quality score for a content item in the set of content items determined at least in part on a number of interactions indicating preference for the content item in the set of content items;
generating a distribution of quality scores for the received content item based on the determined quality scores for the content items in the set of content items;
receiving an interaction for the received content item;
determining a quality score for the received content item based at least in part on the interaction; and
generating a modified distribution of quality scores for the received content item by modifying the distribution of quality scores for the received content item to include the quality score of the received content item.

### Claim 16 (depends on 15)

The method of claim 15, wherein an interaction indicating preference for a content item in the set of content items comprises a user of the digital magazine server accessing the content item for at least a threshold time interval.

### Claim 17 (depends on 15)

The method of claim 15, wherein the quality score for the received content item is determined based on a ratio of a number of interactions indicating preference for the received content item to a normalization factor.

### Claim 18 (depends on 17)

The method of claim 17, wherein the normalization factor comprises a total number of interactions with content items in the set of content items.

### Claim 19 (depends on 15)

The method of claim 15, wherein the quality score for a content item in the set of content items is determined based on a ratio of the number of interactions indicating preference for the content item in the set of content items to a normalization factor.

### Claim 20 (depends on 19)

The method of claim 19, wherein the normalization factor comprises a total number of interactions with the content items in the set of content items.

### Claim 21

A method of determining quality of one or more content items for presentation by a digital magazine server, the method comprising:
receiving a content item;
determining a characteristic associated with the received content item;
identifying a set of content items previously presented to one or more users of a digital magazine server based at least in part on the characteristic associated with the received content item;
determining a number of interactions indicating preference for each content item in the set of content items;
determining a quality score for each content item in the set of content items, the quality score for a content item in the set of content items determined at least in part on a number of interactions indicating preference for the content item in the set of content items;
generating a distribution of quality scores for the received content item based on the determined quality scores for the content items in the set of content items;
receiving a query for quality of the received content item before an interaction with the received content item has been received; and
determining the quality of the received content item based at least in part on the distribution of quality scores for the received content item.

### Claim 22 (depends on 21)

The method of claim 21, wherein an interaction indicating preference for a content item in the set of content items comprises a user of the digital magazine server accessing the content item for at least a threshold time interval.

### Claim 23 (depends on 21)

The method of claim 21, wherein determining the quality score for the received content item based at least in part on the interaction comprises:
determining a total number of interactions indicating preference based on the number of interactions indicating preference for each content item in the set of content items; and
determining a ratio of the total number of interactions indicating preference and a normalization factor.

### Claim 24 (depends on 23)

The method of claim 23, wherein the normalization factor comprises a total number of interactions with content items in the set of content items.

### Claim 25 (depends on 21)

The method of claim 21, wherein the query for quality of the received content item comprises a specified quality score and a specified confidence.
