US 10,853,840 B2Granted

Performance-based digital content delivery in a digital medium environment

AssigneeAdobe Inc.

InventorsKourosh Modarresi, Khashayar Khosravi

Life of this patent

Estimating the term…

Loading patent…

Abstract

Performance-based digital content delivery in a digital medium environment is described. Initially, different items of a collection of digital content are delivered to a substantially equal number of users. The collection is then iteratively tested to identify which content item achieves a desired action (e.g., conversion) at a highest rate. During the iterative test, data describing user interaction with the delivered content is collected. Based on the collected data, measures of achievement are determined for the different content items. Measures of statistical guarantee are also computed that indicate an estimated accuracy of the achievement measures. Responsive to determining that a condition for ending the test has not yet occurred, an optimized allocation is computed for delivery of the content by applying one of multiple allocation optimization techniques. The particular technique applied is based on the condition for ending the test and a type of statistical guarantee associated with the test.

Claims20

Dependent claims

In a digital medium environment to identify digital content of a collection of different digital content that achieves a desired action, a method implemented by at least one computing device, the method comprising:

receiving, by the at least one computing device, a request via a graphical user interface to test the collection of different digital content to identify the digital content of the collection that achieves the desired action, the request including data indicative of a condition defining a test end;
delivering, by the at least one computing device, the collection of digital content according to initial delivery allocation data that indicates to deliver different digital content items of the collection to a substantially equal number of user devices;
selecting, by the at least one computing device, one of a plurality of allocation optimization algorithms used for delivery of the different digital content items based on the condition defining the test end and a type of statistical guarantee associated with the test end, each algorithm of the plurality of allocation optimization algorithms being used in connection with a combination's of conditions defining the test end and types of statistical guarantees that is different from the other algorithms;
collecting, by the at least one computing device and from the user devices, marketing data describing user interactions with the different digital content items;
determining, by the at least one computing device, measures of achievement of the desired action for the different digital content items based on the marketing data;
calculating, by the at least one computing device, measures of the statistical guarantee that indicate accuracy of the measures of achievement;
responsive to a determination that the condition defining the test end has not occurred, generating, by the at least one computing device, optimized delivery allocation data by applying the selected allocation optimization algorithm, the optimized delivery allocation data indicating numbers of the different digital content items to deliver to the user devices;
and
delivering, by the at least one computing device, the collection of digital content to the user devices according to the optimized delivery allocation data.

6 more elements

A system comprising:

a testing module implemented at least partially in hardware of at least one computing device to determine measures of achievement for different digital content items of a collection to achieve a desired action, the testing module further implemented to calculate measures of statistical guarantee for the measures of achievement, the measures of achievement determined based on collected marketing data that describes user interaction with the different digital content items;
an optimization algorithm selection module implemented at least partially in hardware of at least one computing device to select one of a plurality of allocation optimization algorithms for use in connection with identifying a digital content item of the collection that achieves the desired action, the plurality of allocation optimization algorithms each being used in connection a combination of conditions defining an end of an identification test and types of statistical guarantees that is different from the other algorithms, and the selected allocation optimization algorithm selected based on a particular condition defining the end of the identification test and a particular type of statistical guarantee associated with the identification test;
a content allocation module implemented at least partially in hardware of at least one computing device to compute an optimized allocation of the different digital content items of the collection for delivery using the selected allocation optimization algorithm:
and
a delivery module implemented at least partially in hardware of at least one computing device to deliver the different digital content items of the collection according to the optimized allocation.

2 more elements

Dependencies are inferred from the claim text.