Back to results
US 10,372,782 B1Granted
Content generation and experimentation using engagement tests
AssigneeAmazon Technologies, Inc.
InventorMichael Frederick Masterman
Life of this patent
Estimating the term…
Abstract
In some examples, a content variation service may identify elements of content and generate variations of the elements of the content programmatically. Content may include a website and the elements of the content may include visual and structural elements that make up the website. The variations of the elements may be provided with the content to a user as part of an engagement test. The engagement test may test how the user interacts with the variations of the elements. Based on results of the engagement test, the elements of the content may be adjusted and other variations may be generated.
Claims20
One or more non-transitory computer-readable storage devices for storing computer-executable instructions that, when executed by one or more computer systems, configure the one or more computer systems to perform operations comprising:
- receiving content including a plurality of elements, the content associated with a web site;
- identifying element attributes corresponding to individual elements of the plurality of elements;
- selecting an element of the plurality of elements for use in an engagement test based at least in part on profile information of a group of users;
- generating a set of variations of the element based at least in part on a portion of the element attributes corresponding to the element and in accordance with a machine-generated rule that comprises one or more constraints to guide the generation of the set of variations, the set of variations comprising at least one of a variation of a structure of the element, a variation of a color of the element, a variation of a design of the element, a variation of a layout of the element, a variation of non-visual aspect of the element, or a variation of a function of the element, the machine-generated rule being previously generated based at least in part on earlier engagement information received as part of an earlier test;
- providing the content as a first engagement test for presentation to the group of users of the website, the first engagement test including at least a first variation of the set of variations of the element;
- receiving engagement information corresponding to the first engagement test, the engagement information usable to measure, based at least in part on one or more success metrics, how users of the group of users interacted with the first variation of the element;
- and
- providing the content as a second engagement test for presentation to the group of users of the website, the second test including at least a second variation of the set of variations of the element.
5 more elements
A computer-implemented method comprising:
- identifying, by a computer system, an element of content for use in an engagement test based at least in part on profile information of at least one user, the element including a plurality of element attributes;
- generating, by the computer system, a set of variations of the element in accordance with a machine-generated rule previously generated based at least in part on earlier engagement information received as part of an earlier engagement test;
- selecting a first variation from the set of variations based at least in part on an element attribute of the first variation, the first variation comprising an adjustment to at least one attribute of the plurality of attributes;
- receiving information from an entity evaluating one or more aspects of the first variation of the element;
- providing, based at least in part on a portion of the information, the content including the first variation of the element for presentation to a user as part of a first engagement test, the first engagement test testing at least one effect of the first variation of the element with respect to the user;
- and
- generating, by the computer system, a second variation of the element based at least in part on the first engagement test.
4 more elements
A system comprising:
- memory that stores computer-executable instructions;
- and
- at least one processor configured to access the memory and execute the computer-executable instructions to collectively at least:
- identify a first element of a first webpage for use in an engagement test based at least in part on profile information of at least one user, the first webpage including a plurality of elements, the first element including an interchangeable portion;
- generate a first variation of the interchangeable portion of the first element based at least in part on other elements of the plurality of elements of the first webpage and in accordance with a machine-generated rule previously generated based at least in part on earlier engagement information received as part of an earlier engagement test;
- perform a first engagement test by providing the first webpage for presentation, the first webpage including the first variation of the interchangeable portion;
- determine a likeness of the first webpage with a second webpage based at least in part on first features of the first webpage and second features of the second webpage, the second webpage including the interchangeable portion;
- and
- provide the second webpage for presentation, the second webpage including a second element including the first variation of the interchangeable portion, the second webpage provided for presentation based at least in part on feedback from the engagement test and the likeness.
6 more elements
Dependencies are inferred from the claim text.