Back to results
US 12,699,820 B2Granted
Generating artificial intelligence subjects and media stimuli to simulate and predict human responses
AssigneeViewpoints AI, Inc.
InventorsLeonid Yeykelis, James Cummings, Byron Reeves
Life of this patent
Estimating the term…
Abstract
According to various embodiments described herein, mechanisms are provided for employing artificial intelligence (AI), such as in the form of large language models, to simulate responses to stimuli. A study may be created, a set of AI subjects having specified characteristics may be generated, and stimuli may be generated and presented to such AI subjects. Responses may be recorded and analyzed, and reports may be generated based on such analysis. The described system and method provide mechanisms for making research and/or product decisions based on observed responses by the AI subjects to stimuli.
Claims21
A computer-implemented method for simulating responses to media stimuli in order to compare effectiveness of different versions of the media, comprising:
- at an input device, receiving a study configuration object comprising a first set of parameters defining a demographic distribution for artificial intelligence (AI) subjects to be run on at least one hardware processor to simulate human subjects and a second set of parameters defining a plurality of experimental conditions;
- at the at least one hardware processor, programmatically translating the study configuration object into a prompt grammar;
- at the at least one hardware processor, generating a plurality of AI subjects by executing the prompt grammar on at least one large language model, wherein each AI subject is instantiated with specific characteristics based on the demographic distribution;
- at a storage device, storing data defining the plurality of AI subjects;
- at the at least one hardware processor, assigning each generated AI subject to either a control group or a treatment group defined by the experimental conditions;
- at the at least one hardware processor, generating stimuli corresponding to the assigned experimental condition for each AI subject, the stimuli representing at least one version of the media;
- at the at least one hardware processor, constructing a final prompt for each AI subject comprising the specific characteristics, the generated stimuli, and a response schema defining a required structured output format;
- at the at least one hardware processor, presenting the final prompt to each AI subject, to expose each AI subject to a version of the media;
- at the at least one hardware processor, recording responses from the AI subjects
- at the at least one hardware processor, automatically comparing effectiveness of the different versions of the media;
- at an output device, outputting a statistical analysis report based on the recorded responses and the comparison;
- and
- at the storage device, storing the recorded responses.
10 more elements
A non-transitory computer-readable medium for simulating responses to media stimuli in order to compare effectiveness of different versions of the media, comprising instructions stored thereon, that when performed by at least one hardware processor, perform the steps of:
- causing an input device to receive a study configuration object comprising a first set of parameters defining a demographic distribution for artificial intelligence (AI) subjects to be run on at least one hardware processor to simulate human subjects and a second set of parameters defining a plurality of experimental conditions;
- programmatically translating the study configuration object into a prompt grammar;
- generating a plurality of AI subjects by executing the prompt grammar on at least one large language model, wherein each AI subject is instantiated with specific characteristics based on the demographic distribution;
- causing a storage device to store data defining the plurality of AI subjects;
- assigning each generated AI subject to either a control group or a treatment group defined by the experimental conditions;
- generating stimuli corresponding to the assigned experimental condition for each AI subject, the stimuli representing at least one version of the media;
- constructing a final prompt for each AI subject comprising the specific characteristics, the generated stimuli, and a response schema defining a required structured output format;
- presenting the final prompt to each AI subject, to expose each AI subject to a version of the media;
- recording responses from the AI subjects;
- automatically comparing effectiveness of the different versions of the media;
- causing an output device to output a statistical analysis report based on the recorded responses and the comparison;
- and
- causing the storage device to store the recorded responses.
10 more elements
A system for simulating responses to media stimuli in order to compare effectiveness of different versions of the media, comprising:
- an input device, configured to receive a study configuration object comprising a first set of parameters defining a demographic distribution for artificial intelligence (AI) subjects to be run on at least one hardware processor to simulate human subjects and a second set of parameters defining a plurality of experimental conditions;
- at least one hardware processor, each communicatively coupled to the input device, configured to;
- programmatically translate the study configuration object into a prompt grammar;
- and
- generate a plurality of AI subjects by executing the prompt grammar on at least one large language model, wherein each AI subject is instantiated with specific characteristics based on the demographic distribution;
- a storage device, communicatively coupled to the at least one hardware processor, configured to store data defining the plurality of AI subjects;
- and
- an output device, communicatively coupled to the at least one hardware processor;
- wherein:
- the at least one hardware processor is further configured to:
- assign each generated AI subject to either a control group or a treatment group defined by the experimental conditions;
- generate stimuli corresponding to the assigned experimental condition for each AI subject, the stimuli representing at least one version of the media;
- construct a final prompt for each AI subject comprising the specific characteristics, the generated stimuli, and a response schema defining a required structured output format;
- present the final prompt to each AI subject, to expose each AI subject to a version of the media;
- record responses from the AI subjects;
- and
- automatically compare effectiveness of the different versions of the media;
- the an output device is configured to output a statistical analysis report based on the recorded responses and the comparison;
- and
- the storage device is further configured to store the recorded responses.
17 more elements
Dependencies are inferred from the claim text.