Back to results
US 8,301,413 B2Granted
Testing analytics tool
AssigneeBank of America Corporation
InventorsMichael David Napolin, Jennifer Prem, Ronald A. Hollis, Jr., Chunrong Li, Mei-Ling Johnson, Brooke Marie Durham, Michael Newbold, Jr., Matthew Thomas Rice, James A. Greco, Hans D. Schumacher
Life of this patent
Estimating the term…
Abstract
Embodiments of the invention relate to systems, methods, and computer program products for testing analytics. Embodiments herein disclosed provide for automating the collection and storage of test data, automating test performance calculations across a multitude of segments within the test group and automating test result information delivery.
Claims26
A method for automatically providing test performance indicators, the method comprising:
- receiving, at a computing device, test expectation data including an expected lift and an expected confidence for a test metric included within a test, wherein the expected lift is defined as an expected difference to be observed in a test population versus a control population and the expected confidence is defined as an expected probability that an observed lift will be repeated if the test is applied to an overall population;
- receiving, at the computing device, test participant data, test performance data and test metric data;
- and
- determining, at the computing device, one or more test performance indicators associated with the test metric and associated with one or more predefined segments of a test dataset, wherein the determination is based on the test expectation data, the test participant data, and the test performance data and wherein the test performance indicators include a lift and a confidence, wherein the lift is defined as a difference in the test population versus the control population and the confidence is defined as a probability that the lift will be repeated if the test is applied to the overall population.
1 more element
An apparatus for automatically providing test performance indicators, the apparatus comprising:
- a computing platform including at least one processor and a memory;
- and
- a testing analytics module stored in the memory, executable by the at least one processor and including,
- a testing analytics integrator configured to receive, for a specified test, test expectation data, test participant data, test performance data and test metric data, wherein the test expectation data includes an expected lift and an expected confidence for a test metric included with a test and wherein the expected lift is defined as an expected difference to be observed in a test population versus a control population and the expected confidence is defined as an expected probability that an observed lift will be repeated if the test is applied to an overall population, and
- a testing analytics engine configured to determine one or more test performance indicators associated with the test metric and associated with one or more predefined segments of a test dataset, wherein the determination is based on the test expectation data, the test participant data, and the test performance data and wherein the test performance indicators include a lift and a confidence, wherein the lift is defined as a difference in the test population versus the control population and the confidence is defined as a probability that the lift will be repeated if the test is applied to the overall population.
2 more elements
A computer program product comprising:
- a non-transitory computer-readable medium including computer instructions stored therein for causing a computer processor to perform:
- receiving test expectation data including an expected lift and an expected confidence for a test metric included within a test, wherein the expected lift is defined as an expected difference to be observed in a test population versus a control population and the expected confidence is defined as an expected probability that an observed lift will be repeated if the test is applied to an overall population;
- receiving test participant data, test performance data and test metric data;
- and
- determining one or more test performance indicators associated with a test metric and associated with one or more predefined segments of a test dataset, wherein the determination is based on the test expectation data, the test participant data, and the test performance data and wherein the test performance indicators include a lift and a confidence, wherein the lift is defined as a difference in the test population versus the control population and the confidence is defined as a probability that the lift will be repeated if the test is applied to the overall population.
2 more elements
Dependencies are inferred from the claim text.