Automated system for adapting reference data and generating evaluation metrics

In a networked environment, a method comprising:

• receiving or retrieving, by at least one server, at least one first data set, wherein the at least one server is operating under control of computer-executable instructions that, when executed by a processor, implement components including at least:
• a governing logic component;
• and
• a production component,
• wherein each first data set identifies at least one item defined by a set of attributes having attribute data that includes two or more parameter values or a plurality of items having attributes that differ by at least one parameter value;
• and
• wherein, for each received or retrieved first data set, the method further comprises implementing, by the at least one server, at least one evaluation service that, in operation, includes:
• obtaining, by the production component, time-dependent metric data from at least one data source accessible to the at least one server, wherein the obtained metric data comprises one or more second data sets that include reference data for one or more items that are responsive to a respective item identified in the first data set, said one or more responsive items having attributes that are responsive to attributes of the respective item identified in the first data set, wherein each responsive item in the metric data possesses a plurality of attributes including at least one parameter value;
• evaluating, by the production component, the plurality of attributes of each responsive item in the metric data relative to the set of attributes identified for the respective item in the first data set to dynamically discover relationships within the attribute data, wherein discovery of one or more relationships comprising a difference enables the governing logic component to define one or more context-specific instructions for adapting the metric data for the respective item;
• and
• normalizing the metric data, wherein the production component executes the context-specific instructions for adapting the metric data for the respective item, wherein execution of at least one context-specific instruction causes one or more adjustment values to be generated and applied to the reference data for one or more responsive items that differ by at least one parameter value from the respective item, transforming the reference data for the one or more responsive items, and automatically producing context-specific reference data for the respective item;
• and
• wherein, for each received or retrieved first data set, the method further includes:
• generating, by the production component, at least one evaluation metric for the first data set, wherein each evaluation metric is generated according to one or more predefined algorithms that are pre-associated with the at least one evaluation service, and wherein at least a subset of the context-specific reference data produced for the respective item or items identified in the first data set are automatically input into one or more of the algorithms to generate the at least one evaluation metric.

In a networked environment, a non-transitory computer-readable medium having computer-executable instructions stored thereon, wherein the computer-executable instructions, when executed, cause at least one server to perform operations comprising:

• receiving at the at least one server, or retrieving by the at least one server, at least one first data set, wherein the at least one server is operating under control of computer-executable instructions that, when executed by a processor, implement components including a governing logic component and a production component, and wherein each received or retrieved first data set identifies at least one item defined by a set of attributes having attribute data that includes two or more parameter values or a plurality of items having attributes that differ by at least one parameter value;
• and
• implementing at least one evaluation service wherein, for each received or retrieved first data set, the computer-executable instructions cause the at least one server to:
• obtain, by the production component, time-dependent metric data from at least one data source accessible to the at least one server, wherein the metric data comprises one or more second data sets that include reference data for one or more items that are responsive to a respective item identified in the first data set, said one or more responsive items having attributes that are responsive to attributes of the respective item identified in the first data set, wherein each responsive item in the metric data possesses a plurality of attributes including at least one parameter value;
• evaluate, by the production component, the plurality of attributes of each responsive item in the metric data relative to the set of attributes identified for the respective item in the first data set to dynamically discover relationships within the attribute data, wherein discovery of one or more relationships comprising a difference enables the governing logic component to define one or more context-specific instructions for adapting the metric for the respective item;
• normalize the metric data, wherein the production component executes the context-specific instructions for adapting the metric for the respective item, wherein execution of at least one context-specific instruction causes one or more adjustment values to be applied to the reference data for one or more responsive items that differ by at least one parameter value from the respective item, transforming the reference data for the at least one responsive item, and automatically producing context-specific reference data for the respective item;
• and
• generate, by the production component, at least one evaluation metric for each received or retrieved first data set, wherein each evaluation metric is generated according to one or more predefined algorithms that are pre-associated with the at least one evaluation service, and wherein at least a subset of the context-specific reference data produced for the respective item or items identified in the first data set are automatically input into one or more of the algorithms to generate the at least one evaluation metric.