Evaluation and adaptive sampling of agent configurations
AssigneeMicrosoft Technology Licensing, LLC
InventorMarco ROSSI
Life of this patent
Estimating the term…
Loading patent…
AssigneeMicrosoft Technology Licensing, LLC
InventorMarco ROSSI
Estimating the term…
This document relates to evaluation of automated agents. One example includes a system having a processor and a storage medium. The storage medium can store instructions which, when executed by the processor, cause the system to perform two or more data gathering iterations, which can include distributing experimental units to a plurality of agents having different agent configurations according to a sampling strategy, populating an event log with events representing reactions of an environment to actions taken by individual agents in response to individual experimental units, and adjusting the sampling strategy for use in a subsequent data gathering iteration based at least on the events in the event log. The event log can provide a basis for subsequent evaluation of the plurality of agents with respect to one or more evaluation metrics.
A method comprising:
A system comprising:
A computer-readable storage medium storing instructions which, when executed by a computing device, cause the computing device to perform acts comprising:
Dependencies are inferred from the claim text.