Training and Control System for Evolving Solutions to Data-Intensive Problems Using Nested Experience-Layered Individual Pool

A system for discovering solutions to a provided problem, comprising:

• a memory storing a candidate pool database identifying a pool of candidate individuals, each candidate individual identifying a potential solution to the problem, each candidate individual further having associated therewith a respective fitness estimate, a respective testing experience level, and a respective value for a partition tag;
• and
• a processing unit which:
• tests individuals from the pool of candidate individuals against training data,
• updates the fitness estimates for tested ones of the individuals, in dependence upon the results of such testing,
• assigns each candidate individual in the pool of candidate individuals into one of a plurality of competition groups in dependence upon the testing experience level and the partition tag value of the candidate individual, and
• selects individuals for discarding from the pool of candidate individuals in dependence upon their assigned competition group.

A non-transitory computer readable medium having stored thereon a plurality of instructions for discovering solutions to a provided problem, the plurality of instructions when executed by a processing unit causing the processing unit to:

• provide in a computer system memory a candidate pool database identifying a pool of candidate individuals, each candidate individual identifying a potential solution to the problem, each candidate individual further having associated therewith a respective fitness estimate, a respective testing experience level, and a respective value for a partition tag;
• test individuals from the pool of candidate individuals against training data;
• update the fitness estimates for tested ones of the individuals, in dependence upon the results of such testing;
• assign each candidate individual in the pool of candidate individuals into one of a plurality of competition groups in dependence upon the testing experience level and the partition tag value of the candidate individual;
• and
• select individuals for discarding from the pool of candidate individuals in dependence upon their assigned competition group.

A computer-implemented data mining system for discovering solutions to a provided problem, comprising:

• a memory having a candidate pool database identifying a pool of candidate individuals, each candidate individual identifying a potential solution to the problem, each candidate individual further having associated therewith a respective fitness estimate, a respective testing experience level, and a respective value for a partition tag;
• means for testing individuals from the pool of candidate individuals against training data;
• means for updating the fitness estimates for tested ones of the individuals, in dependence upon the results of such testing;
• means for assigning each candidate individual in the pool of candidate individuals into one of a plurality of competition groups in dependence upon the testing experience level and the partition tag value of the candidate individual;
• and
• means for selecting individuals for discarding from the pool of candidate individuals in dependence upon their assigned competition group.