# US 2016/0259701 A1 · Generating test data record set populations > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2016/0259701 A1 - Document ID: US20160259701A1 - Status: Published application - Kind: A1 - Application number: 14/637,575 - Filed: 2015-03-04 - Published: 2016-09-08 - Earliest claimed: 2015-03-04 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: Joel L. Masser; David C. Reed; Max D. Smith - Web page: https://patentgrep.com/patent/US20160259701A1 ## CPC - G06F 11/2635: {using a storage for the test inputs, e.g. test ROM, script files} - G06F 11/2221: {to test input/output devices or peripheral units} - G06F 11/3034: {where the computing system component is a storage system, e.g. DASD based or network based (digital input from or digital output to record carriers G06F3/06; digital recording or reproducing G11B20/18; for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097)} - G06F 11/36: Prevention of errors by analysis, debugging or testing of software - G06F 11/3668: Testing of software - G06F 11/3414: {Workload generation, e.g. scripts, playback} - G06F 11/3698: Environments for analysis, debugging or testing of software - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Metadata of a target data record set population is used to generate a test data record set population for use in data storage system testing. The metadata includes values for metadata parameters for individual target data record sets. The target data record set population as a whole has metadata parameter values distributed among sets of value ranges. A group of proportions is calculated for each set of value ranges. A test data record set population is generated based on the groups of proportions. As generated, the test data record set population meets a set of predetermined criteria. ## Claims ### Claim 1 A method for using target metadata of a target data record set population to generate a test data record set population, the method comprising: analyzing the target metadata, the target metadata containing, for each individual target data record set of the target data record set population, a value for a first metadata parameter and a value for a second metadata parameter, wherein the target data record set population as a whole has a first set values for the first metadata parameter distributed among a first plurality of value ranges and a second set of values for the second metadata parameter distributed among a second plurality of value ranges; calculating, based on the analyzing the target metadata, first and second groups of proportions for the target data record set population, wherein the first group of proportions has, for each value range of the first plurality of value ranges, a proportion of the first set of values within that particular value range and the second group of proportions has, for each value range of the second plurality of value ranges, a proportion of the second set of values within that particular value range; and generating, based on at least the first and second groups of proportions, the test data record set population, wherein the test data record set population meets a set of predetermined criteria, wherein each individual test data record set of the test data record set population has a value for a first metadata parameter and a value for a second metadata parameter, and wherein the test data record set population as a whole has a third set of values for the first metadata parameter distributed among the first plurality of value ranges and a fourth set of values for the second metadata parameter distributed among the second plurality of value ranges. ### Claim 2 (depends on 1) The method of claim 1, wherein the test data record set population has a third group of proportions and a fourth group of proportions, the third group of proportions having, for each value range of the first plurality of value ranges, a proportion of the third set of values within that particular value range and the fourth group of proportions having, for each value range of the second plurality of value ranges, a proportion of the fourth set of values within that particular value range, and wherein the set of predetermined criteria is met by the first group of proportions being substantially the same as the third group of proportions and the second group of proportions being substantially the same as the fourth group of proportions. ### Claim 3 (depends on 1) The method of claim 1 further comprising: generating, for the first metadata parameter, a first histogram, wherein bars of the first histogram represent proportions of the first group of proportions; and generating, for the second metadata parameter, a second histogram, wherein bars of the second histogram represent proportions of the second group of proportions. ### Claim 4 (depends on 1) The method of claim 1 further comprising: identifying a group of data record sets stored on a target data storage system by scanning a system catalog of the target data storage system; and selecting as the target data record set population a subgroup of data record sets from the group of data records. ### Claim 5 (depends on 1) The method of claim 1, wherein the first and second groups of proportions are calculated without accessing content of individual target data record sets of the target data record set population. ### Claim 6 (depends on 1) The method of claim 1 further comprising: running a test script on the test data record set population. ### Claim 7 (depends on 6) The method of claim 6 further comprising: generating, based on at least the first and second groups of proportions, a second test data record set population, wherein the second test data record set population meets the set of predetermined criteria; and running the test script on the second test data record set population. ### Claim 8 (depends on 6) The method of claim 6 further comprising: calculating a revised first group of proportions by selectively varying at least two proportions of the first group of proportions; generating, based on the revised first group of proportions and the second group of proportions, a second test data record set population; running the test script on the second test data record set population; comparing results of the running the test script on the test data record set population and results of the running the test script on the second test data record set population; and determining, based on the comparing, a significance of the first metadata parameter relative to the second metadata parameter. ### Claim 9 (depends on 1) The method of claim 1 further comprising: identifying data record sets stored on a target data storage system; determining that a subgroup of the identified data record sets are used in the target data storage system by a system functionality under test; and selecting, in response to the determining, a representative sample of the subgroup of data record sets as the target data record set population. ### Claim 10 (depends on 1) The method of claim 1 further comprising: identifying data record sets stored on a plurality of target data storage systems configured to perform a target system functionality; determining that the target system functionality is configured to use a subgroup of the identified data record sets; selecting, based on the determining, a representative sample of the subgroup of data record sets as the target data record set population; and running, on the test data record set population, a test script configured to test the target system functionality. ### Claim 11 (depends on 1) The method of claim 1, wherein a first metadata parameter is selected from a group consisting of number of data records and block size. ### Claim 12 (depends on 1) The method of claim 1, wherein a first portion of the first set of values are within a first value range of the first plurality of value ranges, wherein a second portion of the first set of values are within a second value range of the first plurality of value ranges, and wherein a third portion of the first set of values are within a third value range of the first plurality of value ranges. ### Claim 13 (depends on 12) The method of claim 12, wherein the second plurality of value ranges includes only a first value range of the second plurality of value ranges and a second value range of the second plurality of value ranges, wherein a first portion of the second set of values are within the first value range of the second plurality of value ranges, and wherein a remaining portion of the second set of values are within the second value range of the second plurality of value ranges. ### Claim 14 A system for using target metadata of a target data record set population to generate a test data record set population, the system comprising: a memory; and at least one processor in communication with the memory, wherein the at least one processor is configured to perform a method comprising: analyzing the target metadata, the target metadata containing, for each individual target data record set of the target data record set population, a value for a first metadata parameter and a value for a second metadata parameter, wherein the target data record set population as a whole has a first set values for the first metadata parameter distributed among a first plurality of value ranges and a second set of values for the second metadata parameter distributed among a second plurality of value ranges; calculating, based on the analyzing the target metadata, first and second groups of proportions for the target data record set population, wherein the first group of proportions has, for each value range of the first plurality of value ranges, a proportion of the first set of values within that particular value range and the second group of proportions has, for each value range of the second plurality of value ranges, a proportion of the second set of values within that particular value range; and generating, based on at least the first and second groups of proportions, the test data record set population, wherein the test data record set population meets a set of predetermined criteria, wherein each individual test data record set of the test data record set population has a value for a first metadata parameter and a value for a second metadata parameter, and wherein the test data record set population as a whole has a third set of values for the first metadata parameter distributed among the first plurality of value ranges and a fourth set of values for the second metadata parameter distributed among the second plurality of value ranges. ### Claim 15 (depends on 14) The system of claim 14, wherein the test data record set population has a third group of proportions and a fourth group of proportions, the third group of proportions having, for each value range of the first plurality of value ranges, a proportion of the third set of values within that particular value range and the fourth group of proportions having, for each value range of the second plurality of value ranges, a proportion of the fourth set of values within that particular value range, and wherein the set of predetermined criteria is met by the first group of proportions being substantially the same as the third group of proportions and the second group of proportions being substantially the same as the fourth group of proportions. ### Claim 16 (depends on 14) The system of claim 14, wherein the method further comprises: generating, for the first metadata parameter, a first histogram, wherein bars of the first histogram represent proportions of the first group of proportions; and generating, for the second metadata parameter, a second histogram, wherein bars of the second histogram represent proportions of the second group of proportions. ### Claim 17 (depends on 14) The system of claim 14, wherein the method further comprises: identifying a group of data record sets stored on a target data storage system by scanning a system catalog of the target data storage system; and selecting as the target data record set population a subgroup of data record sets from the group of data records. ### Claim 18 A computer program product for using target metadata of a target data record set population to generate a test data record set population, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform a method comprising: analyzing the target metadata, the target metadata containing, for each individual target data record set of the target data record set population, a value for a first metadata parameter and a value for a second metadata parameter, wherein the target data record set population as a whole has a first set values for the first metadata parameter distributed among a first plurality of value ranges and a second set of values for the second metadata parameter distributed among a second plurality of value ranges; calculating, based on the analyzing the target metadata, first and second groups of proportions for the target data record set population, wherein the first group of proportions has, for each value range of the first plurality of value ranges, a proportion of the first set of values within that particular value range and the second group of proportions has, for each value range of the second plurality of value ranges, a proportion of the second set of values within that particular value range; and generating, based on at least the first and second groups of proportions, the test data record set population, wherein the test data record set population meets a set of predetermined criteria, wherein each individual test data record set of the test data record set population has a value for a first metadata parameter and a value for a second metadata parameter, and wherein the test data record set population as a whole has a third set of values for the first metadata parameter distributed among the first plurality of value ranges and a fourth set of values for the second metadata parameter distributed among the second plurality of value ranges. ### Claim 19 (depends on 18) The computer program product of claim 18, wherein the test data record set population has a third group of proportions and a fourth group of proportions, the third group of proportions having, for each value range of the first plurality of value ranges, a proportion of the third set of values within that particular value range and the fourth group of proportions having, for each value range of the second plurality of value ranges, a proportion of the fourth set of values within that particular value range, and wherein the set of predetermined criteria is met by the first group of proportions being substantially the same as the third group of proportions and the second group of proportions being substantially the same as the fourth group of proportions. ### Claim 20 (depends on 18) The computer program product of claim 18, wherein the method further comprises: generating, for the first metadata parameter, a first histogram, wherein bars of the first histogram represent proportions of the first group of proportions; and generating, for the second metadata parameter, a second histogram, wherein bars of the second histogram represent proportions of the second group of proportions.