Use of the UNPIVOT relational operator in the efficient gathering of sufficient statistics for data mining

A method of generating a tabulation of occurrences of selected one or more class attributes of database records as a combination of other attributes and attribute values in the database records comprising the steps of

• a) scanning the database records;
• b) for each scanned database record, reformatting the data within said record into records that include combinations of attribute name, attribute value and the selected one or more class attributes, the SQL language processor processes the UNPIVOT command to reformat the data;
• and
• c) grouping combinations of data that are scanned from the database to build statistics for the one or more class attributes, the scanning performed by an SQL language processor that processes an UNPIVOT command the UNPIVOT command is combined with a SELECT and a GROUP BY SQL command to provide a counts table without producing an UNPIVOTED table.

A method of generating a tabulation of occurrences of selected one or more class attributes of database records as a combination of other attributes and attribute values in the database records comprising the steps of

• a) scanning the database records, the scanning performed by an SQL language processor that processes an UNPIVOT command;
• b) for each scanned database record, reformatting the data within said record into records that include combinations of attribute name, attribute value and the selected one or more class attributes, the reformatting performed by the SQL language processor that processes the UNPIVOT command;
• and
• c) grouping combinations of data that are scanned from the database to build statistics for more than one class attributes and more than one class attribute is evaluated to build a database classifier and wherein a statistical count table is built during the process of building the database classifier by means of multiple invocations of the UNPIVOT operator to data in the database.

A method of generating a tabulation of occurrences of selected one or more class attributes of database records as a combination of other attributes and attribute values in the database records comprising the steps of

• a) reorganizing the database records into a specified format by causing an SQL language processor to execute a PIVOT SQL command;
• b) scanning the database records the scanning performed by an SQL language processor that processes an UNPIVOT command;
• c) for each scanned database record, reformatting the data within said record into records that include combinations of attribute name, attribute value and the selected one or more class attributes, the reformatting performed by the SQL language processor that processes the UNPIVOT command;
• and
• d) grouping combinations of data that are scanned from the database to build statistics for one or more class attributes.

A method for use with a database classifier on a computer including a computer storage device for storing the database;

• said database classifier processing statistical data from the records of the database, said method characterized by the steps of:
• a) scanning records of a database and reformatting each scanned record into a set of records that are based on the contents of the database record attributes so that each of the database records provides multiple records containing combinations of attribute names with attribute types for that record along with the contents of a classifier variable;
• b) counting instances of the classifier variable for each of the records in the set of records;
• c) grouping the results of the counting step into a count table for use by the classifier;
• and
• d) scanning the database for other records to iteratively build a complete count table for use by the database classifier.

A method for use with a database classifier;

• said database classifier processing statistical data from the records of the database;
• said method characterized by the steps of:
• a) scanning a database record and creating multiple associated records in a temporary store where the contents of each of the associated records contains a combination of a record attribute and an attribute value of the database record and a classifier variable of said database record;
• b) determining a count of the combinations of record attribute name and attribute values for each value or value range of the classifier variable;
• and
• c) scanning other records from the database and determining counts for the other records;
• and
• d) preparing a tabulation of the counts that are grouped by attribute name, attribute value and classifier value or value range.

Apparatus for use in creating a database classifier;

• said database classifier processing statistical data from the records of the database;
• the apparatus comprising:
• a) data access means for reading database records from the database;
• b) memory means for storing temporary data records based on the data in a database record;
• and
• c) processor means for creating temporary data records in said memory means where the contents of each of said temporary records contains a combination of an attribute name and an attribute value of the database record for different classifier attribute values of said database;
• said processor means including means for determining combinations of attribute name and attribute value for the temporary records;
• and preparing a tabulation of the counts that are grouped by attribute name, attribute value and classifier value from the temporary records.

Apparatus for use in creating a database classifier, said classifier processing statistical data from the records of the database;

• the apparatus comprising:
• a) data access means for reading database records from the database;
• b) memory means for temporarily storing data records based on the data in a database record;
• and
• c) processor means for creating temporary data records in said memory means where the contents of each of the temporary records contains a combination of an attribute name and an attribute value of the database record for different classifier variable values of said database;
• said processor means including access means for accessing multiple records from the database and determining combinations of attribute name and attribute value for the other records;
• and preparing a tabulation of the counts that are grouped by attribute name, attribute value and classifier value;
• the processor means comprises means for processing SQL commands and wherein an UNPIVOT SQL command reformats the data of a data table which in combination with SQL SELECT and GROUP BY commands creates combinations of attributes and attribute values in a tabulated form in said memory means.