Universal delta set management

A method for identifying changes in data sets, the method comprising:

• receiving, by a processor, an ending version for a data set, the ending version sent by a source system connected to the processor by a wireless transmission system;
• identifying, by the processor, a beginning version for the data set;
• comparing, by the processor, the ending version for the data set with the beginning version for the data set;
• calculating, by the processor, a number of differences between the ending version and the beginning version;
• creating, by the processor, a data structure in a computer-readable storage that identifies the number of differences between the ending version and the beginning version;
• adding, by the processor, a number of files to the data structure using the number of differences identified to form an update file, wherein the update file comprises a number of delta files, a number of new files, and a list of a number of unchanged files, wherein responsive to identifying a number of differences between an ending version of a data set and a beginning version of the data set, determining whether there are new files in the ending version, wherein the new files are a number of files identified only in the ending version;
• determining, by the processor, whether there are changed files in the ending version, wherein the changed files are a number of pairs of files, wherein the number of pairs of files are distributed so that a first file in a file pair is in the ending version of the data set and a second file in the file pair is in the beginning version of the data set, and wherein the first file and the second file have a number of differences;
• and
• responsive to a determination that there are new files in the ending version, adding the new files to the update file.

A method for identifying changes in data sets, the method comprising:

• receiving in a processor an ending version for a data set for the target system, the processor connected to the target system by a wireless transmission system;
• identifying, by the processor, a beginning version for the data set from a target data directory on a computer readable storage medium of a source system;
• comparing, by the processor, the ending version for the data set with the beginning version for the data set;
• calculating, by the processor, a number of differences between the ending version and the beginning version;
• identifying, by the processor, a number of constraints for transmission of the number of differences;
• creating, by the processor, an update file that identifies the number of differences between the ending version and the beginning version using the number of constraints, and wherein the update file comprises a number of delta files, a number of new files, and a number of changed files;
• adding, by the processor, a number of files to a data structure using the number of differences identified to form the update file, the update file comprising a number of delta files, a number of new files, and a list of a number of unchanged files, wherein adding the number of files to the empty data structure further comprises:
• determining, by the processor, whether there are changed files in the ending version, wherein the changed files are a number of pairs of files, wherein the number of pairs of files are distributed so that a first file in a file pair is in the ending version of the data set and a second file in the file pair is in the beginning version of the data set, and wherein the first file and the second file have a number of differences;
• responsive to a determination that there are changed files in the ending version of the data set, determining, by the processor, whether the changed files reach or exceed a size threshold;
• responsive to a determination that the changed files do not reach or exceed the size threshold, adding, by the processor, the changed files to the update file;
• sending the update file to the target system via the wireless transmission system;
• and
• loading the update file in the target system.

A method of updating data sets by a source system, the method comprising:

• receiving, by a processor of the source system, an ending version for a data set in a target system;
• identifying, by the processor, a beginning version of a data set from a target data directory on a computer readable storage medium of the source system;
• comparing, by the processor, the beginning version of the data set with the ending version for the data set received;
• calculating, by the processor, a number of differences between the beginning version of the data set and the ending version for the data set;
• and
• creating, by the processor, an ending version data directory on the target system based on the number of differences between the beginning version of the data set and the ending version for the data set;
• adding, by the processor, a number of files to an empty data structure using the number of differences between the beginning version of the data set and the ending version for the data set, so as to create an update file, the update file comprising a number of delta files, a number of new files, and a list of a number of unchanged files, wherein adding the number of files to the empty data structure further comprises:
• determining, by the processor, whether there are changed files in the ending version, wherein the changed files are a number of pairs of files, wherein the number of pairs of files are distributed so that a first file in a file pair is in the ending version of the data set and a second file in the file pair is in the beginning version of the data set, and wherein the first file and the second file have a number of differences;
• responsive to a determination that there are changed files in the update version of the data set, determining, by the processor, whether the changed files reach or exceed a size threshold;
• responsive to a determination that the changed files do not reach or exceed the size threshold, adding, by the processor, the changed files to the update file;
• responsive to a determination that there are new files in the ending version, adding the new files to the update file;
• responsive to adding the changed files to the update file, sending the update file to the target system via a wireless transmission system;
• loading the update file in the target system;
• and
• replacing in the target system the target data directory with the ending version directory.

A system for creating an update file by a source system in a nontransitory medium and connected to the source system by a wireless transmission system, the system comprising:

• a number of data directories in a number of computer readable storage mediums in the source system;
• a transmission decision process configured to calculate, by one or more processors in the source system, a data file size using a number of constraints, wherein the transmission decision process uses the number of constraints to determine when to transmit the update file to a target system, the update file comprising a number of delta files, a number of new files, and a list of a number of unchanged files, the constraints including at least time and transmission speed;
• the one or more processors in the source system in wireless communication with the target system, the one or more processors configured to determine whether there are changed files in the update file, wherein the changed files are a number of pairs of files, wherein the number of pairs of files are distributed so that a first file in a file pair is in the update version of the data set and a second file in the file pair is in the beginning version of the data set, and wherein the first file and the second file have a number of differences;
• a delta computing process coupled to the transmission decision process and configured to create, by the one or more processors, the update file using the data file size;
• wherein the delta computing process compares two sets of data and calculates a number of differences in the two sets of data;
• responsive to a determination that the changed files do not reach or exceed the size threshold, adding the changed files to the update file;
• responsive to a determination that there are new files in the ending version, adding the new files to the update file;
• responsive to adding the changed files to the update file;
• and
• wherein the delta computing process creates the update file that identifies the number of differences in the two sets of data using the data file size calculated by the data transmission process.