Data integrity for compaction devices

An information processing system for processing a stream of data and including a plurality of parallel and sequentially connected data processing units, each of the data processing units comprising:

• a first storage device for accepting and storing a set of data from the stream of data;
• a first event counter for counting a certain number of bytes received by said storage device to form the set of data by controlling the amount of data received by said storage device;
• a first interface control controlled by said first event counter which when reaching the count of the set of data for activating the next sequentially connected data processing unit signals that this data processing unit has received its set of data and that the next data processing unit should receive its set of data;
• an encoder connected to said first storage device for compacting the set of data from the first storage device and for adding an end of set signal;
• a decoder connected to receive the compacted sets of data compacted by said encoder for decompacting the compacted set of data;
• first error detection means connected to receive the same data directed to said encoder for generating a first integrity code representative of the sets of data transmitted to said encoder;
• second error detection means connected to an output of said decoder for generating a second integrity code representative of the decompacted data from said decoder;
• and
• means for comparing said first and second integrity codes and for generating an error signal if said first and second integrity codes are not the same;
• whereby the data compacted by said encoder is immediately decompacted by said decoder for checking the integrity of the compacted data;
• a second storage device for accepting and storing the compacted set of data from said encoder;
• a second event counter for determining when the entire set of data has been compacted by said encoder by sensing the end of set signal;
• a second interface control controlled by said second event counter for determining that the set of data has been compacted and for transmitting the compacted set of data from said second storage device when the second interface control is activated by said second event counter sensing the end of set signal and for signalling a subsequent data processing unit that it has transmitted its compacted set of data;
• means in the information processing system for combining the compacted sets of data from each second storage device located in each of the data processing units;
• and
• third storage means connected to said combining means for receiving the compacted sets of data and storing the sets of data in the same sequence as the set sequence extracted from the stream of data.

An information processing system for compressing a stream of data comprising:

• an encoder for compacting the stream of data to obtain a compacted stream of data;
• a decoder for decompacting the compacted stream of data;
• connecting means connected to an output of said encoder and an input of said decoder for directing the compacted stream of data compacted by said encoder to said decoder for decompaction;
• first error detecting means connected to receive the stream of data directed to said encoder for generating a first integrity code representative of the stream of data that is compacted by said encoder;
• second error detecting means connected to an output of said decoder for generating a second integrity code representative of the decompacted data from said decoder;
• and
• means for comparing said first and second integrity codes and for generating an error signal if said first and second integrity codes are not the same;
• whereby the data compacted by said encoder is immediately decompacted by said decoder for checking the integrity of the compacted data.

An information processing system for processing an input stream of data from a first unit and including a plurality of parallel and sequentially connected data processing units said stream of data including a first data integrity code, each of the data processing units comprising:

• first error detecting means connected to receive the stream of data distributed to all data processing units for generating a first integrity code representative of the stream of data;
• a first storage device for accepting and storing a set of data from the stream of data;
• a first event counter for counting a certain number of bytes received by said storage device to form the set of data by controlling the amount of data received by said storage device;
• a first interface control controlled by said first event counter which when reaching the count of the set of data for activating the next sequentially connected data processing unit signals that this data processing unit has received its set of data and that the next data processing unit should receive its set of data;
• an encoder connected to said first storage device for compacting the set of data from the first storage device and for adding an end of set signal;
• a decoder connected to receive the compacted sets of data compacted by said encoder for decompacting the compacted set of data;
• second error detection means connected to receive the set of data directed to an input of said encoder for generating a second integrity code representative of the sets of data transmitted to said encoder;
• third error detection means connected to an output of said decoder for generating a third integrity code representative of the decompacted data from said decoder;
• first comparing means for comparing said second and third integrity codes and for generating an error signal if no match is made;
• said third error detection means further directs the data compacted by said encoder that generates said third integrity code to said decoder for immediate decompaction;
• fourth error detection means connected to the output of said encoder for generating a fourth integrity code representative of the compacted data compacted by said encoder;
• a second storage device for accepting and storing the compacted set of data from said encoder of said compaction system;
• a second event counter for determining when the entire set of data has been compacted by said encoder by sensing the end of set signal;
• a second interface control controlled by said second event counter for determining that the set of data has been compacted and for transmitting the compacted set of data from said second storage device when the second interface control is activated by said second event counter sensing the end of said signal and for signalling a subsequent data processing unit that it has transmitted its compacted set of data;
• means in the information processing system for combining in sequence the compacted sets of data stored in the second storage device from each of the data processing units;
• a third storage device in the information processing system connected to said combining means for receiving the compacted sets of data from all data processing units and for storing the sets of data in the same sequence as the set sequence extracted from the stream of data;
• transmitting means in the information processing system and connected to said third storage means for transmitting said stored sets of data to a utilization device;
• fifth error detecting means in the information processing system connected to said transmitting means for generating a fifth integrity code representative of the compacted data transmitted by said transmitting means;
• sixth error detecting means connected to said transmitting means to receive all of the compacted sets of data from all data processing units for generating a first sixth integrity code representative of the compacted sets of data said sixth error detecting means also connected to accept the compacted sets of data from said third storage means after transmission by said transmitting means for generating a second sixth integrity code representative of the compacted sets of data;
• second comparing means to compare the first data integrity code received with the input stream of data and the first integrity code of all processing units and for generating an error signal if not the same;
• third comparing means to compare said fourth and fifth integrity codes and for generating an error signal if not the same to verify that the compacted data before and after said second storage device is the same;
• fourth comparing means to compare said fifth and first sixth integrity codes and for generating an error signal if not the same to verify that the compacted data set has been transmitted to said third storage device and received correctly;
• seventh error detecting means connected to receive all of the compacted data sets transmitted to said third storage means from all data processing units for generating a seventh integrity code representative of the compacted data stored in said third storage means;
• and
• fifth comparing means for comparing said seventh integrity codes from each data processing unit and for generating an error signal if no match is made to verify that the compacted data from all data processing units has been received by said third storage means.

A data processing system for compressing a stream of data from a central processing unit for storage onto a media comprising:

• a control unit including adaptors for the transmission of data to and from the central processing unit under command control of the central processing unit, a command unit to process the command controls, a format control and a plurality of parallel and sequentially connected compression/decompression units;
• and
• a device including a drive for transporting the media past a transducer, a motion control under control of said command unit for controlling said drive, and a data control for activating the transducer to write data onto the media and for retrieving data from the media as the drive transports the media;
• each of compression/decompression units comprising:
• means for determining that a certain size section of data, one set of data, had been received by its unit;
• first storage means for storing the sets of data received;
• first signalling means controlled by said determining means for signalling the next sequentially connected unit that this unit has received its set of data and that the next unit should receive its set of data;
• an encoder connected to said first storage means for compacting each set of data received by said first storage means;
• a decoder connected to receive the compacted set of data compacted by said encoder for decompacting the compacted set of data;
• second storage means for storing the set of data compacted by said encoder;
• second signalling means for signalling that said second storage means is ready to transmit its compacted set of data;
• means in the information processing system for transmitting the compacted set of data stored in said second storage means for inclusion in sequence with the other compacted data from the plurality of parallel compression/decompression units;
• first error detection means connected to an input of said encoder for generating first integrity codes representative of the sets of data transmitted to said encoder;
• second error detection means connected to the output of said decoder for generating second integrity codes representative of the decompacted data from said decoder;
• and
• means for comparing said first and second integrity codes and for generating an error signal if said first and second integrity codes are not the same;
• said format control accepting the compressed sets of data and transmitting the compressed sets of data to said data control for writing the compressed data onto the media under control of said command unit;
• and
• said command unit activating said motion control to control said drive and activating said compaction system and said format control to process the write data flow from the adaptors through said compaction system, said format control and said data control to write the compressed data onto the media for storage thereon;
• whereby the data compacted by said encoder is immediately decompacted by said decoder for checking the integrity of the compacted data.

A data processing system for compressing a stream of data including a first data integrity code from a central processing unit for storage comprising:

• a control unit including adaptors for the transmission of data to and from the central processing unit under command control of the central processing unit, a command unit to process the command controls, a plurality of parallel and sequentially connected data processing units, and a format control;
• each of the data processing units comprising:
• first error detecting means connected to receive the stream of data from said adaptors and distributed to all data processing units for generating a first integrity code representative of the stream of data;
• a first storage device for accepting and storing a set of data from the stream of data;
• a first event counter for counting a certain number of bytes received by said storage device to form the set of data by controlling the amount of data received by said storage device;
• a first interface control controlled by said first event counter which when reaching the count of the set of data for activating the next sequentially connected data processing unit signals that this data processing unit has received its set of data and that the next data processing unit should receive its set of data;
• an encoder connected to said first storage device for compacting the set of data from the first storage device and for adding an end of set signal;
• a decoder connected to receive the compacted sets of data compacted by said encoder for decompacting the compacted set of data;
• second error detection means connected to receive the set of data directed to an input of said encoder for generating a second integrity code representative of the sets of data transmitted to said encoder;
• third error detection means connected to an output of said decoder for generating a third integrity code representative of the decompacted data from said decoder;
• first comparing means for comparing said second and third integrity codes and for generating an error signal if no match is made;
• said third error detection means further directs the data compacted by said encoder that generates said third integrity code to said decoder for immediate decompaction;
• fourth error detection means connected to the output of said encoder for generating a fourth integrity code representative of the compacted data compacted by said encoder;
• a second storage device for accepting and storing the compacted set of data from said encoder of said compaction system;
• a second event counter for determining when the entire set of data has been compacted by said encoder by sensing the end of set signal;
• a second interface control controlled by said second event counter for determining that the set of data has been compacted and for transmitting the compacted set of data from said second storage device when the second interface control is activated by said second event counter sensing the end of set signal and for signalling a subsequent data processing unit that it has transmitted its compacted set of data;
• said format control connected to said combining means and under control of said command control for preparing the compacted sets of data for storage;
• a third storage device in the data processing system connected to said format control means and under control of said command control for receiving the compacted sets of data from all data processing units and for storing the sets of data in the same sequence as the set sequence extracted from the stream of data;
• fifth error detecting means connected to an output of second storage device for generating a fifth integrity code;
• sixth error detecting means connected to said third storage means to receive all of the compacted sets of data from all data processing units for generating a first and a second sixth integrity code representative of the compacted sets of data;
• second comparing means to compare the first data integrity code received with the input stream of data and the first integrity code of all processing units and for generating an error signal if not the same;
• third comparing means to compare said fourth and fifth integrity codes and for generating an error signal if not the same to verify that the compacted data before and after said second storage device is the same;
• fourth comparing means to compare said fifth and first sixth integrity codes and for generating an error signal if not the same to verify that the compacted data set has been transmitted to said third storage device and received correctly;
• seventh error detecting means connected to receive all of the compacted data sets transmitted to said third storage means from all data processing units for generating a seventh integrity code representative of the compacted data stored in said third storage means;
• and
• fifth comparing means for comparing said seventh integrity codes from each data processing unit and for generating an error signal if no match is made to verify that the compacted data from all data processing units has been received by said third storage means;
• said command unit activating said data processing units, said format control and said third storage means to process the write data flow from the adaptors through said data processing units and said format control to write the compressed data into said third storage means.

A data processing system for compressing a stream of data from a central processing unit comprising:

• a control unit including adaptors for the transmission of data to and from the central processing unit under command control of the central processing unit, a command unit to process the command controls and a plurality of parallel and sequentially connected compression/decompression units;
• each of said compression/decompression units including:
• means for determining that a certain size section of data, one set of data, had been received by its unit;
• first storage means for storing the sets of data received;
• first signalling means controlled by said determining means for signalling the next sequentially connected unit that this unit has received its set of data and that the next unit should receive its set of data;
• an encoder connected to said first storage means for compacting each set of data received by said first storage means;
• a decoder connected to receive the compacted set of data compacted by said encoder for decompacting the compacted set of data;
• second storage means for storing the set of data compacted by said encoder;
• second signalling means for signalling that said second storage means is ready to transmit its compacted set of data;
• means in the information processing system for combining the compacted set of data stored in said second storage means for inclusion in sequence from the other compacted data from the plurality of parallel compression/decompression units;
• first error detection means connected to an input of said encoder for generating first integrity codes representative of the sets of data transmitted to said encoder;
• second error detection means connected to the output of said decoder for generating second integrity codes representative of the decompacted data from said decoder;
• and
• means for comparing said first and second integrity codes and for generating an error signal if said first and second integrity codes are not the same;
• whereby said adaptors receive a stream of data and command controls from the central processing unit and said command unit is responsive thereto to direct the stream of data to said determining means of said compression/decompression unit;
• and
• whereby the stream of data compacted by said encoder is immediately decompacted by said decoder for checking the integrity of the compacted data.

A data processing system for compressing a stream of data from a central processing unit for storage onto a media comprising:

• a control unit including channel adaptors for the transmission of data to and from the central processing unit under command control of the central processing unit, a command unit to process the command controls, a plurality of parallel and sequentially connected data processing units and a format control, said stream of data including a first data integrity code;
• and
• a device including a drive for transporting the media past a transducer, a motion control under control of said command unit for controlling said drive, and a data control to activate the transducer to write data onto the media and to retrieve data from the media as the drive transports the media;
• each of said data processing units including:
• first error detecting means connected to receive the stream of data distributed to all data processing units for generating a first integrity code representative of the stream of data;
• a first storage device for accepting and storing a set of data from the stream of data;
• a first event counter for counting a certain number of bytes received by said storage device to form the set of data by controlling the amount of data received by said storage device;
• a first interface control controlled by said first event counter which when reaching the count of the set of data for activating the next sequentially connected data processing unit signals that this data processing unit has received its set of data and that the next data processing unit should receive its set of data;
• an encoder connected to said first storage device for compacting the set of data from the first storage device and for adding an end of set signal;
• a decoder connected to receive the compacted sets of data compacted by said encoder for decompacting the compacted set of data;
• second error detection means connected to receive the set of data directed to an input of said encoder for generating a second integrity code representative of the sets of data transmitted to said encoder;
• third error detection means connected to an output of said decoder for generating a third integrity code representative of the decompacted data from said decoder;
• first comparing means for comparing said second and third integrity codes and for generating an error signal if no match is made;
• said third error detection means further directs the data compacted by said encoder that generates said third integrity code to said decoder for immediate decompaction;
• fourth error detection means connected to the output of said encoder for generating a fourth integrity code representative of the compacted data compacted by said encoder;
• a second storage device for accepting and storing the compacted set of data from said encoder of said compaction system;
• a second event counter for determining when the entire set of data has been compacted by said encoder by sensing the end of set signal;
• a second interface control controlled by said second event counter for determining that the set of data has been compacted and for transmitting the compacted set of data from said second storage device when the second interface control is activated by said second event counter sensing the end of set signal and for signalling a subsequent data processing unit that it has transmitted its compacted set of data;
• means in the data processing system for combining in sequence the compacted set of data from each of the second storage device in each data processing units;
• said format control receiving the compacted sets of data from said combining means and transmitting the compacted sets of data to said data control for writing the compacted sets of data onto the media under control of said command units;
• fifth error detecting means connected to an output of said second storage device for generating a fifth integrity code representative of the compacted data transmitted to said format control;
• sixth error detecting means connected to said combining means to receive all of the compacted sets of data from all data processing units for generating a first sixth integrity code representative of the compacted sets of data;
• said sixth error detecting means also connected to accept the compacted sets of data from said media after transmission by said transmitting means for generating a second sixth integrity code representative of the compacted sets of data;
• second comparing means to compare the first data integrity code received with the input stream of data and the first integrity code of all processing units and for generating an error signal if not the same;
• third comparing means to compare said fourth and fifth integrity codes and for generating an error signal if not the same to verify that the compacted data before and after said second storage device is the same;
• fourth comparing means to compare said fifth and first sixth integrity codes and for generating an error signal if not the same to verify that the compacted data set has been transmitted to said third storage device and received correctly;
• seventh error detecting means connected to receive all of the compacted data sets transmitted to said third storage means from all data processing units for generating a seventh integrity code representative of the compacted data stored in said third storage means;
• and
• fifth comparing means for comparing said seventh integrity codes from each data processing unit and for generating an error signal if no match is made to verify that the compacted data from all data processing units has been received by the media;
• said command unit activating said motion control to control said drive and activating said data processing units and said format control to process the write data flow from the adaptors through said data processing units, said format control, and said data control to write the compressed data onto the media for storage thereon.

A data processing system for compressing a stream of data including a first data integrity code for storage comprising:

• an adaptor operational for receiving data and commands, a command unit to process the commands, a plurality of parallel and sequentially connected data processing units, and a format control;
• each of the data processing units comprising:
• first error detecting means connected to receive the stream of data from said adaptors and distributed to all data processing units for generating a first integrity code representative of the stream of data;
• a first storage device for accepting and storing a set of data from the stream of data;
• a first event counter for counting a certain number of bytes received by said storage device to form the set of data by controlling the amount of data received by said storage device;
• a first interface control controlled by said first event counter which when reaching the count of the set of data for activating the next sequentially connected data processing unit signals that this data processing unit has received its set of data and that the next data processing unit should receive its set of data;
• an encoder connected to said first storage device for compacting the set of data from the first storage device and for adding an end of set signal;
• a decoder connected to receive the compacted sets of data compacted by said encoder for decompacting the compacted set of data;
• second error detection means connected to receive the set of data directed to an input of said encoder for generating a second integrity code representative of the sets of data transmitted to said encoder;
• third error detection means connected to an output of said decoder for generating a third integrity code representative of the decompacted data from said decoder;
• first comparing means for comparing said second and third integrity codes and for generating an error signal if no match is made;
• said third error detection means further directs the data compacted by said encoder that generates said third integrity code to said decoder for immediate decompaction;
• fourth error detection means connected to the output of said encoder for generating a fourth integrity code representative of the compacted data compacted by said encoder;
• a second storage device for accepting and storing the compacted set of data from said encoder of said compaction system;
• a second event counter for determining when the entire set of data has been compacted by said encoder by sensing the end of set signal;
• a second interface control controlled by said second event counter for determining that the set of data has been compacted and for transmitting the compacted set of data from said second storage device when the second interface control is activated by said second event counter sensing the end of set signal and for signalling a subsequent data processing unit that it has transmitted its compacted set of data;
• said format control connected to said combining means and under control of said command control for preparing the compacted sets of data for storage;
• a third storage device in the data processing system connected to said format control means and under control of said command control for receiving the compacted sets of data from all data processing units and for storing the sets of data in the same sequence as the set sequence extracted from the stream of data;
• fifth error detecting means connected to an output of second storage device for generating a fifth integrity code;
• sixth error detecting means connected to said third storage device to receive all of the compacted sets of data from all data processing units for generating a first and second sixth integrity code representative of the compacted sets of data;
• second comparing means to compare the first data integrity code received with the input stream of data and the first integrity code of all processing units and for generating an error signal if not the same;
• third comparing means to compare said fourth and fifth integrity codes and for generating an error signal if not the same to verify that the compacted data before and after said second storage device is the same;
• fourth comparing means to compare said fifth and first sixth integrity codes and for generating an error signal if not the same to verify that the compacted data set has been transmitted to said third storage device and received correctly;
• seventh error detecting means connected to receive all of the compacted data sets transmitted to said third storage means from all data processing units for generating a seventh integrity code representative of the compacted data stored in said third storage means;
• and
• fifth comparing means for comparing said seventh integrity codes from each data processing unit and for generating an error signal if no match is made to verify that the compacted data from all data processing units has been received by said third storage means;
• said command unit activating said data processing units, said format control and said third storage means to process the write data flow from the adaptor through said data processing units and said format control to write the compressed data into said third storage means.

A data processing system for compressing a stream of data comprising:

• an adaptor operational to receive data and commands, a command unit to process the commands and a plurality of parallel and sequentially connected compression/decompression units;
• each of said compression/decompression units including:
• means for determining that a certain size section of data, one set of data, had been received by its unit;
• first storage means for storing the sets of data received;
• first signalling means controlled by said determining means for signalling the next sequentially connected unit that this unit has received its set of data and that the next unit should receive its set of data;
• an encoder connected to said first storage means for compacting each set of data received by said first storage means;
• a decoder connected to receive the compacted set of data compacted by said encoder for decompacting the compacted set of data;
• second storage means for storing the set of data compacted by said encoder;
• second signalling means for signalling that said second storage means is ready to transmit its compacted set of data;
• means in the data processing system for combining the compacted set of data stored in said second storage means for inclusion in sequence from the other compacted data from the plurality of parallel compression/decompression units;
• first error detection means connected to an input of said encoder to obtain first integrity codes representative of the sets of data transmitted to said encoder;
• second error detection means connected to the output of said decoder to obtain second integrity codes representative of the decompacted data from said decoder;
• and
• means for comparing said first and second integrity codes;
• whereby said adaptor receives a stream of data and commands and said command unit is responsive thereto to direct the stream of data to said determining means of said compression/decompression unit;
• and
• whereby the stream of data compacted by said encoder is immediately decompacted by said decoder for checking the integrity of the compacted data.

A data processing system for compressing a stream of data for storage onto a media comprising:

• an adaptor operational to receive data and commands, a command unit to process the commands, a plurality of parallel and sequentially connected data processing units, and a format control, said stream of data including a first data integrity code;
• and
• a device including a drive for transporting the media past a transducer, a motion control under control of said command unit for controlling said drive, and a data control to activate the transducer to write data onto the media and to retrieve data from the media as the drive transports the media;
• each of said data processing units including:
• first error detecting means connected to receive the stream of data distributed to all data processing units to obtain a first integrity code representative of the stream of data;
• a first storage device for accepting and storing a set of data from the stream of data;
• a first event counter for counting a certain number of bytes received by said storage device to form the set of data by controlling the amount of data received by said storage device;
• a first interface control controlled by said first event counter which when reaching the count of the set of data for activating the next sequentially connected data processing unit signals that this data processing unit has received its set of data and that the next processing unit should receive its set of data;
• an encoder connected to said first storage device for compacting the set of data from the first storage device and for adding an end of set signal;
• a decoder connected to receive the compacted sets of data compacted by said encoder for decompacting the compacted set of data;
• second error detection means connected to receive the set of data directed to an input of said encoder for generating a second integrity code representative of the sets of data transmitted to said encoder;
• third error detection means connected to an output of said decoder for generating a third integrity code representative of the decompacted data from said decoder;
• first comparing means for comparing said second and third integrity codes and for generating an error signal if no match is made;
• said third error detection means further directs the data compacted by said encode that generates said third integrity code to said decoder for immediate decompaction;
• fourth error detection means connected to the output of said encoder to obtain a fourth integrity code representative of the compacted data compacted by said encoder;
• a second storage device for accepting and storing the compacted set of data from said encoder of said compaction system;
• a second event counter for determining when the entire set of data has been compacted by said encoder by sensing the end of set signal;
• a second interface control controlled by said second event counter for determining that the set of data has been compacted and for transmitting the compacted set of data from said second storage device when the second interface control is activated by said second event counter sensing the end of said signal and for signalling a subsequent data processing unit that it has transmitted its compacted set of data;
• means in the data processing system for combining in sequence the compacted set of data stored in the second storage device in each of the data processing units;
• said format control receiving the compacted sets of data from said combining means and transmitting the compacted sets of data to said data control for writing the compacted sets of data onto the media under control of said command units;
• fifth error detecting means connected to an output of second storage device for generating a fifth integrity code representative of the compacted data transmitted to said format control;
• sixth error detecting means connected to said combining means to receive all of the compacted sets of data from all data processing units for generating a first sixth integrity code representative of the compacted sets of data;
• said sixth error detecting means also connected to accept the compacted sets of data from said media after transmission by said transmitting means for generating a second sixth integrity code representative of the compacted sets of data;
• second comparing means to compare the first data integrity code received with the input stream of data and the first integrity code of all processing units and for generating an error signal if not the same;
• third comparing means to compare said fourth and fifth integrity codes and for generating an error signal if not the same to verify that the compacted data before and after said second storage device is the same;
• fourth comparing means to compare said fifth and first sixth integrity codes and for generating an error signal if not the same to verify that the compacted data set has been transmitted to said third storage device and received correctly;
• seventh error detecting means connecting to receive all of the compacted data sets transmitted to said third storage means from all data processing units for generating a seventh integrity code representative of the compacted data stored in said third storage means;
• and
• fifth comparing means for comparing said seventh integrity codes from each data processing unit and for generating an error signal if no match is made to verify that the compacted data from all data processing units has been received by the media;
• said command unit activating said motion control to control said drive and activating said data processing units and said format control to process the write data flow from the adaptors through said data processing units, said format control, and said data control to write the compressed data onto the media for storage thereon.