Tape drive library integrated memory deduplication

A computer program product, comprising a computer readable hardware storage device storing a computer readable program code, said computer readable program code comprising an algorithm that when executed by a processor of a storage tape drive hardware device implements a tape drive memory storage improvement method, said method comprising:

• receiving, by said processor, a data stream for storage, wherein said storage tape drive hardware device is comprised by a storage tape drive hardware library system comprising a plurality of storage tape drive hardware devices, and wherein said storage tape drive hardware device internally comprises a deduplication software engine, a non-volatile memory device (NVS1), a non-volatile memory device (NVS2), and a first data storage tape cartridge;
• identifying, by said processor within said NVS2, duplicate data chunks of a plurality of adjacent variable length data chunks of said data stream, wherein said duplicate data chunks comprise duplicated data with respect to a first group of data chunks of said plurality of adjacent variable length data chunks;
• deleting, by said processor from said NVS2, said duplicate data chunks such that said first group of data chunks remain within said NVS2;
• writing, by said processor to a first data storage tape cartridge of said storage tape drive hardware device, said first group of data chunks;
• generating, by said processor for storage with said first data storage tape cartridge, pointers associated with a location within said NVS1 storing de-duplication hashes identifying each data chunk of said first group of data chunks stored within said first data storage tape cartridge;
• writing, by said processor from said NVS1 to a manager non-volatile memory device (MNVS) of said storage tape drive hardware library system, said de-duplication hashes;
• and
• updating, by said processor, said MNVS by combining said de-duplication hashes with a plurality of additional de-duplication hashes identifying a plurality of commonly used de-duplicated data chunks stored within said plurality of storage tape drive hardware devices.

A storage tape drive hardware device comprising a processor coupled to a computer-readable memory unit, said memory unit comprising instructions that when executed by the processor implements a tape drive memory storage improvement method comprising:

• receiving, by said processor, a data stream for storage, wherein said storage tape drive hardware device is comprised by a storage tape drive hardware library system comprising a plurality of storage tape drive hardware devices, and wherein said storage tape drive hardware device internally comprises a deduplication software engine, a non-volatile memory device (NVS1), a non-volatile memory device (NVS2), and a first data storage tape cartridge;
• identifying, by said processor within said NVS2, duplicate data chunks of a plurality of adjacent variable length data chunks of said data stream, wherein said duplicate data chunks comprise duplicated data with respect to a first group of data chunks of said plurality of adjacent variable length data chunks;
• deleting, by said processor from said NVS2, said duplicate data chunks such that said first group of data chunks remain within said NVS2;
• writing, by said processor to a first data storage tape cartridge of said storage tape drive hardware device, said first group of data chunks;
• generating, by said processor for storage with said first data storage tape cartridge, pointers associated with a location within said NVS1 storing de-duplication hashes identifying each data chunk of said first group of data chunks stored within said first data storage tape cartridge;
• writing, by said processor from said NVS1 to a manager non-volatile memory device (MNVS) of said storage tape drive hardware library system, said de-duplication hashes;
• and
• updating, by said processor, said MNVS by combining said de-duplication hashes with a plurality of additional de-duplication hashes identifying a plurality of commonly used de-duplicated data chunks stored within said plurality of storage tape drive hardware devices.