System and method for management of compressed sequencing files
AssigneePersonalis, Inc.
InventorAlexander Halley Stram
Life of this patent
Estimating the term…
Abstract
Systems and methods for management of storing and analyzing genetic sequencing data. In some embodiments disclosed herein, a method for converting a compressed SAM file back into a raw FASTQ file, wherein the information of the raw FASTQ file is substantively identical to that which was stored in the original FASTQ file from which the compressed SAM file is based is provided. The method advantageously enables storage of the smaller compressed SAM files for reliable, efficient reconstruction of the original FASTQ file when needed.
Claims20
A method of regenerating a FASTQ file from a compressed sequence alignment map file, the compressed sequence alignment map file including alignment data for a plurality of sequence strings for more than one aligned reads of clusters on a flow cell, the method comprising:
- (a) determining an fqsum of an original FASTQ file on which the compressed sequence alignment file is based, wherein each entry of the original FASTQ file is defined by at least four line-separated fields per sequence and the fqsum represents an order invariant checksum of the original FASTQ file;
- (b) storing a quality score of each base call for individual instances of the plurality of sequence strings;
- (c) sorting the compressed sequence alignment map file by one or more reference genome coordinates;
- (d) extracting primary alignments from the compressed sequence alignment map file;
- (e) ensuring all FASTQ records from the original FASTQ file are stored in the compressed SAM file;
- (f) reconstructing original base quality scores by at least one of retrieving the stored quality score or applying an inverse of a model of the stored quality score;
- (g) writing at least three of the four line-separated fields per sequence of the compressed sequence alignment map file to a regenerated FASTQ file;
- and
- (h) compressing the regenerated FASTQ file.
A method of regenerating a FASTQ file from a compressed sequence alignment map file, the compressed sequence alignment map file including alignment data for a plurality of sequence strings for more than one aligned reads of clusters on a flow cell, the method comprising:
- (a) determining an fqsum of an original FASTQ file on which the compressed sequence alignment file is based, wherein each entry of the original FASTQ file is defined by at least four line-separated fields per sequence and the fqsum represents an order invariant checksum of the original FASTQ file;
- (b) storing a quality score of each base call for individual instances of the plurality of sequence strings;
- (c) sorting the compressed sequence alignment map file by sequence string;
- (d) extracting primary alignments from the compressed sequence alignment map file;
- (e) ensuring all FASTQ records from the original FASTQ file are stored in the compressed SAM file;
- (f) reconstructing original base quality scores by at least one of retrieving the stored quality score or applying an inverse of a model of the stored quality score;
- (g) writing at least three of the four line-separated fields per sequence of the compressed sequence alignment map file to a regenerated FASTQ file;
- and
- (h) compressing the regenerated FASTQ file.
A computer program product for regenerating a FASTQ file from a compressed sequence alignment map file, the compressed sequence alignment map file including alignment data for a plurality of sequence strings for more than one aligned reads of clusters on a flow cell, the computer program product being encoded on one or more machine-readable storage media and comprising instructions for:
- (i) determining an fqsum of an original FASTQ file on which the compressed sequence alignment file is based, wherein each entry of the original FASTQ file is defined by at least four line-separated fields per sequence and the fqsum represents an order invariant checksum of the original FASTQ file;
- (ii) storing a quality score of each base call for individual instances of the plurality of sequence strings;
- (iii) sorting the compressed sequence alignment map file by one or more reference genome coordinates;
- (iv) extracting primary alignments from the compressed sequence alignment map file;
- (v) ensuring all FASTQ records from the original FASTQ file are stored in the compressed SAM file;
- (vi) reconstructing original base quality scores by at least one of retrieving the stored quality score or applying an inverse of a model of the stored quality score;
- (vii) writing at least three of the four line-separated fields per sequence of the compressed sequence alignment map file to a regenerated FASTQ file;
- and
- (viii) compressing the regenerated FASTQ file.
Dependencies are inferred from the claim text.