# US 2019/0318806 A1 · Variant Classifier Based on Deep Neural Networks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318806 A1
- Document ID: US20190318806A1
- Status: Published application
- Kind: A1
- Application number: 16/383,464
- Filed: 2019-04-12
- Published: 2019-10-17
- Earliest claimed: 2018-04-12
- Assignees: Illumina, Inc.
- Applicants: Illumina, Inc.
- Inventors: Aaron WISE; Kristina M. KRUGLYAK
- Web page: https://patentgrep.com/patent/US20190318806A1

## CPC

- G16B 20/20: Allele or variant detection, e.g. single nucleotide polymorphism [SNP] detection
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/048: Activation functions
- G06N 3/09: Supervised learning
- G06N 3/096: Transfer learning
- G16B 30/10: Sequence alignment; Homology search
- G16B 40/20: Supervised data analysis
- G16B: BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

We introduce a variant classifier that uses trained deep neural networks to predict whether a given variant is somatic or germline. Our model has two deep neural networks: a convolutional neural network (CNN) and a fully-connected neural network (FCNN), and two inputs: a DNA sequence with a variant and a set of metadata features correlated with the variant. The metadata features represent the variant's mutation characteristics, read mapping statistics, and occurrence frequency. The CNN processes the DNA sequence and produces an intermediate convolved feature. A feature sequence is derived by concatenating the metadata features with the intermediate convolved feature. The FCNN processes the feature sequence and produces probabilities for the variant being somatic, germline, or noise. A transfer learning strategy is used to train the model on two mutation datasets. Results establish advantages and superiority of our model over traditional classifiers.

## Claims

### Claim 1

A neural network-implemented system, comprising:
a variant classifier, running on one or more processors operating in parallel and coupled to memory, that has
a convolutional neural network having at least two convolution layers and each of the convolution layers having at least five convolution filters trained over one thousand to millions of gradient update iterations to
process an input sequence with a variant at a target position flanked by at least ten bases on each side, and
produce an intermediate convolved feature;
a metadata correlator that correlates the variant with a set of metadata features which represent
mutation characteristics of the variant,
read mapping statistics of the variant, and
occurrence frequency of the variant; and
a fully-connected neural network having at least two fully-connected layers trained over the one thousand to millions of gradient update iterations to
process a feature sequence derived from a combination of the intermediate convolved feature and the metadata features, and
output classification scores for likelihood that the variant is a somatic variant, a germline variant, or noise.

### Claim 2 (depends on 1)

The neural network-implemented system of claim 1, wherein the metadata correlator is further configured to correlate the variant with an amino acid impact feature that specifies whether the variant is a nonsynonymous variant that changes a codon so as to produce a new codon which codes for a different amino acid.

### Claim 3 (depends on 1)

The neural network-implemented system of claim 1, wherein the metadata correlator is further configured to correlate the variant with a variant type feature that specifies type whether the variant is a single-nucleotide polymorphism, an insertion, or a deletion.

### Claim 4 (depends on 1)

The neural network-implemented system of claim 1, wherein the metadata correlator is further configured to correlate the variant with a read mapping statistic feature that specifies quality parameters of read mapping that identified the variant.

### Claim 5 (depends on 1)

The neural network-implemented system claim 1, wherein the metadata correlator is further configured to correlate the variant with a population frequency feature that specifies allele frequencies of the variant in sequenced populations.

### Claim 6 (depends on 1)

The neural network-implemented system of claim 1, wherein the metadata correlator is further configured to correlate the variant with a sub-population frequency feature that specifies allele frequencies of the variant in ethnic sub-populations stratified from sequenced populations.

### Claim 7 (depends on 1)

The neural network-implemented system of claim 1, wherein the metadata correlator is further configured to correlate the variant with an evolutionary conservation feature that specifies conservativeness of the target position across multiple species.

### Claim 8 (depends on 1)

The neural network-implemented system of claim 1, wherein the metadata correlator is further configured to correlate the variant with a clinical significance feature that specifies the variant's clinical effect, drug sensitivity, and histocompatibility as determined from clinical tests.

### Claim 9 (depends on 1)

The neural network-implemented system of claim 1, wherein the metadata correlator is further configured to correlate the variant with a functional impact feature that specifies the variant's impact on functionality of a protein resulting from an amino acid substitution caused by the variant.

### Claim 10 (depends on 1)

The neural network-implemented system of claim 1, wherein the metadata correlator is further configured to correlate the variant with an ethnicity prediction feature that specifies likelihoods identifying ethnic makeup of an individual that provided a tumor sample associated with the variant.

### Claim 11 (depends on 1)

The neural network-implemented system of claim 1, wherein the metadata correlator is further configured to correlate the variant with a tumor frequency feature that specifies frequency of the variant in sequenced cancerous tumors.

### Claim 12 (depends on 1)

The neural network-implemented system of claim 1, wherein the metadata correlator is further configured to correlate the variant with an alternative allele feature that specifies at least one base mutated by the variant at the target position in a reference sequence.

### Claim 13 (depends on 1)

The neural network-implemented system of claim 1, wherein the convolutional neural network and the fully-connected neural network of the variant classifier are trained together end-to-end on five hundred thousand training examples from a first dataset of cancer-causing mutations, followed by training on fifty thousand training examples from a second dataset of cancer-causing mutations.

### Claim 14 (depends on 1)

The neural network-implemented system of claim 1, wherein the convolutional neural network and the fully-connected neural network of the variant classifier are tested together end-to-end on validation data held-out only from the second dataset.

### Claim 15 (depends on 1)

The neural network-implemented system of claim 1, wherein each of the convolution layers and the fully-connected layers is followed by at least one rectified linear unit layer.

### Claim 16 (depends on 1)

The neural network-implemented system of claim 1, wherein each of the convolution layers and the fully-connected layers are followed by at least one batch normalization layer.

### Claim 17 (depends on 1)

The neural network-implemented system of claim 1, wherein the variant is flanked by at least 19 bases on each side.

### Claim 18 (depends on 1)

The neural network-implemented system of claim 1, further configured to comprise a concatenator that derives the feature sequence by concatenating the intermediate feature with the metadata features.

### Claim 19 (depends on 1)

The neural network-implemented system of claim 1, wherein the metadata features are encoded in a one-dimensional array.

### Claim 20 (depends on 1)

The neural network-implemented system of claim 1, wherein the input sequence is encoded in an n-dimensional array, where n≥2.

### Claim 21 (depends on 1)

The neural network-implemented system of claim 1, wherein each of the convolution layers has at least six convolution filters.

### Claim 22

A neural network-implemented method of variant classification, including:
processing an input sequence through a convolutional neural network to produce an intermediate convolved feature, wherein
the convolutional neural network has at least two convolution layers and each of the convolution layers has at least five convolution filters trained over one thousand to millions of gradient update iterations, and
the input sequence has a variant at a target position flanked by at least ten bases on each side;
correlating the variant with a set of metadata features which represent
mutation characteristics of the variant,
read mapping statistics of the variant, and
occurrence frequency of the variant; and
processing a feature sequence through a fully-connected neural network to output classification scores for likelihood that the variant is a somatic variant, a germline variant, or noise, wherein
the fully-connected neural network has at least two fully-connected layers trained over the one thousand to millions of gradient update iterations, and
the feature sequence is derived from a combination of the intermediate convolved feature and the metadata features.

### Claim 23

A non-transitory computer readable storage medium impressed with computer program instructions to classify variants, the instructions, when executed on a processor, implement a method comprising:
processing an input sequence through a convolutional neural network to produce an intermediate convolved feature, wherein
the convolutional neural network has at least two convolution layers and each of the convolution layers has at least five convolution filters trained over one thousand to millions of gradient update iterations, and
the input sequence has a variant at a target position flanked by at least ten bases on each side;
correlating the variant with a set of metadata features which represent
mutation characteristics of the variant,
read mapping statistics of the variant, and
occurrence frequency of the variant; and
processing a feature sequence through a fully-connected neural network to output classification scores for likelihood that the variant is a somatic variant, a germline variant, or noise, wherein
the fully-connected neural network has at least two fully-connected layers trained over the one thousand to millions of gradient update iterations, and
the feature sequence is derived from a combination of the intermediate convolved feature and the metadata features.

### Claim 24

A neural network-implemented system, comprising:
a variant classifier, running on one or more processors operating in parallel and coupled to memory, that has
a convolutional neural network trained to process an input sequence and produce an intermediate convolved feature, wherein
the convolutional neural network has at least two convolution layers and each of the convolution layers has at least five convolution filters trained over one thousand to millions of gradient update iterations,
the input sequence has a variant at a target position flanked by at least ten bases on each side and has a set of metadata features correlated with the variant, and
the metadata features represent (A) mutation characteristics of the variant including at least three of (i) a chromosome feature specifying a chromosome on which a DNA segment spanning the variant occurs, (ii) an alternative allele feature specifying at least one base mutated by the variant at the target position, (iii) a mutation type feature specifying whether the variant is a single-nucleotide variant, an insertion or a deletion, (iv) a functional impact feature specifying an impact of the variant on functionality of a protein resulting from an amino acid substitution caused by the variant and (vi) a clinical significant feature specifying a clinical effect, a drug sensitivity and a histocompatibility of the variant, (B) read mapping statistics of the variant including at least two of (i) an allele frequency of the variant, (ii) a read depth of the variant, (iii) a base call quality score of the variant, (iv) a read number of the variant, and (C) occurrence frequency of the variant including at least one of (i) a tumor frequency specifying a frequency of the variant in sequenced cancerous tumors and (ii) a sub-population frequency specifying allele frequencies of the variant in ethnic sub-populations stratified from sequenced populations; and
a fully-connected neural network trained to process the intermediate convolved feature and output classification scores for likelihood that the variant is a somatic variant, a germline variant, or noise, wherein
the fully-connected neural network has at least two fully-connected layers trained over the one thousand to millions of gradient update iterations.

### Claim 25 (depends on 24)

The neural network-implemented system of claim 24, further configured to comprise a metadata correlator that correlates the variant with the metadata features.

### Claim 26

A neural network-implemented method of variant classification, including:
processing an input sequence through a convolutional neural network to produce an intermediate convolved feature, wherein
the convolutional neural network has at least two convolution layers and each of the convolution layers has at least five convolution filters trained over one thousand to millions of gradient update iterations,
the input sequence has a variant at a target position flanked by at least ten bases on each side and has a set of metadata features correlated with the variant, and
the metadata features represent (A) mutation characteristics of the variant including at least three of (i) a chromosome feature specifying a chromosome on which a DNA segment spanning the variant occurs, (ii) an alternative allele feature specifying at least one base mutated by the variant at the target position, (iii) a mutation type feature specifying whether the variant is a single-nucleotide variant, an insertion or a deletion, (iv) a functional impact feature specifying an impact of the variant on functionality of a protein resulting from an amino acid substitution caused by the variant and (vi) a clinical significant feature specifying a clinical effect, a drug sensitivity and a histocompatibility of the variant, (B) read mapping statistics of the variant including at least two of (i) an allele frequency of the variant, (ii) a read depth of the variant, (iii) a base call quality score of the variant, (iv) a read number of the variant, and (C) occurrence frequency of the variant including at least one of (i) a tumor frequency specifying a frequency of the variant in sequenced cancerous tumors and (ii) a sub-population frequency specifying allele frequencies of the variant in ethnic sub-populations stratified from sequenced populations; and
processing the intermediate convolved feature through a fully-connected neural network to output classification scores for likelihood that the variant is a somatic variant, a germline variant, or noise, wherein
the fully-connected neural network has at least two fully-connected layers trained over the one thousand to millions of gradient update iterations.

### Claim 27

A non-transitory computer readable storage medium impressed with computer program instructions to classify variants, the instructions, when executed on a processor, implement a method comprising:
processing an input sequence through a convolutional neural network to produce an intermediate convolved feature, wherein
the convolutional neural network has at least two convolution layers and each of the convolution layers has at least five convolution filters trained over one thousand to millions of gradient update iterations,
the input sequence has a variant at a target position flanked by at least ten bases on each side and has a set of metadata features correlated with the variant, and
the metadata features represent (A) mutation characteristics of the variant including at least three of (i) a chromosome feature specifying a chromosome on which a DNA segment spanning the variant occurs, (ii) an alternative allele feature specifying at least one base mutated by the variant at the target position, (iii) a mutation type feature specifying whether the variant is a single-nucleotide variant, an insertion or a deletion, (iv) a functional impact feature specifying an impact of the variant on functionality of a protein resulting from an amino acid substitution caused by the variant and (vi) a clinical significant feature specifying a clinical effect, a drug sensitivity and a histocompatibility of the variant, (B) read mapping statistics of the variant including at least two of (i) an allele frequency of the variant, (ii) a read depth of the variant, (iii) a base call quality score of the variant, (iv) a read number of the variant, and (C) occurrence frequency of the variant including at least one of (i) a tumor frequency specifying a frequency of the variant in sequenced cancerous tumors and (ii) a sub-population frequency specifying allele frequencies of the variant in ethnic sub-populations stratified from sequenced populations; and
processing the intermediate convolved feature through a fully-connected neural network to output classification scores for likelihood that the variant is a somatic variant, a germline variant, or noise, wherein
the fully-connected neural network has at least two fully-connected layers trained over the one thousand to millions of gradient update iterations.
