# US 2021/0174909 A1 · Generative machine learning models for predicting functional protein sequences

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174909 A1
- Document ID: US20210174909A1
- Status: Published application
- Kind: A1
- Application number: 17/118,447
- Filed: 2020-12-10
- Published: 2021-06-10
- Earliest claimed: 2019-12-10
- Assignees: Homodeus, Inc.
- Applicants: Homodeus, Inc.
- Inventors: Jonathan M. Rothberg; Zhizhuo Zhang; Spencer Glantz
- Web page: https://patentgrep.com/patent/US20210174909A1

## CPC

- G16B 40/00: ICT specially adapted for biostatistics; ICT specially adapted for bioinformatics-related machine learning or data mining, e.g. knowledge discovery or pattern finding
- C12N 15/1058: {Directional evolution of libraries, e.g. evolution of libraries is achieved by mutagenesis and screening or selection of mixed population of organisms}
- C12N 15/1089: {Design, preparation, screening or analysis of libraries using computer algorithms}
- G16B 35/10: Design of libraries
- G16B: BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
- C12N: MICROORGANISMS OR ENZYMES; COMPOSITIONS THEREOF; PROPAGATING, PRESERVING, OR MAINTAINING MICROORGANISMS; MUTATION OR GENETIC ENGINEERING; CULTURE MEDIA (microbiological testing media C12Q1/00)

## Abstract

The present disclosure provides, in some embodiments, techniques for using generative machine learning models to generate new functional protein sequences based on an input protein structure, such that the new functional protein sequences are structurally similar to the input protein structure but have new and diverse protein sequences. The techniques described herein may be used alone, or in conjunction with structural prediction algorithms and/or to generate diversified gene libraries in directed evolution techniques.

## Claims

### Claim 1

A system for generating multiple diverse candidate protein sequences based on an input protein structure, the system comprising:
at least one hardware processor; and
at least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform:
receiving the input protein structure;
accessing a set of known protein sequences having protein structures similar to the input protein structure;
accessing a generative machine learning model configured to generate a candidate protein sequence upon receiving a protein structure as input; and
generating multiple diverse candidate protein sequences by repeatedly:
providing the input protein structure to the generative machine learning model as input, in order to generate a resulting candidate protein sequence;
conditionally determining whether to include or exclude the resulting candidate protein sequence from the multiple diverse candidate protein sequences, based at least on a metric of similarity between the resulting candidate protein sequence and the set of known protein sequences.

### Claim 2 (depends on 1)

The system of claim 1, wherein conditionally determining whether to include or exclude the resulting candidate protein sequence comprises determining to exclude the resulting candidate protein sequence if the metric of similarity between the resulting candidate protein sequence and the set of known protein sequences is above a threshold.

### Claim 3 (depends on 1)

The system of claim 1, wherein the metric of similarity is an identity percentage.

### Claim 4 (depends on 1)

The system of claim 1, wherein the set of known protein sequences having protein structures similar to the input protein structure comprises protein sequences having protein structures with a root-mean-square deviation from the input protein structure below a threshold.

### Claim 5 (depends on 1)

The system of claim 1, wherein the generating multiple diverse candidate protein sequences is repeated until a set number of diverse candidate protein sequences are generated.

### Claim 6 (depends on 1)

The system of claim 1, wherein the input protein structure is an experimentally-determined protein structure.

### Claim 7 (depends on 1)

The system of claim 1, wherein the input protein structure is an output of a structural prediction algorithm.

### Claim 8

A method of training a generative machine learning model to generate multiple candidate protein sequences, wherein at least one protein sequence of the multiple candidate protein sequences has a protein structure similar to a primary input protein structure, and wherein the at least one protein sequence differs from a set of known protein sequences having protein structures similar to the primary input protein structure, the method comprising using computer hardware to perform:
accessing a plurality of target protein sequences, wherein each target protein sequence of the plurality of target protein sequences represents a target training output of the generative machine learning model;
accessing a plurality of input protein structures, wherein each input protein structure of the plurality of input protein structures corresponds to a target protein sequence of the plurality of target protein sequences and represents an input to the generative machine learning model for a corresponding target training output; and
training the generative machine learning model using the plurality of target protein sequences and the plurality of input protein structures, to obtain the trained generative machine learning model.

### Claim 9 (depends on 8)

The method of claim 8, further comprising using computer hardware to perform:
accessing the primary input protein structure;
providing the primary input protein structure as input to the trained generative machine learning model; and
generating the multiple candidate protein sequences.

### Claim 10 (depends on 9)

The method of claim 9, further comprising using computer hardware to perform:
based on the multiple candidate protein sequences, producing a library of protein sequences for use in a directed protein evolution process.

### Claim 11 (depends on 9)

The method of claim 9, further comprising using computer hardware to perform:
filtering the multiple candidate protein sequences, wherein filtering the multiple candidate protein sequences comprises:
determining a metric of similarity between a candidate protein sequence of the multiple candidate protein sequences and a known protein sequence of the set of known protein sequences having protein structures similar to the primary input protein structure; and
conditionally excluding the candidate protein sequence from the multiple candidate protein sequences based on the determined metric of similarity.

### Claim 12 (depends on 11)

The method of claim 11, wherein conditionally excluding the candidate protein sequence from the multiple candidate protein sequences based on the determined metric of similarity comprises:
excluding the candidate protein sequence if the determined metric of similarity is above a threshold.

### Claim 13 (depends on 11)

The method of claim 11, wherein filtering the multiple candidate protein sequences is performed repeatedly in conjunction with generating the multiple candidate protein sequences.

### Claim 14 (depends on 11)

The method of claim 11, wherein filtering the multiple candidate protein sequences is performed repeatedly in conjunction with generating the multiple candidate protein sequences, until a count of the multiple candidate protein sequences is above a threshold.

### Claim 15 (depends on 8)

The method of claim 8, wherein the generative machine learning model comprises:
an encoding phase;
a sampling phase; and
a decoding phase.

### Claim 16 (depends on 15)

The method of claim 15, wherein the encoding phase and decoding phase utilize one or more residual networks.

### Claim 17 (depends on 8)

The method of claim 8, wherein the primary input protein structure and the plurality of input structures comprise information representing a three-dimensional protein backbone structure.

### Claim 18 (depends on 17)

The method of claim 17, wherein the information representing the three-dimensional protein backbone structure is a list of torsion angles.

### Claim 19

A method for performing directed evolution of proteins, the method comprising iteratively performing:
producing a library of protein sequences based on an input protein structure, using a generative machine learning model configured to generate protein sequences having protein structures similar to an input protein structure;
expressing the protein sequences of the library of protein sequences;
selecting and amplifying at least a portion of the expressed protein sequences;
providing the selected and amplified protein sequences as input to a protein structure prediction algorithm configured to output a predicted protein structure.

### Claim 20 (depends on 19)

The method of claim 19, wherein the input protein structure has a desired function.
