# US 2023/0409904 A1 · Method and system for predicting molecular properties

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0409904 A1
- Document ID: US20230409904A1
- Status: Published application
- Kind: A1
- Application number: 18/237,516
- Filed: 2023-08-24
- Published: 2023-12-21
- Earliest claimed: 2023-08-24
- Assignees: Quantiphi, Inc
- Inventors: Dagnachew Birru; Mukkamala Venkata Sai Prakash; Saisubramaniam Gopalakrishnan; Nareddy Siddartha Reddy; Ganesh Laxman Parab; Vishal Vaddina
- Web page: https://patentgrep.com/patent/US20230409904A1

## CPC

- G06N 3/042: Knowledge-based neural networks; Logical representations of neural networks
- G06N 3/08: Learning methods
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/09: Supervised learning
- G06N 5/022: Knowledge engineering; Knowledge acquisition
- G16C 20/30: Prediction of properties of chemical compounds, compositions or mixtures
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G16C 20/70: Machine learning, data mining or chemometrics
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G16C: COMPUTATIONAL CHEMISTRY; CHEMOINFORMATICS; COMPUTATIONAL MATERIALS SCIENCE

## Abstract

A method and system of predicting molecular properties is provided herein. The method includes representing a molecule as a graph and a string. The method further includes encoding the graph into a first feature representation and the string into a second feature representation, using a graph neural network and a transformer-based network, respectively. The method further includes concatenating the first feature representation obtained from the graph neural network and the second feature representation obtained from the transformer-based network to create a combined feature representation. The method further includes fusing the combined feature representation using a linear layer to obtain a synergistic combined feature representation for the molecule. The method further includes predicting one or more molecular properties for the molecule using the synergistic combined feature representation and a predictor network.

## Claims

### Claim 1

A computer-implemented method for predicting molecular properties, comprising:
representing a molecule as a graph and a string;
encoding the graph into a first feature representation and the string into a second feature representation, using a graph neural network and a transformer-based network, respectively;
concatenating the first feature representation obtained from the graph neural network and the second feature representation obtained from the transformer-based network to create a combined feature representation;
fusing the combined feature representation using a linear layer to obtain a synergistic combined feature representation for the molecule; and
predicting one or more molecular properties for the molecule using the synergistic combined feature representation and a predictor network.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the graph neural network include architectures selected from, but not limited to, a Graph Isomorphism Network (GIN), a Graph Convolutional Network (GCN), and a Graph Attention Networks (GAT), and wherein the transformer based network include architectures selected from, but not limited to, Bidirectional Encoder Representations from Transformers (BERT), Bidirectional Autoregressive Transformers (BART), and Robustly Optimized BERT Pretraining Approach (RoBERTa).

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the graph representation comprises nodes representing atoms and edges representing bonds.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the string corresponds to one of a Simplified Molecular Input Line Entry System (SMILES), a SELF-referencIng Embedded Strings (SELFIES), or an International Chemical Identifier (InChi).

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, wherein the SMILES string, SELFIES string, or InChi are textual representations of the molecule.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein predicting the one or more molecular properties comprises estimating solubility, toxicity, reactivity, or biological activity of the molecule.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the predictor network is a neural network that employ one of a regression algorithm or a classification algorithm for predicting molecular properties.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, further comprising training the predictor network using a loss function that compares the one or more predicted molecular properties with known ground truth properties.

### Claim 9 (depends on 8)

The computer-implemented method of claim 8, further comprising:
performing back propagation on the predictor network using the loss function to update network parameters; and
adjusting weights of the predictor network based on the back propagation to optimize the prediction accuracy of molecular properties.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the synergistic combined feature representation captures global structure of molecules and characteristics of individual atoms to accurately predict the one or more molecular properties.

### Claim 11

A computer system for predicting molecular properties, the computer system comprising: one or more computer processors, one or more computer readable memories, one or more computer readable storage devices, and program instructions stored on the one or more computer readable storage devices for execution by the one or more computer processors via the one or more computer readable memories, the program instructions comprising:
representing a molecule as a graph and a string;
encoding the graph into a first feature representation and the string into a second feature representation, using a graph neural network and a transformer-based network, respectively;
concatenating the first feature representation obtained from the graph neural network and the second feature representation obtained from the transformer-based network to create a combined feature representation;
fusing the combined feature representation using a linear layer to obtain a synergistic combined feature representation for the molecule; and
predicting one or more molecular properties for the molecule using the synergistic combined feature representation and a predictor network.

### Claim 12 (depends on 11)

The computer system of claim 11, wherein the graph neural network include architectures selected from, but not limited to, a Graph Isomorphism Network (GIN), a Graph Convolutional Network (GCN), and a Graph Attention Networks (GAT), and wherein the transformer based network include architectures selected from, but not limited to, Bidirectional Encoder Representations from Transformers (BERT), Bidirectional Autoregressive Transformers (BART), and Robustly Optimized BERT Pretraining Approach (RoBERTa).

### Claim 13 (depends on 11)

The computer system of claim 11, wherein the graph representation comprises nodes representing atoms and edges representing bonds.

### Claim 14 (depends on 11)

The computer system of claim 11, wherein the string corresponds to a Simplified Molecular Input Line Entry System (SMILES), a SELF-referencIng Embedded Strings (SELFIES), or an International Chemical Identifier (InChi).

### Claim 15 (depends on 14)

The computer system of claim 14, wherein the SMILES string and the SELFIES, or InChi are textual representations of the molecule.

### Claim 16 (depends on 11)

The computer system of claim 11, wherein predicting the one or more molecular properties comprises estimating solubility, toxicity, reactivity, or biological activity of the molecule.

### Claim 17 (depends on 11)

The computer system of claim 11, wherein the predictor network is a neural network that employ one of a regression algorithm or a classification algorithm for predicting molecular properties.

### Claim 18 (depends on 11)

The computer system of claim 11, further comprising training the predictor network using a loss function that compares the one or more predicted molecular properties with known ground truth properties.

### Claim 19 (depends on 11)

The computer system of claim 11, further comprising:
performing back propagation on the predictor network using the loss function to update network parameters; and
adjusting weights of the predictor network based on the back propagation to optimize the prediction accuracy of molecular properties.

### Claim 20

A non-transitory computer-readable storage medium having stored thereon computer executable instruction which when executed by one or more processors, cause the one or more processors to carry out operations for hiding personal application user interface (UI) elements, the operations comprising perform the operations comprising:
representing a molecule as a graph and a string;
encoding the graph into a first feature representation and the string into a second feature representation, using a graph neural network and a transformer-based network, respectively;
concatenating the first feature representation obtained from the graph neural network and the second feature representation obtained from the transformer-based network to create a combined feature representation;
fusing the combined feature representation using a linear layer to obtain a synergistic combined feature representation for the molecule; and
predicting one or more molecular properties for the molecule using the synergistic combined feature representation.
