Clustering terms using machine learning models
OwnerColin Robert Small, Ryan Yuki Huanginventors
Life of this patent
Estimating the term…
Abstract
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for clustering terms. One of the methods includes obtaining a plurality of text sequences to be clustered; obtaining a context text sequence specifying a context for the clustering; for each text sequence of the plurality of text sequences, processing the text sequence and the context text sequence using a language model neural network to generate a respective extracted term that describes content from the text sequence that is relevant to the context; and clustering the respective extracted terms for the text sequences into a plurality of clusters.
Claims20
A computer-implemented method comprising:
- obtaining a plurality of text sequences to be clustered;
- obtaining a context text sequence specifying a context for the clustering;
- for each text sequence of the plurality of text sequences, processing the text sequence and the context text sequence using a language model neural network to generate a respective extracted term that describes content from the text sequence that is relevant to the context;
- and
- clustering the respective extracted terms for the text sequences into a plurality of clusters.
A system comprising one or more computers and one or more storage devices storing instructions that when executed by the one or more computers cause the one or more computers to perform operations comprising:
- obtaining a plurality of text sequences to be clustered;
- obtaining a context text sequence specifying a context for the clustering;
- for each text sequence of the plurality of text sequences, processing the text sequence and the context text sequence using a language model neural network to generate a respective extracted term that describes content from the text sequence that is relevant to the context;
- and
- clustering the respective extracted terms for the text sequences into a plurality of clusters.
One or more non-transitory computer-readable storage media storing instructions that when executed by one or more computers cause the one more computers to perform operations comprising:
- obtaining a plurality of text sequences to be clustered;
- obtaining a context text sequence specifying a context for the clustering;
- for each text sequence of the plurality of text sequences, processing the text sequence and the context text sequence using a language model neural network to generate a respective extracted term that describes content from the text sequence that is relevant to the context;
- and
- clustering the respective extracted terms for the text sequences into a plurality of clusters.
Dependencies are inferred from the claim text.