Domain specialty instruction generation for text analysis tasks
AssigneeAmazon Technologies, Inc.
InventorsKarthik Gopalakrishnan, Sravan Babu Bodapati, Katrin Kirchhoff, Sarthak Handa
Life of this patent
Estimating the term…
Abstract
Domain specialty instructions may be generated for performing text analysis tasks. An input text may be received for performing a text analysis task. A domain specialty may be identified for the input text. Specialty domain identifiers may be inserted as part of generating instructions to perform the text analysis task using a pre-trained large language model fine-tuned to a domain that includes multiple domain specialties. The pre-trained large language model may perform the text analysis task on the input text using the generated instructions. A result of the text analysis tsk performed on the input text may be provided.
Claims20
A system, comprising:
- one or more computing devices, respectively comprising at least one processor and a memory;
- wherein the one or more computing devices store program instructions that when executed by the one or more computing devices:
- receive a request to perform a summarization task on a natural language text, wherein the request specifies a domain specialty;
- insert one or more domain specialty identifiers as part of generating instructions to perform the summarization task using a pre-trained large language model fine-tuned to a domain comprising a plurality of domain specialties including the domain specialty;
- cause the pre-trained large language model fine-tuned to the domain to perform the summarization task on the natural language text using the generated instructions;
- and
- provide a result of the summarization task performed on the natural language text.
A method, comprising:
- receiving, at a text analysis system, an input text for performing a text analysis task;
- identifying, by the text analysis system, a domain specialty for the input text;
- inserting, by the text analysis system, one or more domain specialty identifiers as part of generating instructions to perform the text analysis task using a pre-trained large language model fine-tuned to a domain comprising a plurality of domain specialties including the domain specialty;
- causing, by the text analysis system, the pre-trained large language model fine-tuned to the domain to perform the text analysis task on the input text using the generated instructions;
- and
- providing, by the text analysis system, a result of the text analysis task performed on the input text.
One or more non-transitory, computer-readable storage media, storing program instructions that when executed on or across one or more computing devices cause the one or more computing devices to implement:
- receiving an input text for performing a text analysis task;
- identifying a domain specialty for the input text;
- inserting one or more domain specialty identifiers as part of generating instructions to perform the text analysis task using a pre-trained large language model fine-tuned to a domain comprising a plurality of domain specialties including the domain specialty;
- causing the pre-trained large language model fine-tuned to the domain to perform the text analysis task on the input text using the generated instructions;
- and
- providing a result of the text analysis task performed on the input text.
Dependencies are inferred from the claim text.