Definition retrieval and display

A tangible, non-transitory, machine-readable medium storing instructions that, when executed by a computer system, effectuate operations comprising:

• obtaining, with a computer system, from an application executing on the computer system, text of a first natural language text document displayed by the application, the text being natural language text;
• detecting, with the computer system, a definitional statement in the text, wherein the definitional statement is not labeled as such in the first natural language text document, wherein detecting the definitional statement comprises:
• causing at least some of the text of the first natural language text document to be input into a transformer model, wherein the transformer model is trained and is neural network-based, and wherein the transformer model has multi-headed attention;
• causing the transformer model to determine embedding vectors of segments of text in the first natural language text document, wherein the embedding vectors are based on context from at least some respective text adjacent the respective segments of text in the first natural language text document;
• and
• causing the transformer model to associate, based on at least some of the embedding vectors, terms in the document with text in the document defining those terms by applying the multi-headed attention to map attention heads of the transformer model to definitional text in the document;
• determining, with the computer system, a defined term and a definition of the defined term from the definitional statement;
• storing, with the computer system, a record associating the defined term with the definition;
• detecting the defined term being used in another location of the natural language text document;
• and
• after detecting the defined term being used in the other location, causing:
• a visual indication of the defined term to be presented in association with the defined term being used in the other location of the first natural language text document, and
• the definitional statement or definition to be presented, wherein:
• the operations further comprise caching a copy of the natural language text document;
• the application is used to display the natural language text document using a first thread;
• and
• detecting the definitional statement comprises detecting the defined term from the copy of the natural language text document using a second thread that is different from the first thread, the first and second threads being executed by the same computing device of the computing system.