Customizable document processing and retrieval system for enhanced artificial intelligence responses
AssigneeMicro Focus LLC
InventorsWen Lin, Hao Liu, Bing Zhang
Life of this patent
Estimating the term…
Abstract
Systems and methods are provided to execute chunking of documents in accordance with a resolver selected in accordance with one or more document elements of the document. A server or other computing device then chunks the document, which may be initially chunked in accordance with static rules, and re-chunked to maintain logical associations and meanings between the otherwise separate chunks.
Claims21
A method of vectorizing a document, comprising:
- chunking the document, in accordance with a resolver, into a number of chunks, wherein the resolver defines associations for portions of a documents type that comprise the document, and
- wherein the resolver comprises two or more different resolver types;
- vectorizing the number of chunks into a number of vectorized chunks;
- providing the number of vectorized chunks to a data storage for storage therein;
- retrieving the number of vectorized chunks;
- receiving a query;
- appending the number of vectorized chunks to the query;
- providing the query to a large language model;
- and
- receiving a response therefrom.
A system, comprising:
- a network interface to a communication network;
- and
- a microprocessor coupled to a computer memory comprising machine-readable instructions that when read by the microprocessor cause the microprocessor to perform:
- accessing a document;
- accessing a resolver,
- wherein the resolver comprises two or more different resolver types;
- chunking the document, in accordance with the resolver, into a number of chunks;
- vectorizing the number of chunks into a number of vectorized chunks;
- providing, via the network interface, the number of vectorized chunks to a data storage for storage therein;
- retrieving the number of vectorized chunks;
- receiving a query;
- appending the number of vectorized chunks to the query;
- providing the query to a large language model;
- and
- receiving a response therefrom.
(canceled)
A non-transitory computer-readable media comprising instructions that, when read by a microprocessor, cause the microprocessor to perform:
- accessing a document;
- accessing a resolver,
- wherein the resolver comprises two or more different resolver types;
- chunking the document, in accordance with the resolver, into a number of chunks;
- vectorizing the chunks into a number of vectorized chunks;
- providing the number of vectorized chunks to a data storage for storage therein;
- retrieving the number of vectorized chunks;
- receiving a query;
- appending the number of vectorized chunks to the query;
- providing the query to a large language model;
- and
- receiving a response therefrom.
Dependencies are inferred from the claim text.