Loading patent…
AssigneeOracle International Corporation
InventorsXin Zhang, Zheng Wang, Yuying Wang, Genyi Huang, Mengqing Guo, Yazhe Hu, Zhonghai Deng, Yimo Liu, Rongguang Wang, Tao Sheng
Estimating the term…
Techniques for multimodal document retrieval are disclosed herein. Multimodal documents that include both textual and graphical components are retrieved from a knowledge base by a multimodal retrieval augmented generation (RAG) agent in response to a query. The documents and/or components or chunks thereof are retrievable by the RAG agent from the knowledge base using the semantic summaries and/or vector search of embeddings in the knowledge base that are generated from text extracted from processing non-textual components of the data. The RAG agent classifies the query type to determine whether to use a semantic match for text or image summaries, full text semantic search, vector cosine similarity search, and/or other multimodal vector search. The RAG agent performs types of searches selected based on the modality used to generate the response to the query.
A method, comprising:
One or more non-transitory computer readable media comprising instructions which, when executed by one or more hardware processors, cause performance of operations comprising:
A system, comprising:
Dependencies are inferred from the claim text.