Loading patent…
AssigneeOracle International Corporation
InventorsXin Zhang, Zheng Wang, Mengqing Guo, Yazhe Hu, Zhonghai Deng, Yimo Liu, Yuying Wang, Genyi Huang, Rongguang Wang, Tao Sheng
Estimating the term…
Hybrid content item chunking techniques for retrieval augmented generation (RAG) systems are disclosed. The techniques employ a dual approach, combining size-based and semantic chunking with layout-based chunking. The techniques analyze content for layout indicators, creating two sets of chunks that are then merged into a hybrid set. This hybrid set is loaded into a database for subsequent searches. The techniques offer several technical advantages, including improved handling of diverse document types, potential for parallel processing, and enhanced capture of both semantic meaning and structural layout. By maintaining size constraints and adapting to various formats, the techniques provide a more comprehensive representation of document content. The techniques overcome limitations of single-method approaches, potentially leading to more accurate information retrieval, improved context preservation, and enhanced RAG system performance across varied document types.
One or more non-transitory computer-readable media comprising instructions which, when executed by one or more hardware processors, cause performance of operations comprising:
A method comprising:
A system comprising:
Dependencies are inferred from the claim text.