# US 2025/0156484 A1 · Deviation detection aka playbook comparison, summary for legal team > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0156484 A1 - Document ID: US20250156484A1 - Status: Published application - Kind: A1 - Application number: 18/948,253 - Filed: 2024-11-14 - Published: 2025-05-15 - Earliest claimed: 2023-11-14 - Assignees: Thomson Reuters Enterprise Centre GmbH - Applicants: Thomson Reuters Enterprise Centre GmbH - Inventors: Robert Rankin - Web page: https://patentgrep.com/patent/US20250156484A1 ## CPC - G06F 16/93: Document management systems - G06F 40/194: Calculation of difference between files - G06F 40/166: Editing, e.g. inserting or deleting - G06F 40/284: Lexical analysis, e.g. tokenisation or collocates - G06F 40/56: Natural language generation - G06N 3/045: Combinations of networks - G06F 40/289: Phrasal analysis, e.g. finite state techniques or chunking - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract This disclosure provides systems, methods, and devices for automatic comparison, analysis, and modification of documents using artificial intelligence and natural language processing-based techniques. In a first aspect, a method includes identifying a first set of document portions in a first document. The method includes generating a set of matched candidate pairs based on the first set of document portions and a set of pre-determined document portions distinct from the first set of document portions. The method includes quantifying relationships between the set of matched candidate pairs. The method includes modifying the first document to produce a second document including one or more new document portions, where the new documents portions correspond to one or more of the set of pre-determined document portions and replace at least one of the first set of documents portions. ## Claims ### Claim 1 A method comprising: identifying, by one or more processors, a first plurality of document portions in a first document; generating, by the one or more processors, a plurality of matched candidate pairs based on the first plurality of document portions and a plurality of pre-determined document portions distinct from the first plurality of document portions, wherein each document portion pair comprises a first document portion and a second document portion, the first document portion of a particular document portion pair corresponding to one of the first plurality of document portions and the second document portion of the particular document portion pair corresponding to one of the plurality of pre-determined document portions; determining, by the one or more processors, information representative of a relationship between the first document portion and the second document portion for each document portion pair; quantifying, by the one or more processors, the relationships between the plurality of matched candidate pairs based on the information representative of the relationship between the first document portion and the second document portion for each document portion pair; and modifying, by the one or more processors, the first document to produce a second document comprising one or more new document portions, wherein the one or more new documents portions correspond to one or more of the plurality of pre-determined document portions and replace at least one of the first plurality of documents portions. ### Claim 2 (depends on 1) The method of claim 1, wherein identifying, by the one or more processors, the first plurality of document portions in the first document is based at least in part on a large language model applicable to a plurality of document classifications. ### Claim 3 (depends on 1) The method of claim 1, wherein identifying, by the one or more processors, the first plurality of document portions in the first document is based at least in part on a trained classification model associated with a class of the first document. ### Claim 4 (depends on 1) The method of claim 1, wherein the information representative of the relationship between the first document portion and the second document portion for each document portion pair comprises, for each document portion pair of the plurality of matched candidate pairs, a first score corresponding to one or more intrinsic properties of the first document portion and the second document portion and a second score corresponding to a difference between the first document portion and the second document portion. ### Claim 5 (depends on 4) The method of claim 4, further comprising generating a set of embeddings for the plurality of matched candidate pairs, wherein each embedding of the set of embeddings corresponds to a particular document portion pair of the plurality of matched candidate pairs, and wherein the information representative of the relationship between the first document portion and the second document portion of each document portion pair is determined based on the set of embeddings. ### Claim 6 (depends on 5) The method of claim 5, wherein the difference between the first document portion and the second document portion is determined based on the set of embeddings using a transformer model. ### Claim 7 (depends on 6) The method of claim 6, wherein a first portion of the set of embeddings corresponding to the first document portion is configured as a query parameter for the transformer model and an attention mechanism of the transformer model is configured based on a second portion of the set of embeddings corresponding to the second document portion. ### Claim 8 (depends on 6) The method of claim 6, further comprising pruning the set of embeddings to produce a pruned set of embeddings, wherein the pruned set of embeddings retains portions of the set of embeddings representative of on an output of the transformer model. ### Claim 9 (depends on 4) The method of claim 4, further comprising generating a priority score for each document portion pair of the plurality of matched candidate pairs based on the one or more intrinsic properties and the difference between the first document portion and the second document portion. ### Claim 10 (depends on 9) The method of claim 9, further comprising ranking the plurality of matched candidate pairs based on the priority score. ### Claim 11 (depends on 1) The method of claim 1, further comprising generating data describing legal differences between a first document portion of at least one document portion pair and a second document portion of the at least one document portion pair using at least one large language model. ### Claim 12 (depends on 11) The method of claim 11, wherein the at least one large language model comprises a plurality of large language models, and wherein the data describing the legal differences is generated by different large language models of the plurality of large language models based on a ranking criterion. ### Claim 13 (depends on 11) The method of claim 11, wherein the data describing legal differences comprises a summary, a natural language description of the difference, a sentence explaining risk arising from the legal differences, a sentence explaining potential liabilities arising from the legal differences, or a combination thereof. ### Claim 14 (depends on 11) The method of claim 11, further comprising generating a prompt based on the first document, the plurality of pre-determined document portions, or both, wherein the prompt is provided as an input to at least one the large language model. ### Claim 15 (depends on 11) The method of claim 11, wherein the data describing the legal differences comprises a threshold number of outputs, each output corresponding to a particular document portion pair of the plurality of matched candidate pairs. ### Claim 16 (depends on 15) The method of claim 15, wherein the threshold number of outputs is configurable. ### Claim 17 An apparatus, comprising: a memory controller of a host device configured to couple the host device to a memory system through a first interface, the memory controller configured to perform operations including: identifying, a first plurality of document portions in a first document; generating a plurality of matched candidate pairs based on the first plurality of document portions and a plurality of pre-determined document portions distinct from the first plurality of document portions, wherein each document portion pair comprises a first document portion and a second document portion, the first document portion of a particular document portion pair corresponding to one of the first plurality of document portions and the second document portion of the particular document portion pair corresponding to one of the plurality of pre-determined document portions; determining information representative of a relationship between the first document portion and the second document portion for each document portion pair; quantifying the relationships between the plurality of matched candidate pairs based on the information representative of the relationship between the first document portion and the second document portion for each document portion pair; and modifying the first document to produce a second document comprising one or more new document portions, wherein the one or more new documents portions correspond to one or more of the plurality of pre-determined document portions and replace at least one of the first plurality of documents portions. ### Claim 18 (depends on 17) The apparatus of claim 17, wherein identifying the first plurality of document portions in the first document is based at least in part on a large language model applicable to a plurality of document classifications. ### Claim 19 (depends on 17) The apparatus of claim 17, wherein identifying the first plurality of document portions in the first document is based at least in part on a trained classification model associated with a class of the first document. ### Claim 20 A non-transitory computer-readable medium having code that, when executed by one or more processors, causes the one or more processors to: identify, a first plurality of document portions in a first document; generate a plurality of matched candidate pairs based on the first plurality of document portions and a plurality of pre-determined document portions distinct from the first plurality of document portions, wherein each document portion pair comprises a first document portion and a second document portion, the first document portion of a particular document portion pair corresponding to one of the first plurality of document portions and the second document portion of the particular document portion pair corresponding to one of the plurality of pre-determined document portions; determine information representative of a relationship between the first document portion and the second document portion for each document portion pair; quantify the relationships between the plurality of matched candidate pairs based on the information representative of the relationship between the first document portion and the second document portion for each document portion pair; and modify the first document to produce a second document comprising one or more new document portions, wherein the one or more new documents portions correspond to one or more of the plurality of pre-determined document portions and replace at least one of the first plurality of documents portions.