# US 2024/0202358 A1 · Smart identification of indicator text with full-text search or optimized document analysis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202358 A1
- Document ID: US20240202358A1
- Status: Published application
- Kind: A1
- Application number: 18/068,022
- Filed: 2022-12-19
- Published: 2024-06-20
- Earliest claimed: 2022-12-19
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Thomas Hampp-Bahnmueller; Michael Baessler; Yannick Saillet
- Web page: https://patentgrep.com/patent/US20240202358A1

## CPC

- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- G06F 16/31: Indexing; Data structures therefor; Storage structures
- G06F 16/3325: {Reformulation based on results of preceding query}
- G06F 16/93: Document management systems
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Several aspects for optimizing unstructured document analysis comprise operating a document system, where the document system comprises a plurality of documents comprising unstructured content and a full-text index; receiving a request to identify documents comprising a type of data elements; selecting a sample out of the plurality of documents; determining data elements of the type in the sample of documents; determining an indicator context expression for the type of data elements out of the determined data elements of the type; determining a query for searching, using a search engine, the full-text index using the indicator context expression; and determining the documents in the document system being compliant to the determined query.

## Claims

### Claim 1

A method for optimizing unstructured document analysis, said method comprising:
operating a document system, said document system comprising a plurality of documents comprising unstructured content and a full-text index;
receiving a request to identify documents comprising a type of data elements;
selecting a sample out of said plurality of documents;
determining data elements of said type in said sample of said plurality of documents;
determining an indicator context expression for said type of data elements out of the determined data elements of said type;
determining a query for searching, using a search engine, said full-text index using said indicator context expression; and
determining the documents in said document system being compliant to said query.

### Claim 2 (depends on 1)

The method according to claim 1, wherein a number of documents in said sample is at least 10 times smaller than a second number of documents in said document system.

### Claim 3 (depends on 1)

The method according to claim 1, wherein said determining the data elements of said type in said sample comprises:
determining a number of relevant sample documents in said sample; and
upon determining that said number of relevant sample documents is below a predefined sample threshold value, selecting a larger sample out of said plurality of documents.

### Claim 4 (depends on 1)

The method according to claim 1, wherein said determining the documents in said document system being compliant to said query comprises:
applying a full analysis related to the documents in said document system.

### Claim 5 (depends on 1)

The method according to claim 1, further comprising:
determining a result number of the documents being compliant with said query; and
upon said result number being determined to be equal or outside predefined boundaries, adjusting said query and repeating said determining the documents in said document system being compliant to said query.

### Claim 6 (depends on 5)

The method according to claim 5, further comprising:
upon said result number having a value within predefined boundaries and a quality indicator value being larger than a predefined quality indicator threshold value, wherein said quality indicator value being indicative of a quality criterion of said type of data elements, stopping the repeating.

### Claim 7 (depends on 1)

The method according to claim 1, further comprising:
repeating said steps of:
determining indicator context expressions,
determining the query for searching said full-text index, and
determining the documents in said document system being compliant to said query, thereby redefining a scope of said indicator context expression.

### Claim 8 (depends on 1)

The method according to claim 1, wherein said determining said indicator context expression comprises:
selecting an expression to a left of a determined data element as one indicator context expression; and
selecting another expression to a right of said determined data element as another indicator context expression.

### Claim 9 (depends on 1)

The method according to claim 1, wherein determining said indicator context expression comprises:
selecting an expression as said indicator context expression in a surrounding of a determined data element, wherein said expression has another format than other elements in said surrounding of said determined data element.

### Claim 10 (depends on 1)

The method according to claim 1, wherein determining said indicator context expression comprises:
using a trained machine-learning model that has been trained to determine said indicator context expression for a determined data element in a given document, wherein said machine-learning model has been developed by a training of a machine-learning system with documents with labelled selected data elements and related indicator context expressions.

### Claim 11 (depends on 1)

The method according to claim 1, wherein determining said indicator context expressions comprises:
using an association model adapted for detecting strong relationship patterns between a determined data element and a potential indicator context expression; and
confirming said potential indicator context expression as an actual indicator context expression based on an analysis of other documents comprising said relationship of said potential indicator context expression and said determined data element.

### Claim 12

A computer-implemented document analysis system for optimizing unstructured document analysis, said system comprising:
a processor and a memory operatively coupled to said processor, wherein said memory stored program code portions, which, when executed enable said processor to:
operate a document system, said document system comprising a plurality of documents comprising unstructured content and a full-text index;
receive a request to identify documents comprising a type of data elements;
select a sample out of said plurality of documents;
determine data elements of said type in said sample of said plurality of documents;
determine an indicator context expression for said type of data elements out of the determined data elements of said type;
determine a query for searching, using a search engine, said full-text index using said indicator context expression; and
determine the documents in said document system being compliant to said query.

### Claim 13 (depends on 12)

The system of claim 12, wherein a number of documents in said sample is at least ten times smaller than a second number of documents in said document system.

### Claim 14 (depends on 12)

The system of claim 12, wherein, during said determining said data elements of said type in said sample of documents, said processor is also adapted to:
determine a number of relevant sample documents in said sample; and
upon determining that said number of relevant sample documents is below a predefined sample threshold value, selecting a larger sample out of said plurality of documents.

### Claim 15 (depends on 12)

The system of claim 12, wherein during said determining the documents in said document system, said processor is also adapted to:
apply a full analysis system related to said document system.

### Claim 16 (depends on 12)

The system of claim 12, wherein said processor is also adapted to:
determine a result number of the documents being compliant with said query; and
upon a determination that said result number is equal or outside predefined boundaries, adjust said query and execute a repetition of said determining the documents in said document system being compliant to said query.

### Claim 17 (depends on 16)

The system according to claim 16, wherein said processor, upon said result number having a value within predefined boundaries, is also adapted to:
upon a quality indicator value being larger than a predefined quality indicator threshold value, wherein said quality indicator value being indicative of a quality criterion of said type of determined data element, stop said repetition.

### Claim 18 (depends on 12)

The system according to claim 12, wherein said processor is also adapted to:
repeat said determining indicator context expressions, said determining said query for searching said full-text index, and said determining the documents in said document system being compliant to said query, thereby redefining a scope of said indicator context expressions.

### Claim 19 (depends on 12)

The system according to claim 12, wherein said processor, during said determining said indicator context expression, is also adapted to:
select an expression to a left of a determined data element as one indicator context expression; and
select another expression to a right of said determined data element as another indicator context expression.

### Claim 20

A computer program product for optimizing unstructured document analysis, said computer program product comprising a computer readable storage medium having program instructions embodied therewith, said program instructions being executable by one or more computing systems or controllers to cause said one or more computing systems to:
operate a document system, said document system comprising a plurality of documents comprising unstructured content and a full-text index;
receive, a request to identify documents comprising a type of data elements;
select a sample out of said plurality of documents;
determine data elements of said type in said sample of documents;
determine an indicator context expression for said type of data elements out of the determined data elements of said type;
determine a query for searching, using a search engine, said full-text index using said indicator context expression; and
determine the documents in said document system being compliant to said query.
