# US 2021/0342718 A1 · Method for training information retrieval model based on weak-supervision and method for providing search result using such model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342718 A1
- Document ID: US20210342718A1
- Status: Published application
- Kind: A1
- Application number: 17/245,435
- Filed: 2021-04-30
- Published: 2021-11-04
- Earliest claimed: 2020-05-01
- Assignees: Hoseo University Academic Cooperation Foundation; Livin Al Inc.
- Applicants: Hoseo University Academic Cooperation Foundation; Livin Al Inc.
- Inventors: Sung Bum PARK; Suehyun CHANG; Geun Jin AHN
- Web page: https://patentgrep.com/patent/US20210342718A1

## CPC

- G06F 16/3329: Natural language query formulation
- G06N 5/04: Inference or reasoning models
- G06F 16/3334: {Selection or weighting of terms from queries, including natural language queries}
- G06F 16/334: Query execution (filtering based on additional data G06F16/335)
- G06F 16/93: Document management systems
- G06N 20/00: Machine learning
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A search method using an artificial intelligence based information retrieval model and a method for training the artificial intelligence based information retrieval model used for the method are provided. In the method, even if there is no labeled data and only a corpus exists, the artificial intelligence based information retrieval model can be trained using the weak-supervision methodology. Search can be performed by dividing documents into passages having short lengths. Compared to an information retrieval model based on unsupervised learning, improved search results are provided.

## Claims

### Claim 1

A computer-implemented method for providing a user with a search result corresponding to a query input by the user from a corpus including a plurality of passages, comprising the steps of:
(a) retrieving, by an information retrieval model based on an unsupervised learning, N passages corresponding to the query from the corpus;
(b) re-ranking, by an artificial intelligence based information retrieval model trained by a weak-supervision methodology, the N passages retrieved in step (a) based on the query; and,
(c) outputting a list of search results corresponding to the passages re-ranked in step (b),
wherein each passage of the corpus is a part of each document of the document corpus including a plurality of documents to be searched, and
wherein the artificial intelligence based information retrieval model trained by the weak-supervision methodology is trained based on pseudo-labels which are generated by using the plurality of passages included in the corpus and a pseudo-query generated from each passage, said pseudo-query generated by an information retrieval model based on unsupervised learning including the information retrieval model that is used in the step (a).

### Claim 2 (depends on 1)

The method according to claim 1, wherein each document in the document corpus has a title, and wherein each passage in the corpus includes the title of the document in which the passage is included as part of.

### Claim 3 (depends on 1)

The method according to claim 1, wherein, in the step (c), the search result list is a list in which documents including the re-ranked passages are sorted so as to correspond to the sorting order of the re-ranked passages in step (b).

### Claim 4 (depends on 3)

The method according to claim 3, wherein, when the re-ranked result in step (b) includes more than two passages extracted from one document, the sorting order of the document is determined to correspond to the order of the most relevant passage.

### Claim 5

An apparatus for providing a user with a search result corresponding to a query input by the user from a corpus including a plurality of passages, comprising:
at least one processor; and
at least one memory for storing computer-executable instructions,
the computer-executable instructions stored in the at least one memory that are operable, when executed by the at least one processor, to perform operations including:
(a) retrieving, by an information retrieval model based on an unsupervised learning, N passages corresponding to the query from the corpus;
(b) re-ranking, by an artificial intelligence based information retrieval model trained by a weak-supervision methodology, the N passages retrieved in step (a) based on the query; and,
(c) outputting a list of search results corresponding to the passages re-ranked in step (b),
wherein each passage of the corpus is a part of each document of the document corpus including a plurality of documents to be searched, and
wherein the artificial intelligence based information retrieval model trained by the weak-supervision methodology is trained based on pseudo-labels which are generated by using the plurality of passages included in the corpus and a pseudo-query generated from each passage, said pseudo-query generated by an information retrieval model based on unsupervised learning including the information retrieval model that is used in the step (a).

### Claim 6 (depends on 5)

The apparatus according to claim 5, wherein each document in the document corpus has a title, and wherein each passage in the corpus includes the title of the document in which the passage is included as part of.

### Claim 7 (depends on 5)

The apparatus according to claim 5, wherein, in the step (c), the search result list is a list in which documents including the re-ranked passages are sorted so as to correspond to the sorting order of the re-ranked passages in step (b).

### Claim 8 (depends on 7)

The apparatus according to claim 7, wherein, when the re-ranked result in step (b) includes more than two passages extracted from one document, the sorting order of the document is determined to correspond to the order of the most relevant passage.
