# US 2019/0318220 A1 · Dispersed template-based batch interaction with a question answering system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318220 A1
- Document ID: US20190318220A1
- Status: Published application
- Kind: A1
- Application number: 15/952,828
- Filed: 2018-04-13
- Published: 2019-10-17
- Earliest claimed: 2018-04-13
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Charles E. Beller; William G. Dubyak; Palani Sakthi; Kristen M. Summers; Hayes McCormick; Jay Oakey
- Web page: https://patentgrep.com/patent/US20190318220A1

## CPC

- G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
- G06N 5/04: Inference or reasoning models
- G06N 5/027: {Frames}
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Embodiments are directed to interaction with an open-domain question and answer system to seek answers to broad and general questions by providing templates and words or phrases to fill slots in the templates that specify alternative specific questions, the answer to any of which may serve the broader purpose. Responses to all of the questions in a batch are considered as candidates, with the strongest general answers being returned. The approach, according to embodiments herein, addresses the need for responses to broad questions in which the user is seeking any response to a known pattern. The user is able to articulate the question as a template that can be instantiated in many forms, and the user may specify how strongly the concrete answers indicate an answer to the underlying general question.

## Claims

### Claim 1

A computer implemented method for answering general questions in an information handling system capable of answering questions, the system comprising a processor and a memory comprising instructions executed by the processor, the method comprising:
receiving a general question template and one or more sets of slot fillers with weights by a user;
combining the one or more sets of slot fillers with the general question template to form questions;
running the questions to obtain answers;
aggregating the answers based on the weights; and
returning at least one answer to the question to the user.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
providing a user interface (UI) allowing the user to adjust the one or more sets of slot fillers and weights;
responsive to the user utilizing the UI to form one or more adjusted sets of slot fillers and adjusted weights, combining the one or more adjusted sets of slot fillers to form adjusted questions;
running the adjusted questions to obtain adjusted answers; and
aggregating the adjusted answers based on the adjusted weights.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
forming a weighted question batch comprising the questions and corresponding question weights, each of the question weights generated by combining weights of slot fillers from the one or more sets of slot fillers that form a respective question.

### Claim 4 (depends on 1)

The method of claim 1, wherein the answers comprise evidence references.

### Claim 5 (depends on 1)

The method of claim 1, wherein the information handling system supports open-domain questions.

### Claim 6 (depends on 1)

The method of claim 1, wherein the general question template includes blanks, and wherein each of the one or more sets of slot fillers corresponds to a respective blank in the general question template.

### Claim 7 (depends on 1)

The method of claim 1, wherein the answers are aggregated according to scores to the answers and weights of the questions.

### Claim 8

A computer program product for answering general questions in an information handling system capable of answering questions, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:
receive a general question template and one or more sets of slot fillers with weights by a user;
combine the one or more sets of slot fillers with the general question template to form questions;
run the questions to obtain answers;
aggregate the answers based on the weights; and
return at least one answer to the question to the user.

### Claim 9 (depends on 8)

The computer program product of claim 8, wherein the program instructions further cause the processor to:
provide a user interface (UI) allowing the user to adjust the one or more sets of slot fillers and weights;
responsive to the user utilizing the UI to form one or more adjusted sets of slot fillers and adjusted weights, combine the one or more adjusted sets of slot fillers to form adjusted questions;
run the adjusted questions to obtain adjusted answers; and
aggregate the adjusted answers based on the adjusted weights.

### Claim 10 (depends on 9)

The computer program product of claim 9, wherein the program instructions further cause the processor to:
form a weighted question batch comprising the questions and corresponding question weights, each of the question weights generated by combining weights of slot fillers from the one or more sets of slot fillers that form a respective question.

### Claim 11 (depends on 8)

The computer program product of claim 8, wherein the information handling system supports open-domain questions.

### Claim 12 (depends on 8)

The computer program product of claim 8, wherein the general question template includes blanks, and wherein each of the one or more sets of slot fillers corresponds to a respective blank in the general question template.

### Claim 13 (depends on 8)

The computer program product of claim 8, wherein the answers are aggregated according to scores to the answers and weights of the questions.

### Claim 14

A system for answering general questions, the system comprising:
a memory comprising executable instructions; and
a processor configured to execute the executable instructions causing the processor to:
receive a general question template and one or more sets of slot fillers with weights by a user;
combine the one or more sets of slot fillers with the general question template to form questions;
run the questions to obtain answers;
aggregate the answers based on the weights; and
return at least one answer to the question to the user.

### Claim 15 (depends on 14)

The system of claim 14, wherein the executable instructions further cause the processor to:
provide a user interface (UI) allowing the user to adjust the one or more sets of slot fillers and weights;
responsive to the user utilizing the UI to form one or more adjusted sets of slot fillers and adjusted weights, combine the one or more adjusted sets of slot fillers to form adjusted questions;
run the adjusted questions to obtain adjusted answers; and
aggregate the adjusted answers based on the adjusted weights.

### Claim 16 (depends on 15)

The system of claim 15, wherein the executable instructions further cause the processor to:
form a weighted question batch comprising the questions and corresponding question weights, each of the question weights generated by combining weights of slot fillers from the one or more sets of slot fillers that form a respective question.

### Claim 17 (depends on 14)

The system of claim 14, wherein the answers comprise evidence references.

### Claim 18 (depends on 14)

The system of claim 14, wherein the information handling system supports open-domain questions.

### Claim 19 (depends on 14)

The system of claim 14, wherein the general question template includes blanks, and wherein each of the one or more sets of slot fillers corresponds to a respective blank in the general question template.

### Claim 20 (depends on 14)

The system of claim 14, wherein the answers are aggregated according to scores to the answers and weights of the questions.
