# US 12,001,424 B2 · Interactive structured analytic systems > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,001,424 B2 - Document ID: US12001424B2 - Status: Granted - Kind: B2 - Application number: 17/817,988 - Filed: 2022-08-07 - Published: 2022-12-22 - Granted: 2024-06-04 - Earliest claimed: 2017-11-29 - Assignees: Resilient Cognitive Solutions, LLC - Applicants: Resilient Cognitive Solutions, LLC - Inventors: Joel P. Benedict; Caroline E. Christ; Paul E. Durbin; William C. Elm; Kathryn M. Kopren; Brian Mendicino; Brian A. Neal; Samantha S. Szymczak; Mark Westerlund; Jorge E. Zuniga; Elise M. Reeves - Web page: https://patentgrep.com/patent/US12001424B2 ## CPC - G06F 16/24522: {Translation of natural language queries to structured queries} - G06F 16/243: {Natural language query formulation} - G06F 16/24578: {using ranking} - G06F 16/248: Presentation of query results - G06F 16/3329: Natural language query formulation - G06Q 10/06: Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling - G06Q 10/0637: Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals - G06Q 10/10: Office automation; Time management - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract An analytics system can include a display on which a plurality of images are shown, and an analytics application communicably coupled to the display. The analytics application can receive a question and hypotheses from a user using the display. The analytics application can also generate queries using a natural language module, and send the queries to a plurality of data sources. The analytics application can further receive data from the data sources in response to the queries, and evaluate the data to generate evaluated data. The analytics application can also present the evaluated data, and receive a selection of at least one data item of the evaluated data. The analytics application can further convert the at least one data item into evidence, receive a selection of the evidence applied to a hypothesis, and evaluate the hypothesis. The analytics application can also present an assessment that the hypothesis answers the question. ## Claims ### Claim 1 An analytics system comprising: a display on which information is shown; and an analytics application executing on one or more processors and communicably coupled to the display, wherein the analytics application: receives an inquiry from a user and generates a hierarchical network of questions that support an answer to the inquiry; receives a selected question from among the hierarchical network of questions, the selected question selected by the user using the display; receives assumptions and hypotheses from the user using the display, wherein the assumptions and hypotheses are specific to the selected question; generates, by a query module, a plurality of queries using a natural language module, wherein the natural language module incorporates natural language into the plurality of queries, wherein the plurality of queries are based on the selected question, the assumptions, and the hypotheses; sends the plurality of queries to a plurality of data sources; receives data from the plurality of data sources in response to the plurality of queries; evaluates the data to generate evaluated data; presents, using a triage module, the evaluated data, wherein the evaluated data is organized by age, veracity, and relevance to the hypotheses; receives, from the triage module, a first selection of at least one data item of the evaluated data; converts, using the triage module, the at least one data item into evidence; receives a second selection of the evidence applied to a hypothesis among the hypotheses; evaluates, by an assessment module, the hypothesis against the selected question; presents, by the assessment module on the display, an assessment of the hypothesis against the selected question based on an analysis by a hypotheses manager; and receives, from the user on the display, confirmation that the hypothesis answers the selected question. ### Claim 2 (depends on 1) The analytics system of claim 1, wherein the analytics application further: generates, using a reporting module, at least one report explaining the answer, wherein the at least one report comprises the evidence supporting the hypothesis and the hypothesis used to answer the selected question. ### Claim 3 (depends on 1) The analytics system of claim 1, wherein the hierarchical network of questions is created and arranged by the user. ### Claim 4 (depends on 1) The analytics system of claim 1, wherein the hypothesis used to answer the selected question is used by the user to help answer another question in the hierarchical network of questions. ### Claim 5 (depends on 4) The analytics system of claim 4, wherein the analytics application further: presents, on the display, an overview of a status for answering the hierarchical network of questions. ### Claim 6 (depends on 1) The analytics system of claim 1, wherein the query module evaluates contents of the plurality of queries and selects the data sources from a pool of data sources based on the contents. ### Claim 7 (depends on 1) The analytics system of claim 1, wherein the query module evaluates contents of the plurality of queries and selects the data sources based on a reliability of previous data supplied by the data sources. ### Claim 8 (depends on 1) The analytics system of claim 1, wherein the query module evaluates the data sources submitting data and notifies the user on the display whether particular data items are from reliable data sources. ### Claim 9 (depends on 1) The analytics system of claim 1, wherein the triage module allows the user, using the display, to manipulate the evaluated data to assist the user in selecting the at least one data item. ### Claim 10 (depends on 1) The analytics system of claim 1, wherein the triage module evaluates the data, in part, by determining an age of the data. ### Claim 11 (depends on 1) The analytics system of claim 1, wherein the triage module presents the evaluated data by pairing the evaluated data with at least one selected from a group consisting of the assumptions and the hypotheses. ### Claim 12 (depends on 1) The analytics system of claim 1, wherein the evaluated data is among a plurality of evaluated data, and wherein the evidence is among a plurality of evidence used to arrive at the answer to the selected question. ### Claim 13 (depends on 1) The analytics system of claim 1, wherein the analytics application and its components perform in real time. ### Claim 14 (depends on 1) The analytics system of claim 1, wherein the analytics application evaluates the data using a relevance module to determine a relevance of the data relative to the plurality of queries. ### Claim 15 A system for solving a problem by offsetting cognitive bias, the system comprising: a plurality of data sources; a display; and an analytics application executing on one or more processors and communicably coupled to the plurality of data sources, wherein the analytics application: receives an inquiry from a user and generates a hierarchical network of questions that support an answer to the inquiry; receives a selected question from among the hierarchical network of questions, the selected question selected by the user using the display; receives assumptions and hypotheses from the user using the display, wherein the assumptions and hypotheses are specific to the selected question; generates, by a query module, a plurality of queries using a natural language module, wherein the natural language module incorporates natural language into the plurality of queries, wherein the plurality of queries are based on the selected question, evidence objects, the assumptions, and the hypotheses; sends the plurality of queries to the plurality of data sources; receives data from the plurality of data sources in response to the plurality of queries; evaluates the data to generate evaluated data; presents on the display, using a triage module, the evaluated data, wherein the evaluated data is organized by age, veracity, and relevance to the hypotheses; receives, from triage module, a first selection of at least one data item of the evaluated data; converts, using the triage module, the at least one data item into evidence; receives a second selection of the evidence applied to a hypothesis among the hypotheses; evaluates, by an assessment module, the hypothesis against the selected question; presents, by the assessment module on the display, an assessment of the hypothesis against the selected question based on an analysis by a hypotheses manager; and receives, from the user on the display, confirmation that the hypothesis answers the selected question. ### Claim 16 (depends on 15) The system of claim 15, wherein at least one data source of the plurality of data sources is secure, and wherein at least one query of the plurality of queries sent by the query module to the at least one data source comprises credentials to access the at least one data source. ### Claim 17 (depends on 15) The system of claim 15, wherein the user is among a plurality of users working on the selected question simultaneously. ### Claim 18 A non-transitory computer-readable medium comprising instructions that, when executed by a hardware processor, perform a method for solving a problem, the method comprising: receiving an inquiry from a user and generating a hierarchical network of questions that support an answer to the inquiry; receiving a selected question from among the hierarchical network of questions, the selected question selected by the user using the display; receiving assumptions and hypotheses from the user using the display, wherein the assumptions and hypotheses are specific to the selected question; generating, by a query module, a plurality of queries using a natural language module, wherein the natural language module incorporates natural language into the plurality of queries, wherein the plurality of queries are based on the selected question, the assumptions, and the hypotheses; sending the plurality of queries to a plurality of data sources; receiving data from the plurality of data sources in response to the plurality of queries; evaluating the data to generate evaluated data; presenting on the display, using a triage module, the evaluated data, wherein the evaluated data is organized by age, veracity, and relevance to the hypotheses; receiving, from the triage module, a first selection of at least one data item of the evaluated data; converting, using the triage module, the at least one data item into evidence; receiving a second selection of the evidence applied to a hypothesis among the hypotheses; evaluating, by an assessment module, the hypothesis against the selected question; presenting, by the assessment module on the display, an assessment of the hypothesis against the selected question; and receiving, from the user on the display, confirmation that the hypothesis answers the selected question. ### Claim 19 (depends on 18) The non-transitory computer-readable medium of claim 18, wherein at least one other question of the plurality of questions is generated by an analytics engine. ### Claim 20 (depends on 1) The analytics system of claim 1, wherein evaluating the data includes evaluating a tripwire linked to the assumptions by a tripwire module to detect user bias in the assumptions.