# US 2022/0044818 A1 · System and method for quantifying prediction uncertainty > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2022/0044818 A1 - Document ID: US20220044818A1 - Status: Published application - Kind: A1 - Application number: 17/336,696 - Filed: 2021-06-02 - Published: 2022-02-10 - Earliest claimed: 2020-08-04 - Assignees: Koninklijke Philips N.V. - Applicants: Koninklijke Philips N.V. - Inventors: Yale Chang - Web page: https://patentgrep.com/patent/US20220044818A1 ## CPC - G16H 50/30: for calculating health indices; for individual health risk assessment - G16H 15/00: ICT specially adapted for medical reports, e.g. generation or transmission thereof - G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms - G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA ## Abstract A method for risk analysis, comprising: (i) receiving a plurality of features about a subject; (ii) analyzing the features using risk prediction models to generate risk scores; (iii) determining, using a distillation model, mean and variance among the risk scores; (iv) generating a single risk score and a risk score confidence interval; (v) determining, based on a feature impact score for each feature, an effect of one or more missing or defective features on the generated risk score confidence interval, wherein the system identifies a missing or defective feature for reporting if that feature would narrow the generated risk score confidence interval if it were not missing or not defective; (vi) generating a report comprising the single risk score and the risk score confidence interval, and further comprising at least one or more of the identified missing or defective features; and (vii) providing the report. ## Claims ### Claim 1 A method for generating a confidence interval for a risk score using a risk analysis system, comprising: receiving a plurality of features obtained about a subject; analyzing the received plurality of features using a plurality of different risk prediction models, wherein each of the plurality of different risk prediction models generates a health risk score for the subject; determining, using a distillation model, an estimated mean and variance among the generated health risk scores for the subject; generating, from the determined estimated mean and variance, a single health risk score and a risk score confidence interval for the subject; determining, based on a predetermined feature impact score for each different type of feature, an effect of one or more missing or defective features on the generated risk score confidence interval, wherein the system identifies a missing or defective feature for reporting if the missing or defective feature would narrow the generated risk score confidence interval if it were not missing or not defective; generating a report comprising the single health risk score and the risk score confidence interval for the subject, and further comprising at least one or more of the missing or defective features identified for reporting; and providing the report. ### Claim 2 (depends on 1) The method of claim 1, further comprising the steps of: receiving information regarding at least one or more of the missing or defective features identified for reporting to produce an updated plurality of features about the subject; analyzing the updated plurality of features using the plurality of different risk prediction models, wherein each of the plurality of different risk prediction models generates an updated health risk score for the subject; determining, using a distillation model, an estimated mean and variance among the updated health risk scores for the subject; generating, from the determined estimated mean and variance, an updated single health risk score and an updated risk score confidence interval for the subject; generating a report comprising the updated single health risk score and the risk updated score confidence interval for the subject; and providing the report. ### Claim 3 (depends on 1) The method of claim 1, wherein at least some of the received plurality of features are vital signs and test results, and wherein at least some of the plurality of features are received via an interface to an electronic health database. ### Claim 4 (depends on 1) The method of claim 1, wherein the report comprises a ranking of one or more of the missing or defective features identified for reporting, the ranking based on the determined effect of each of the one or more missing or defective features on the generated risk score confidence interval. ### Claim 5 (depends on 1) The method of claim 1, wherein the risk score comprises a probability of a risk, and the confidence interval comprises a range for the probability. ### Claim 6 (depends on 1) The method of claim 1, wherein the risk score comprises a probability of the risk being within a confidence interval range. ### Claim 7 (depends on 1) The method of claim 1, wherein the report comprises at least one or more of the missing or defective features identified for reporting comprises a recommendation to obtain new data for the at least one or more of the missing or defective features. ### Claim 8 (depends on 7) The method of claim 7, further comprising the step of receiving and carrying out instructions to pause or silence the recommendation. ### Claim 9 A system configured to generate a confidence interval for a risk score using a risk analysis system, comprising: a plurality of plurality of features obtained about a subject; a plurality of risk prediction models each configured to analyze the plurality of features and further configured to generate a risk score for the subject; a distillation model configured to determine an estimated mean and variance among the generated risk scores for the subject; a processor configured to: (i) generate, from the determined estimated mean and variance, a single risk score and a risk score confidence interval for the subject; (ii) determine, based on a feature impact score for each different type of feature, an effect of one or more missing or defective features on the generated risk score confidence interval, wherein the system identifies a missing or defective feature for reporting if the missing or defective feature would narrow the generated risk score confidence interval if it were not missing or not defective; and (iii) generate a report comprising the single risk score and the risk score confidence interval for the subject, and further comprising at least one or more of the missing or defective features identified for reporting; and a user interface configured to provide the report. ### Claim 10 (depends on 9) The system of claim 9, wherein the processor is further configured to: receive information regarding at least one or more of the missing or defective features identified for reporting to produce an updated plurality of features about the subject; and perform a new risk analysis with the updated plurality of features. ### Claim 11 (depends on 9) The system of claim 9, wherein at least some of the received plurality of features are vital signs and test results, and wherein at least some of the plurality of features are received via an interface to an electronic health database. ### Claim 12 (depends on 9) The system of claim 9, wherein the report comprises a ranking of one or more of the missing or defective features identified for reporting, the ranking based on the determined effect of each of the one or more missing or defective features on the generated risk score confidence interval. ### Claim 13 (depends on 9) The system of claim 9, wherein the risk score comprises a probability of a risk, and the confidence interval comprises a range for the probability. ### Claim 14 (depends on 9) The system of claim 9, wherein the risk score comprises a probability of the risk being within a confidence interval range. ### Claim 15 (depends on 9) The system of claim 9, wherein the report comprises at least one or more of the missing or defective features identified for reporting comprises a recommendation to obtain new data for the at least one or more of the missing or defective features.