# US 9,436,913 B2 · Adaptive probabilistic computer-controlled method and system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,436,913 B2 - Document ID: US9436913B2 - Status: Granted - Kind: B2 - Application number: 14/840,567 - Filed: 2015-08-31 - Published: 2016-01-07 - Granted: 2016-09-06 - Earliest claimed: 2006-01-10 - Assignees: ManyWorlds, Inc. - Applicants: Steven Dennis Flinn; Naomi Felina Moneypenny - Inventors: Steven Dennis Flinn; Naomi Felina Moneypenny - Web page: https://patentgrep.com/patent/US9436913B2 ## CPC - G06N 5/04: Inference or reasoning models - G06N 5/022: Knowledge engineering; Knowledge acquisition - G06N 5/045: Explanation of inference; Explainable artificial intelligence [XAI]; Interpretable artificial intelligence - G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks - G06N 20/00: Machine learning - G06N 20/10: using kernel methods, e.g. support vector machines [SVM] - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract An adaptive probabilistic computer-controlled method and system determines computer-controlled actions that are expected to reduce uncertainties that are embodied as probabilities and then updates the probabilities in accordance with the results of the computer-controlled actions. The updated probabilities inform the determination of subsequent computer-controlled actions. Expected values of information may also be applied in determining the subsequent computer-controlled actions. The computer-controlled actions may comprise analysis of content and generating recommendations that are delivered to users, and inferences from the analysis of content and usage behaviors may inform the updating of the probabilities. Statistical learning functions and/or neural networks may be applied in determining the computer-controlled actions. ## Claims ### Claim 1 A computer-implemented method comprising: determining automatically a first computer-controlled action that is expected to result in a reduction of uncertainty that is embodied by one or more probabilities; performing automatically the first computer-controlled action; updating automatically the one or more probabilities based upon an assessment of a result of the first computer-controlled action; determining automatically a second computer-controlled action in accordance with the updated one or more probabilities and an expected value of information; and performing automatically the second computer-controlled action. ### Claim 2 (depends on 1) The method of claim 1, further comprising: performing automatically the first computer-controlled action, wherein the first computer-controlled action comprises a search of one or more computer-implemented knowledge bases. ### Claim 3 (depends on 1) The method of claim 1, further comprising: performing automatically the first computer-controlled action, wherein the first computer-controlled action comprises a statistical analysis of computer-implemented content. ### Claim 4 (depends on 1) The method of claim 1, further comprising: performing automatically the first computer-controlled action, wherein the first computer-controlled action comprises generating a recommendation that is delivered to a user of a computer-implemented system. ### Claim 5 (depends on 4) The method of claim 4, further comprising: updating automatically the one or more probability distributions based upon the assessment of the result of the first computer-controlled action, wherein the result of the first computer-controlled action comprises an inference from behavioral information that is exhibited by the user in response to the recommendation. ### Claim 6 (depends on 1) The method of claim 1, further comprising: performing automatically the first computer-controlled action, wherein the first computer-controlled action comprises modifying a structure of a computer-implemented system. ### Claim 7 (depends on 6) The method of claim 6, further comprising: updating automatically the one or more probability distributions based upon the assessment of the result of the first computer-controlled action, wherein the result of first computer-controlled action comprises an inference from user behavioral information that is associated with the modified structure of the computer-implemented system. ### Claim 8 (depends on 1) The method of claim 1, further comprising: determining automatically the second computer-controlled action in accordance with the updated one or more probabilities, the expected value of information, and an expected cost of the second computer-controlled action. ### Claim 9 (depends on 8) The method of claim 8, further comprising: determining automatically the second computer-controlled action in accordance with the updated one or more probabilities, the expected value of information, the expected cost of the second computer-controlled action, and a utility function. ### Claim 10 A system comprising one or more processor-based devices configured to: determine a first computer-controlled action that is expected to result in a reduction of uncertainty that is embodied by one or more probabilities; perform the first computer-controlled action; update the one or more probabilities based upon an assessment of a result of the first computer-controlled action; determine a second computer-controlled action in accordance with the updated one or more probabilities and an expected value of information; and perform the second computer-controlled action. ### Claim 11 (depends on 10) The system of claim 10, further comprising the one or more processor-based devices configured to: determine the first computer-controlled action, wherein the first computer-controlled action is determined, at least in part, by applying a neural network. ### Claim 12 (depends on 10) The system of claim 10, further comprising the one or more processor-based devices configured to: determine the first computer-controlled action, wherein the first computer-controlled action is determined, at least in part, by a statistical learning-based function. ### Claim 13 (depends on 10) The system of claim 10, further comprising the one or more processor-based devices configured to: perform the first computer-controlled action, wherein the first computer-controlled action comprises a search of one or more computer-implemented knowledge bases. ### Claim 14 (depends on 10) The system of claim 10, further comprising the one or more processor-based devices configured to: perform the first computer-controlled action, wherein the first computer-controlled action comprises modifying a structure of the one or more processor-based devices. ### Claim 15 (depends on 14) The system of claim 14, further comprising the one or more processor-based devices configured to: update the one or more probability distributions based upon the assessment of the result of the first computer-controlled action, wherein the result of first computer-controlled action comprises an inference from user behavioral information that is associated with the modified structure. ### Claim 16 (depends on 10) The system of claim 10, further comprising the one or more processor-based devices configured to: perform the first computer-controlled action, wherein the first computer-controlled action comprises applying one or more sensors to attain information that is expected to result in the reduction of the uncertainty. ### Claim 17 A system comprising one or more processor-based devices configured to: determine a first computer-controlled action that is expected to result in a reduction of uncertainty that is embodied by one or more probabilities, wherein the first computer-controlled action comprises performing an analysis of a first text-based content; perform the first computer-controlled action; update the one or more probabilities based on an assessment of a result of the first computer-controlled action; determine a second computer-controlled action in accordance with the updated one or more probabilities, wherein the second computer-controlled action comprises performing an analysis of a second text-based content; and perform the second computer-controlled action. ### Claim 18 (depends on 17) The system of claim 17, further comprising the one or more processor-based devices configured to: determine the first computer-controlled action that is expected to result in the reduction of uncertainty that is embodied by the one or more probabilities, wherein the first computer-controlled action comprises performing a search of text-based content and performing the analysis of the first text-based content, wherein the first text-based content is identified by the search. ### Claim 19 (depends on 17) The system of claim 17, further comprising the one or more processor-based devices configured to: determine the first computer-controlled action that is expected to result in the reduction of uncertainty that is embodied by the one or more probabilities, wherein the first computer-controlled action comprises performing the analysis of the first text-based content, wherein the analysis of the first text-based content comprises a statistical analysis of words in the text-based content. ### Claim 20 (depends on 17) The system of claim 17, further comprising the one or more processor-based devices configured to: determine the second computer-controlled action in accordance with the updated one or more probabilities and an expected value of information. ### Claim 21 (depends on 17) The system of claim 17, further comprising the one or more processor-based devices configured to: generate text-based content in accordance with the updated one or more probabilities.