# US 2021/0279669 A1 · Hybrid human-computer learning system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279669 A1
- Document ID: US20210279669A1
- Status: Published application
- Kind: A1
- Application number: 16/836,749
- Filed: 2020-03-31
- Published: 2021-09-09
- Earliest claimed: 2020-03-06
- Assignees: Anthrop LLC
- Applicants: Anthrop LLC
- Inventors: Richard GARDNER
- Web page: https://patentgrep.com/patent/US20210279669A1

## CPC

- G06Q 10/063112: {Skill-based matching of a person or a group to a task}
- G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06N 3/09: Supervised learning
- G06N 5/043: Distributed expert systems; Blackboards
- G06N 20/00: Machine learning
- G06Q 10/101: Collaborative creation, e.g. joint development of products or services
- G06N 3/042: Knowledge-based neural networks; Logical representations of neural networks
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A human-computer hybrid learning system may include an interconnected series of layers of nodes, where each node includes a communication device associated with a human expert. A task introduced into the first layer may be assessed and solved individually by experts of the first layer, and the solutions may be assessed and ranked by following layers. The system may automatically control selection of experts, communication between nodes, and generation of a final solution based on the results.

## Claims

### Claim 1

A data processing system for providing a solution to a user-supplied task, the data processing system comprising:
a memory;
one or more processors;
a plurality of instructions stored in the memory and executable by the one or more processors to:
receive task-related data corresponding to a selected task, wherein the task is identified with a selected domain of one or more domains of expertise;
from a plurality of experts, automatically select a first subset of experts associated with the selected domain and a second subset of experts associated with the selected domain;
communicate the task-related data to a plurality of first electronic devices, wherein each of the first electronic devices is associated with a respective one of the experts of the first subset;
receive from each of the experts of the first subset, via the first electronic devices, a respective task solution and an accompanying first confidence score;
generate a first set of task solutions based on the task solutions received from the experts of the first subset, sorted by the first confidence scores;
communicate the task-related data and the first set of task solutions to a plurality of second electronic devices, wherein each of the second electronic devices is associated with a respective one of the experts of the second subset;
receive from each of the experts of the second subset, via the second electronic devices, information indicating a respective selected solution chosen from the first set of task solutions and an accompanying second confidence score;
generate a second set of task solutions based on the information indicating the selected solutions, sorted by the second confidence scores;
generate a preliminary output based on the second set of task solutions; and
communicate a final output based on the preliminary output to a user interface.

### Claim 2 (depends on 1)

The system of claim 1, wherein the instructions are further executable to:
automatically associate the plurality of experts with one or more of the domains of expertise.

### Claim 3 (depends on 1)

The system of claim 1, wherein the instructions are further executable to:
communicate the task-related data and the preliminary output to the plurality of first electronic devices;
receive from each of the experts in the first subset, via the first electronic devices, information indicating a respective selected solution chosen from the preliminary output and an accompanying third confidence score;
generate a third set of task solutions based on the information indicating the selected solutions received from the first electronic devices, sorted by the third confidence score;
communicate the task-related data and the third set of task solutions to the plurality of second electronic devices;
receive from each of the experts in the second subset, via the second electronic devices, information indicating a respective selected solution chosen from the third set of task solutions and an accompanying fourth confidence score;
generate a fourth set of task solutions based on the information indicating the selected solutions from the second electronic devices, sorted by the fourth confidence score;
update the preliminary output based at least on the fourth set of task solutions prior to communicating the final output to the user interface.

### Claim 4 (depends on 1)

The system of claim 1, wherein the instructions are further executable to:
automatically select a third subset of the experts categorized in the selected domain;
communicate the task-related data and the second set of task solutions to a plurality of third electronic devices, wherein each of the third electronic devices is associated with a respective one of the experts of the third subset;
receive from each of the experts of the third subset, via the third electronic devices, information indicating a respective selected solution chosen from the second set of task solutions and an accompanying third confidence score;
generate a third set of task solutions based on the information indicating the selected task solutions received from the third electronic devices, sorted by the third confidence score;
update the preliminary output based on the third set of task solutions prior to communicating the final output to the user interface.

### Claim 5 (depends on 1)

The system of claim 1, wherein generating the second set of task solutions based on the information indicating the selected solutions includes sorting the second set by an aggregation of the first confidence scores and the second confidence scores.

### Claim 6 (depends on 5)

The system of claim 5, wherein the aggregation of the first confidence scores and the second confidence scores includes calculating an average of a combination of the first confidence scores and the second confidence scores.

### Claim 7 (depends on 6)

The system of claim 6, wherein the first confidence scores and the second confidence score are percentages from 0% to 100%.

### Claim 8 (depends on 1)

The system of claim 1, wherein the instructions are further executable to:
automatically assign a respective weight to each expert, wherein the respective weight of each expert is determined using historical data regarding a performance of the respective expert.

### Claim 9 (depends on 8)

The system of claim 8, wherein the instructions are further executable to:
automatically remove experts from the first subset and second subset that have a respective weight below a selected threshold.

### Claim 10 (depends on 1)

The system of claim 1, wherein the final output includes only a single solution.

### Claim 11

A data processing system for providing a solution to a user-supplied task, the data processing system comprising:
a memory;
one or more processors;
a plurality of instructions stored in the memory and executable by the one or more processors to:
receive task-related data corresponding to a selected task, wherein the task is identified with a selected domain of one or more domains of expertise;
from a plurality of experts, automatically select a first subset of experts, one or more intermediate subsets of experts, and a final subset of experts, wherein each of the subsets of experts is associated with the selected domain;
automatically assign a respective weight to each expert of the plurality of experts, wherein the respective weight of each expert is determined using historical performance data of the respective expert;
communicate the task-related data to a plurality of first electronic devices, wherein each of the first electronic devices is associated with a respective one of the experts of the first subset;
receive from each of the experts of the first subset of experts, via the first electronic devices, a respective subjective response and an accompanying first confidence score indicating a confidence of the respective expert in the subjective response;
generate an intermediate set of task solutions based on the subjective responses received from the experts of the first subset of experts, sorted by the first confidence scores;
with respect to each of the one or more intermediate subsets of experts, in series:
communicate the task-related data and the intermediate set of task solutions to a plurality of electronic devices, wherein each of the electronic devices is associated with a respective one of the experts of the respective intermediate subset of experts;
receive from each of the experts of the respective intermediate subset of experts, via the electronic devices, information indicating a respective selected solution chosen from the intermediate set of task solutions and an accompanying intermediate confidence score; and
update the intermediate set of task solutions based on the information indicating the selected solutions, sorted by the intermediate confidence scores;
communicate the intermediate task-related data to a plurality of final electronic devices, wherein each of the final electronic devices is associated with a respective one of the experts of the final subset of experts;
receive from each of the experts of the final subset of experts, via the final electronic devices, information indicating a respective selected solution chosen from the intermediate set of task solutions and an accompanying final confidence score; and
communicate, to a user interface, a final set of task solutions based on the information indicating the selected solutions.

### Claim 12 (depends on 11)

The system of claim 11, wherein the final set of task solutions includes only a single solution.

### Claim 13 (depends on 11)

The system of claim 11, wherein the final set of task solutions is sorted by an aggregation of the first confidence scores, the intermediate confidence scores, and the final confidence scores.

### Claim 14 (depends on 13)

The system of claim 13, wherein the aggregation of the first confidence scores, the intermediate confidence scores, and the final confidence scores is determined by calculating an average of a combination of the first confidence scores, the intermediate confidence scores, and the final confidence scores.

### Claim 15

(canceled)

### Claim 16 (depends on 11)

The system of claim 11, wherein the instructions are further executable to:
automatically remove experts from the first subset, the one or more intermediate subsets, and the final subset that have a respective weight below a selected threshold.

### Claim 17 (depends on 11)

The system of claim 11, wherein the instructions are further executable to:
automatically preprocess the task-related data prior to communicating the task-related data to the plurality of first electronic devices.

### Claim 18 (depends on 17)

The system of claim 17, wherein preprocessing the task-related data comprises encrypting portions of the task-related data.

### Claim 19 (depends on 11)

The system of claim 11, wherein the first confidence scores, the intermediate confidence scores, and the final confidence scores are percentages ranging from 0% to 100%.

### Claim 20 (depends on 11)

The system of claim 11, wherein one or more of the electronic devices comprises a mobile device.
