# US 2016/0358494 A1 · Methods and systems for providing a learning path for an electronic learning system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0358494 A1
- Document ID: US20160358494A1
- Status: Published application
- Kind: A1
- Application number: 14/729,526
- Filed: 2015-06-03
- Published: 2016-12-08
- Earliest claimed: 2015-06-03
- Assignees: D2L Corporation
- Applicants: D2L Corporation
- Inventors: Jugoslav Bilic; Stephen John Michaud; Martin David Goodenough Bayly; Ryan Clayton Ogg
- Web page: https://patentgrep.com/patent/US20160358494A1

## CPC

- G09B 7/00: Electrically-operated teaching apparatus or devices working with questions and answers (mechanically operated G09B3/00; computing arrangements G06F)
- G09B 5/02: with visual presentation of the material to be studied, e.g. using film strip
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

Methods and systems for providing a learning path for an electronic learning system. The methods can include: retrieving learning objectives assigned to the learning path; for each learning objective, selecting resources assigned a relevance score satisfying a relevance threshold for that learning objective, the relevance score representing an estimated degree of correlation between that learning objective and the resource, and the relevance threshold indicating a minimum relevance score required for a resource to be selected; generating an initial learning path using the selected resources; identifying evaluation type resources which include an interaction for evaluating a proficiency of a user in relation to a subset of learning objectives; monitoring a feedback usage indicator for each evaluation type resource, the feedback usage indicator representing an amount of user interactions with that evaluation type resource; and updating the initial learning path to generate the learning path based on the feedback usage indicator.

## Claims

### Claim 1

A method for providing a learning path for an electronic learning system, the electronic learning system including a processor and at least one memory in electronic communication with the processor, the at least one memory storing one or more learning objectives, the method comprising:
retrieving, from the one or more learning objectives, a set of learning objectives assigned to the learning path;
for each learning objective of the set of learning objectives, selecting, from a plurality of resources accessible to the electronic learning system, one or more resources assigned a relevance score at least satisfying a relevance threshold for that learning objective, the relevance score representing an estimated degree of correlation between that learning objective and a content of the respective resource, and the relevance threshold indicating a minimum relevance score required for a resource to be selected for a learning objective;
generating an initial learning path using the selected one or more resources;
identifying one or more evaluation type resources from the selected one or more resources, each evaluation type resource comprises an interaction for evaluating a proficiency of a user in relation to at least a subset of learning objectives of the set of learning objectives;
monitoring a feedback usage indicator for each evaluation type resource of the selected one or more resources, the feedback usage indicator being stored in a storage component accessible to the electronic learning system and the feedback usage indicator representing an amount of user interactions with that evaluation type resource; and
updating the initial learning path to generate the learning path based on, at least, the feedback usage indicator of each evaluation type resource of the selected one or more resources.

### Claim 2 (depends on 1)

The method of claim 1, wherein updating the initial learning path to generate the learning path comprises:
for each evaluation type resource, determining whether the feedback usage indicator at least satisfies an initial usage threshold; and
in response to determining the feedback usage indicator at least satisfies the initial usage threshold, generating the learning path based on (i) the relevance score assigned to each resource of the one or more resources and (ii) a system learn value assigned to each resource selected for the subset of learning objectives associated with that evaluation type resource, otherwise, providing the initial learning path as the learning path;
wherein the system learn value is assigned to each resource selected for the subset of learning objectives after at least one user completes the respective evaluation type resource, and the system learn value represents a likelihood of that resource in assisting the at least one user achieve the respective learning objective.

### Claim 3 (depends on 2)

The method of claim 2, wherein generating the learning path based on the relevance score assigned to each resource and the system learn value assigned to each resource comprises:
applying a first weight to the relevance score and a second weight to the system learn value; and
generating a combined score based on the weighted relevance score and the weighted system learn value.

### Claim 4 (depends on 2)

The method of claim 2, wherein, in response to determining the feedback usage indicator exceeds the initial usage threshold, the method further comprises:
for each evaluation type resource, determining whether the feedback usage indicator exceeds a subsequent usage threshold; and
in response to determining the feedback usage indicator at least satisfies the subsequent usage threshold, generating the learning path based on the assigned system learn values, otherwise, generating the learning path based on the relevance score assigned to each resource and the system learn value assigned to each resource.

### Claim 5 (depends on 1)

The method of claim 1, wherein the relevance score assigned to a resource is generated based on a semantic analysis of each learning objective of the one or more learning objectives and the semantic analysis of the content of each resource of the one or more resources.

### Claim 6 (depends on 2)

The method of claim 2, wherein updating the initial learning path to generate the learning path comprises: rearranging an order in which the selected one or more resources is presented in the initial learning path.

### Claim 7 (depends on 6)

The method of claim 6, wherein rearranging the order in which the selected one or more resources is presented in the initial learning path comprises:
ordering at least some of the resources of the selected one or more resources according to the respective system learn values in a decreasing sequence.

### Claim 8 (depends on 2)

The method of claim 2, wherein updating the initial learning path to generate the learning path comprises at least one of (i) removing at least one resource of the selected one or more resources from the initial learning path and (ii) adding a different resource to the initial learning path.

### Claim 9 (depends on 8)

The method of claim 8, wherein removing the at least one resource of the selected one or more resources from the initial learning path comprises:
determining whether the system learn value assigned to the at least one resource is less than a learn value threshold, the learn value threshold corresponding to a minimum system learn value required for the at least one resource to be retained in the learning path; and
in response to determining the system learn value assigned to the at least one resource is less than the learn value threshold, removing the at least one resource from the initial learning path, otherwise, retaining the at least one resource in the learning path.

### Claim 10

An electronic learning system comprising:
a memory for storing one or more learning objectives; and
a processor in electronic communication with the memory, the processor operating to:
retrieve, from the one or more learning objectives, a set of learning objectives assigned to the learning path;
for each learning objective of the set of learning objectives, select, from a plurality of resources accessible to the electronic learning system, one or more resources assigned a relevance score at least satisfying a relevance threshold for that learning objective, the relevance score representing an estimated degree of correlation between that learning objective and a content of the respective resource, and the relevance threshold indicating a minimum relevance score required for a resource to be selected for a learning objective;
generate an initial learning path using the selected one or more resources;
identify one or more evaluation type resources from the selected one or more resources, each evaluation type resource comprises an interaction for evaluating a proficiency of a user in relation to at least a subset of learning objectives of the set of learning objectives;
monitor a feedback usage indicator for each evaluation type resource of the selected one or more resources, the feedback usage indicator being stored in a storage component accessible to the electronic learning system and the feedback usage indicator representing an amount of user interactions with that evaluation type resource; and
update the initial learning path to generate the learning path based on, at least, the feedback usage indicator of each evaluation type resource of the selected one or more resources.

### Claim 11 (depends on 10)

The electronic learning system of claim 10, wherein the processor operates to:
for each evaluation type resource, determine whether the feedback usage indicator at least satisfies an initial usage threshold; and
in response to determining the feedback usage indicator at least satisfies the initial usage threshold, generate the learning path based on (i) the relevance score assigned to each resource of the one or more resources and (ii) a system learn value assigned to each resource selected for the subset of learning objectives associated with that evaluation type resource, otherwise, provide the initial learning path as the learning path;
wherein the system learn value is assigned to each resource selected for the subset of learning objectives after at least one user completes the respective evaluation type resource, and the system learn value represents a likelihood of that resource in assisting the at least one user achieve the respective learning objective.

### Claim 12 (depends on 11)

The electronic learning system of claim 11 wherein the processor operates to:
apply a first weight to the relevance score and a second weight to the system learn value; and
generate a combined score based on the respective weighted relevance score and the weighted system learn value.

### Claim 13 (depends on 11)

The electronic learning system of claim 11, wherein the processor operates to:
for each evaluation type resource, determine whether the feedback usage indicator exceeds a subsequent usage threshold; and
in response to determining the feedback usage indicator at least satisfies the subsequent usage threshold, generate the learning path based on the assigned system learn values, otherwise, generate the learning path based on the relevance score assigned to each resource and the system learn value assigned to each resource.

### Claim 14 (depends on 10)

The electronic learning system of claim 10, wherein the relevance score assigned to a resource is generated based on a semantic analysis of each learning objective of the one or more learning objectives and the semantic analysis of the content of each resource of the one or more resources.

### Claim 15 (depends on 11)

The electronic learning system of claim 11, wherein the processor operates to rearrange an order in which the selected one or more resources is presented in the initial learning path.

### Claim 16 (depends on 15)

The electronic learning system of claim 15, wherein the processor further operates to order at least some of the resources of the selected one or more resources according to the respective system learn values in a decreasing sequence.

### Claim 17 (depends on 11)

The electronic learning system of claim 11, wherein the processor operates to update the initial learning path by performing at least one of (i) removing at least one resource of the selected one or more resources from the initial learning path and (ii) adding a different resource to the initial learning path.

### Claim 18 (depends on 17)

The electronic learning system of claim 17, wherein the processor operates to:
determine whether the system learn value assigned to the at least one resource is less than a learn value threshold, the learn value threshold corresponding to a minimum system learn value required for the at least one resource to be retained in the learning path; and
in response to determining the system learn value assigned to the at least one resource is less than the learn value threshold, remove the at least one resource from the initial learning path, otherwise, retain the at least one resource in the learning path.
