# US 2020/0394058 A1 · Systems and methods for automated real-time selection and display of guidance elements in computer implemented sketch training environments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0394058 A1
- Document ID: US20200394058A1
- Status: Published application
- Kind: A1
- Application number: 16/901,962
- Filed: 2020-06-15
- Published: 2020-12-17
- Earliest claimed: 2019-06-14
- Assignees: eGrove Education, Inc.
- Applicants: eGrove Education, Inc.
- Inventors: Nathan Delson
- Web page: https://patentgrep.com/patent/US20200394058A1

## CPC

- G09B 11/00: Teaching hand-writing, shorthand, drawing, or painting
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 9/453: {Help systems}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06V 10/945: {User interactive design; Environments; Toolboxes}
- G06V 10/987: {with the intervention of an operator}
- G09B 7/04: characterised by modifying the teaching programme in response to a wrong answer, e.g. repeating the question or supplying a further explanation
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

In a computer implemented sketch-based education or training system, guidance elements are generated and output to users both on an affirmative request of the user and in an automated manner without a request for guidance from the user. Automated guidance may take the form of a mini-hint that does not provide explicit information about a solution. The automatically provided guidance elements may contain numerical measures of correspondence between a user submitted sketch and a model sketch.

## Claims

### Claim 1

A method of providing guidance to a user of a computer implemented educational system, the method comprising:
receiving user input via a computer sketch input interface, the user input defining a first computer sketch;
comparing the first computer sketch to a model computer sketch;
calculating a magnitude of one or more differences and/or similarities between the first computer sketch and the model computer sketch;
assigning a fail status to the first computer sketch based at least in part on the calculating; and
in response to the fail status, automatically outputting a guidance element to the user.

### Claim 2 (depends on 1)

The method of claim 1, wherein the guidance element comprises a graphic or textual output indicative of a quantitative measure of one or more differences and/or similarities between the first computer sketch and the model computer sketch.

### Claim 3 (depends on 2)

The method of claim 2, wherein the graphic or textual output does not include information identifying the position of any lines of the model computer sketch.

### Claim 4 (depends on 2)

The method of claim 2, wherein the graphic or textual output comprises a quantitative measure of how many lines in the first computer sketch correspond with lines in the model computer sketch.

### Claim 5 (depends on 2)

The method of claim 2, wherein the graphic or textual output comprises a quantitative measure of how many lines in the first computer sketch that are omitted with respect to the model computer sketch.

### Claim 6 (depends on 2)

The method of claim 2, wherein the graphic or textual output comprises a quantitative measure of how many lines in the model computer sketch are omitted in the first computer sketch.

### Claim 7 (depends on 1)

The method of claim 1, wherein the fail status is output to the user with the guidance element in a single display.

### Claim 8

An interactive education system comprising:
a computer sketch input interface;
a sketch generator executing on a processor configured to receive user interaction signals from the computer sketch input interface and generate a computer sketch defined thereby;
a pass/fail result generator executing on a processor configured to output a pass indication or a fail indication to the user based at least in part on a comparison between the sketch created by user interaction and the model sketch;
a guidance sketch comparator executing on a processor configured to receive the pass/fail result, and if the result is fail, automatically generate content for a guidance element based at least in part on a comparison between the sketch created by user interaction and the model sketch;
a guidance element generator executing on a processor configured to receive the content for a guidance element from the guidance sketch comparator and automatically output a guidance element to the user containing the content.

### Claim 9

In an interactive sketch education system, a method of generating guidance elements for outputting to a user of the interactive sketch education system, the method comprising:
comparing a computer sketch created by a user with a model computer sketch;
outputting to the user a guidance element based at least in part on the comparing, wherein the guidance element contains information indicating similarities and/or differences between the computer sketch created by the user and the model sketch without containing information indicating the location of any sketch component in the model sketch or in the sketch created by the user.

### Claim 10 (depends on 9)

The method of claim 9, wherein the information indicating similarities and/or differences is quantitative information.

### Claim 11 (depends on 9)

The method of claim 9 comprising automatically outputting the guidance element to the user without a user request for guidance.

### Claim 12

An interactive education system comprising:
a computer sketch input interface;
a sketch generator configured to receive user interaction signals from the computer sketch input interface and generate a computer sketch defined thereby;
a pass/fail result generator configured to output a pass indication or a fail indication to the user based at least in part on a comparison between the sketch created by user interaction and a model sketch;
a database storing information regarding one or more sketch errors that may be committed by a user when attempting to match the user generated computer sketch to the model sketch;
a guidance sketch comparator configured to receive the pass/fail result, and if the result is fail, generate content for a guidance element based at least in part on a comparison between one or more components of the sketch created by user interaction and the one or more sketch errors stored in the database;
a guidance element generator configured to receive the content for a guidance element from the guidance sketch comparator and output a guidance element to the user containing the content.
