Multi-modal learning system
AssigneeLivescribe Inc.
InventorJim Marggraff
Life of this patent
Estimating the term…
Abstract
An instruction is presented to a user for making a target gesture. The target gesture may be a portion of an exemplary or model symbol. The instruction may be presented in various ways, such as being printed on a writing surface or being played in audio format through a speaker of a smart pen device. A writing gesture made on a writing surface by the user is digitally captured using a smart pen device. The captured writing gesture is compared to the target gesture and feedback is determined based on this comparison. This feedback may indicate the correctness of the user's writing gesture. The feedback may be presented to the user through various means, including through the smart pen device. The comparison may also be used to determine a next instruction for the user to follow.
Claims20
A method for instructing a student to create a plurality of target symbols, the method comprising:
- capturing, by a smart pen device, a plurality of instructional modules, each instructional module comprising a sequence of target gestures made by an instructor on a dot-enabled surface, wherein a target symbol is created by the sequence of target gestures;
- presenting to the student on a display of the smart pen device, a representation of the sequence of target gestures of a first instructional module;
- capturing, by the smart pen device, a second sequence of gestures made by the student on the dot-enabled surface, wherein a second symbol is created by the second sequence of gestures;
- comparing, by the smart pen device, the second symbol to the target symbol associated with the first instructional module and comparing the second sequence of gestures to the sequence of target gestures associated with the first instructional module;
- determining, by the smart pen device, feedback based on the comparisons, wherein the feedback indicates a similarity between the target symbol associated with the first instructional module and the second symbol made by the student, and a similarity between the sequence of target gestures associated with the first instructional module and the second sequence of gestures;
- presenting, by the smart pen device, the feedback to the student;
- selecting, by the smart pen device, a second instructional module based on the comparisons;
- and
- presenting to the student on the display of the smart pen device, a representation of the sequence of target gestures of the second instructional module.
A non-transitory computer-readable storage medium storing computer program instructions for instructing a student to create a plurality of target symbols, the instructions when executed by a processor cause the processor to perform steps comprising:
- capturing a plurality of instructional modules, each instructional module comprising a sequence of target gestures made by an instructor on a dot-enabled surface, wherein a target symbol is created by the sequence of target gestures;
- presenting to the student on a display of the smart pen device, a representation of the sequence of target gestures of a first instructional module;
- capturing a second sequence of gestures made on by the student on the dot-enabled surface, wherein a second symbol is created by the second sequence of gestures;
- comparing the second symbol to the target symbol associated with the first instructional module and comparing the second sequence of gestures to the sequence of target gestures associated with the first instructional module;
- determining feedback based on the comparisons, wherein the feedback indicates a similarity between the target symbol associated with the first instructional module and the second symbol made by the student, and a similarity between the sequence of target gestures associated with the first instructional module and the second sequence of gestures;
- presenting the feedback to the student;
- selecting a second instructional module based on the comparisons;
- and
- presenting to the student on the display of the smart pen device, a representation of the sequence of target gestures of the second instructional module.
A smart pen device for instructing a student to create a target symbol, the smart pen device comprising:
- a processor;
- and
- a non-transitory computer-readable storage medium storing computer-executable program instructions, the instructions when executed by the processor to perform steps including:
- capturing a plurality of instructional modules, each instructional module comprising a sequence of target gestures made by an instructor on a dot-enabled surface, wherein a target symbol is created by the sequence of target gestures;
- presenting to the student on a display of the smart pen device, a representation of the sequence of target gestures of a first instructional module;
- capturing a second sequence of gestures made by the student on the dot-enabled surface, wherein a second symbol is creating by the second sequence of gestures;
- comparing the second symbol to the target symbol associated with the first instructional module and comparing the second sequence of gestures to the sequence of target gestures associated with the first instructional module;
- determining feedback based on the comparisons, wherein the feedback indicates a similarity between the target symbol associated with the first instructional module and the second symbol made by the student, and a similarity between the sequence of target gestures associated with the first instructional module and the second sequence of gestures;
- presenting the feedback to the student;
- selecting a second instructional module based on the comparisons;
- and
- presenting to the student on the display of the smart pen device, a representation of the sequence of target gestures of the second instructional module.
Dependencies are inferred from the claim text.