# US 11,443,653 B2 · Method and system for skill learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,443,653 B2
- Document ID: US11443653B2
- Status: Granted
- Kind: B2
- Application number: 16/594,738
- Filed: 2019-10-07
- Published: 2020-12-10
- Granted: 2022-09-13
- Earliest claimed: 2019-06-06
- Assignees: National Taiwan Normal University
- Applicants: National Taiwan Normal University
- Inventors: Jon-Chao Hong; Kai-Hsin Tai; Jian-Hong Ye
- Web page: https://patentgrep.com/patent/US11443653B2

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G09B 19/003: {Repetitive work cycles; Sequence of movements}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G09B 5/02: with visual presentation of the material to be studied, e.g. using film strip
- G09B 19/24: Use of tools
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

A method for skill learning is implemented using a system including a wearable device to be worn by a user, a storage unit, and a processor communicating with the wearable device and the storage unit. The storage unit stores a plurality of virtual reality modules in the storage unit, each of the virtual reality modules containing interactive data associated with learning a skill. The method includes: accessing the storage unit to load a selected one of the virtual reality modules; and controlling the wearable device to present the interactive data contained in the selected one of the virtual reality modules to the user in the form of a virtual environment.

## Claims

### Claim 1

A method for skill learning, implemented using a system including a wearable device worn by a user, a storage unit, and a processor communicating with the wearable device and the storage unit, the storage unit storing a plurality of virtual reality modules therein, each of the virtual reality modules containing interactive data associated with learning a skill, the wearable device including a display unit and an input unit, the method comprising:
accessing, by the processor, the storage unit to load a selected one of the virtual reality modules; and
controlling, by the processor, the wearable device to present the interactive data contained in the selected one of the virtual reality modules to the user in the form of a virtual environment;
the method further comprising, after presenting the interactive data:
detecting, by the input unit, a hand gesture of the user and generating a gesture signal corresponding with the hand gesture;
in response to receipt of the gesture signal from the input unit, generating, by the processor, an interactive gesture presentation based on the gesture signal; and
controlling, by the processor, the wearable device to further present the interactive gesture presentation in the virtual environment;
the method further comprising, prior to accessing the storage unit to load the selected one of the virtual reality modules:
controlling, by the processor, the wearable device to present a selection screen, the selection screen including a plurality of skill options each corresponding with a skill, and a plurality of mode options each corresponding with an operation mode; and
in response to receipt of a selection signal indicating one of the skill options and one of the mode options, transmitting, by the input unit, the selection signal to the processor;
wherein:
the processor loads a selected one of the virtual reality modules based on the selection signal;
one of the mode options corresponds with a practice mode;
the selected one of the virtual reality modules includes a practice sub-module corresponding with the practice mode, the practice sub-module containing interactive data that includes a cognitive scaffolding network, the cognitive scaffolding network including a plurality of scaffolding elements; and
when the practice mode is selected, the step of presenting the interactive data includes presenting at least one of the scaffolding elements in the virtual environment, and the scaffolding elements include a number cue indicating an order of operation, and one or more of an arrow, a broken line, a text message, and a visual cue.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
one of the mode options corresponds with an evaluation mode;
the selected one of the virtual reality modules includes an evaluation sub-module corresponding with the evaluation mode; and
when the evaluation mode is selected, the step of presenting the interactive data includes not presenting the scaffolding elements in the virtual environment.

### Claim 3 (depends on 2)

The method of claim 2, further comprising, after presenting the interactive data:
in response to receipt of the gesture signal from the input unit in the evaluation mode, generating, by the processor, an evaluation result based on the gesture signal.

### Claim 4 (depends on 3)

The methods of claim 3, further comprising storing the evaluation result in the storage unit.

### Claim 5 (depends on 1)

The method of claim 1, wherein one of the virtual reality modules is associated with preparing food on a cutting board using a kitchen knife.

### Claim 6 (depends on 1)

The method of claim 1, wherein one of the virtual reality modules is associated with auto detailing to be performed on an exterior of an automobile.

### Claim 7

A system for skill learning, comprising:
a wearable device to be worn by a user;
a storage unit storing a plurality of virtual reality modules therein, each of the virtual reality modules containing interactive data associated with learning a skill; and
a processor communicating with said wearable device and said storage unit, wherein said processor is configured to:
access said storage unit to load a selected one of the virtual reality modules; and
control said wearable device to present the interactive data contained in the selected one of the virtual reality modules to the user in the form of a virtual environment;
wherein:
said wearable device includes a display unit and an input unit;
after presenting the interactive data, said input unit is configured to detect a hand gesture of the user and generate a gesture signal corresponding with the hand gesture;
in response to receipt of the gesture signal from the input unit, said processor generates an interactive gesture presentation based on the gesture signal, and controls said wearable device to further present the interactive gesture presentation in the virtual environment;
wherein, prior to accessing said storage unit to load the selected one of the virtual reality modules:
said processor controls said wearable device to present a selection screen, the selection screen including a plurality of skill options each corresponding with a skill, and a plurality of mode options each corresponding with an operation mode; and
in response to receipt of a selection signal indicating one of the skill options and one of the mode options, said input unit transmits the selection signal to the processor;
wherein said processor loads a selected one of the virtual reality modules based on the selection signal;
wherein, prior to accessing said storage unit to load the selected one of the virtual reality modules:
said processor controls said wearable device to present a selection screen, the selection screen including a plurality of skill options each corresponding with a skill, and a plurality of mode options each corresponding with an operation mode; and
in response to receipt of a selection signal indicating one of the skill options and one of the mode options, said input unit transmits the selection signal to the processor;
wherein said processor loads a selected one of the virtual reality modules based on the selection signal;
wherein:
one of the mode options corresponds with a practice mode;
the selected one of the virtual reality modules includes a practice sub-module corresponding with the practice mode, the practice sub-module containing interactive data that includes a cognitive scaffolding network, the cognitive scaffolding network including a plurality of scaffolding elements; and
when the practice mode is selected, said processor further controls said wearable device to present at least one of the scaffolding elements in the virtual environment, and the scaffolding elements include a number cue indicating an order of operation, and one or more of an arrow, a broken line, a text message, and a visual cue.

### Claim 8 (depends on 7)

The system of claim 7, wherein:
one of the mode options corresponds with an evaluation mode;
the selected one of the virtual reality modules includes an evaluation sub-module corresponding with the evaluation mode; and
when the evaluation mode is selected, said processor further controls said wearable device to not present the scaffolding elements in the virtual environment.

### Claim 9 (depends on 8)

The system of claim 8, wherein, after presenting the interactive data, in response to receipt of the gesture signal from said input unit in the evaluation mode, said processor generates an evaluation result based on the gesture signal.

### Claim 10 (depends on 9)

The system of claim 9, wherein said processor further stores the evaluation result in said storage unit.

### Claim 11 (depends on 7)

The system of claim 7, wherein one of the virtual reality modules is associated with preparing food on a cutting board using a kitchen knife.

### Claim 12 (depends on 7)

The system of claim 7, wherein one of the virtual reality modules is associated with auto detailing to be performed on an exterior of an automobile.