# US 12,222,976 B2 · Sensor based processing of data from a user for learning using artificial intelligence module > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,222,976 B2 - Document ID: US12222976B2 - Status: Granted - Kind: B2 - Application number: 17/836,770 - Filed: 2022-06-09 - Published: 2022-10-06 - Granted: 2025-02-11 - Earliest claimed: 2018-01-19 - Assignees: Amesite Inc. - Applicants: Amesite Inc. - Inventors: Ann Marie Sastry - Web page: https://patentgrep.com/patent/US12222976B2 ## CPC - G06F 16/48: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06F 16/38: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06F 16/58: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06F 16/78: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06F 16/9035: Filtering based on additional data, e.g. user or group profiles - G06N 3/0499: Feedforward networks - G06N 3/08: Learning methods - G06N 20/00: Machine learning - G09B 5/06: with both visual and audible presentation of the material to be studied - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract In an example, the present invention provides a meta data processing apparatus for processing sensor inputs and providing feedback to a user for an on-line course. ## Claims ### Claim 1 A method of operating an apparatus for processing sensor inputs and providing feedback to a user for an on-line course, the method comprising: in the apparatus comprising: a housing configured with a display device, the display device coupled to an input device for communicating text information from a user; a processing device; a network interface coupled to the processing device, the network interface being configured to couple to a network of computers; a memory resource coupled to the processing device; an application comprising a course module, the course module comprising a plurality of templates and at least one video file; an image capturing device coupled to the housing and configured to the processing device, the image capturing device being configured to capture an image of at least a facial expression of the user while the user is interacting with the course module; one or more spatial orientation sensors configured to identify a spatial orientation of the user while the user is interacting with the course module; a natural language processor configured for processing information from the text information while the user is interacting with the course module; an artificial intelligence module coupled to the processing device, the artificial intelligence module comprising a neural network module comprising a plurality of nodes respectively coupled to the image capturing device, the natural language processor, and the one or more spatial orientation sensors; using the artificial intelligence module to: receive user-related information from the one or more spatial orientation sensors, image capturing device, or natural language processor, and output feedback information according to the user-related information; and an output handler coupled to the output of the neural network module, the output handler configured to provide feedback according to the feedback information to the user. ### Claim 2 (depends on 1) The method of claim 1 wherein the feedback comprises a plurality of characteristics to allow the user to achieve a predetermined score within a range for the course. ### Claim 3 (depends on 1) The method of claim 1 wherein the natural language processor is configured to process the text information to identify a characteristic of the user in association with the course, and the neural network module produces the feedback information according to the characteristic of the user. ### Claim 4 (depends on 1) The method of claim 1, further comprising: one or more additional sensors, the one or more additional sensors including a keyboard, an accelerometer sensor, an rf sensor, a gyroscope, a chemical sensor, a temperature sensor, or a microphone, wherein the neural network module is configured to also receive the user-related information from the one or more additional sensors. ### Claim 5 (depends on 1) The method of claim 1 further comprising a wearable device comprising a set of sensors to characterize movement, orientation, temperature, heart rate, or breathing rate of the user while interacting with the course, wherein the neural network module is configured to also receive the user-related information from the wearable device. ### Claim 6 (depends on 1) The method of claim 1 wherein the neural network module is configured to receive information from the image capturing device and output a learning characteristic of the user in the feedback information. ### Claim 7 (depends on 1) The method of claim 1, further comprising using the neural network module to: receive information associated with the facial expression captured by the image capturing device and an eye response captured by the image capturing device, and output a learning characteristic of the user in the feedback information. ### Claim 8 A method of operating an apparatus for processing sensor inputs and providing feedback to a user for an on-line course and to configure the on-line course, the method comprising: in the apparatus comprising: a housing configured with a display device, the display device coupled to an input device for communicating text information from a user; a processing device; a network interface coupled to the processing device, the network interface being configured to couple to a network of computers; a memory resource coupled to the processing device; an application comprising a course module, the course module comprising a plurality of templates and at least one video file; an image capturing device coupled to the housing and configured to the processing device, the image capturing device being configured to capture an image of at least a facial expression of the user while the user is interacting with the course module; one or more spatial orientation sensors configured to identify a spatial orientation of the user while the user is interacting with the course module; a natural language processor configured for processing information from the text information while the user is interacting with the course module; an artificial intelligence module coupled to the processing device, the artificial intelligence module comprising a neural network module comprising a plurality of nodes respectively coupled to the image capturing device, the natural language processor, and the one or more spatial orientation sensors; using the artificial intelligence module to: receive user-related information from the one or more spatial orientation sensors, image capturing device, or natural language processor, and output feedback information according to the user-related information; and an output handler coupled to the output of the neural network module, the output handler configured to provide feedback according to the feedback information to the user and configure the on-line course. ### Claim 9 (depends on 8) The method of claim 8 wherein the feedback comprises a plurality of characteristics to allow the user to achieve a predetermined score within a range for the course; wherein the on-line course comprises a personally designed course based upon the feedback to the user. ### Claim 10 (depends on 8) The method of claim 8 wherein the natural language processor is configured to process the text information to identify a characteristic of the user in association with the course, the natural language processor comprising a rule based processing process or a statistical based processing process. ### Claim 11 (depends on 8) The method of claim 8, further comprising, one or more additional sensors, the one or more additional sensors including a keyboard, an accelerometer sensor, an rf sensor, a gyroscope, a chemical sensor, a temperature sensor, or a microphone, wherein the neural network module is configured to also receive the user-related information from the one or more additional sensors. ### Claim 12 (depends on 8) The apparatus of claim 8 further comprising a wearable device comprising a set of sensors to characterize movement, orientation, temperature, heart rate, or breathing rate of the user while interacting with the course, wherein the neural network module is configured to also receive the user-related information from the wearable device. ### Claim 13 (depends on 8) The apparatus of claim 8 further comprising using the neural network module to receive information from the image capturing device and output a learning characteristic of the user in the feedback information. ### Claim 14 (depends on 8) The method of claim 8, further comprising using the neural network module to: receive information associated with the facial expression captured by the image capturing device and an eye response captured by the image capturing device, and output a learning characteristic of the user in the feedback information.