# US 10,872,535 B2 · Facilitating facial recognition, augmented reality, and virtual reality in online teaching groups > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,872,535 B2 - Document ID: US10872535B2 - Status: Granted - Kind: B2 - Application number: 15/485,876 - Filed: 2017-04-12 - Published: 2017-08-03 - Granted: 2020-12-22 - Earliest claimed: 2009-07-24 - Assignees: Tutor Group Limited - Applicants: Tutor Group Limited - Inventors: Cheng-Ta Yang - Web page: https://patentgrep.com/patent/US10872535B2 ## CPC - G09B 5/06: with both visual and audible presentation of the material to be studied - G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay} - G06Q 30/02: Marketing; Price estimation or determination; Fundraising - G06Q 50/20: Education - G06T 11/60: Creating or editing images; Combining images with text - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06V 40/165: {using facial parts and geometric relationships} - G09B 5/00: Electrically-operated educational appliances (working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F) - G09B 5/14: with provision for individual teacher-student communication - G09B 7/00: Electrically-operated teaching apparatus or devices working with questions and answers (mechanically operated G09B3/00; computing arrangements G06F) - G09B 7/02: of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student - H04L 12/18: for broadcast or conference {, e.g. multicast} - H04L 43/045: for graphical visualisation of monitoring data - H04L 51/10: Multimedia information - H04L 51/18: Commands or executable codes - H04L 65/1083: In-session procedures - H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) - H04L 67/131: Protocols for games, networked simulations or virtual reality - G09B 19/06: Foreign languages (with audible presentation of material to be studied G09B5/04) - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract An online learning management system and method for facilitating facial recognition, augmented reality, and virtual reality learning environments for users distributed across a network is disclosed. The system includes a server and one or more clients coupled by a network, each of the one or more clients having a learning environment. In some embodiments, the server receives and detects a network status of each client and dynamically adjusts a synchronization frequency of each associated learning environment. The learning environment may be an augmented reality learning environment having one or more face masks and/or stickers applied to facial features of a user in a video signal, wherein the server synchronizes the augmented reality learning environment among each client. The learning environment may further be a virtual reality learning environment having one or more 3D objects in a 3D scene, wherein the server synchronizes the virtual reality learning environments. ## Claims ### Claim 1 A method for generating and synchronizing an augmented reality learning environment, the method comprising: rendering an augmented reality learning environment through a graphical user interface; receiving one or more user inputs; transforming the user inputs into augmented reality identification information; sending synchronization information including network status information and the augmented reality identification information, wherein the synchronization information further includes a synchronization frequency that comprises a length of time between synchronization events based on the network status information, the network status information indicating a small upload/download bandwidth of a client; receiving updated synchronization information; updating the augmented reality learning environment based on the received synchronization information, the updated synchronization information includes an update to the synchronization frequency including a longer length of time between the synchronization events to facilitate all of the synchronization information being transferred to and from the client. ### Claim 2 (depends on 1) The method as recited in claim 1, wherein the augmented reality learning environment comprises one or more video signals, each video signal corresponding to one or more clients. ### Claim 3 (depends on 2) The method as recited in claim 2, wherein the augmented reality identification information includes a selection of a face mask or sticker corresponding to a video signal of the one or more video signals. ### Claim 4 (depends on 3) The method as recited in claim 3, further comprising identifying a location and an orientation of one or more facial features in the video signal using facial recognition, and updating a location and an orientation of the face mask or sticker based on the identified location and orientation of the one or more facial features. ### Claim 5 (depends on 3) The method as recited in claim 3, wherein the updating the augmented reality learning environment includes applying the face mask or sticker to the corresponding video signal. ### Claim 6 A method for generating and synchronizing a virtual reality learning environment, the method comprising: rendering a virtual reality learning environment through a graphical user interface; receiving one or more user inputs; transforming the user inputs into object position and orientation information; sending synchronization information including network status information and the object position and orientation information, wherein the synchronization information further includes a synchronization frequency that comprises a length of time between synchronization events based on the network status information, the network status information indicating a small upload/download bandwidth of a client; receiving updated synchronization information; updating the virtual reality learning environment based on the received synchronization information, the synchronization information includes an update to the synchronization frequency including an increase to the length of time between the synchronization events to facilitate all of the synchronization information being transferred to and from the client. ### Claim 7 (depends on 6) The method as recited in claim 6, wherein the virtual reality learning environment comprises a 3D scene having one or more 3D objects. ### Claim 8 (depends on 7) The method as recited in claim 7, wherein the received one or more user input corresponds to a 3D object of the one or more 3D objects. ### Claim 9 (depends on 6) The method as recited in claim 6, wherein the updated synchronization information includes a signal to play a sound effect or an animation. ### Claim 10 (depends on 6) The method as recited in claim 6, wherein the updated synchronization information includes updated object position and orientation information, the updating the virtual reality learning environment including updating a position and an orientation of a 3D object. ### Claim 11 (depends on 6) The method as recited in claim 6, wherein the rendering includes rendering the virtual reality learning environment via a virtual reality headset. ### Claim 12 A method for synchronizing learning environments of one or more clients, the method comprising: receiving synchronization information from one or more clients; determining a controlling client of the one or more clients; updating learning environment information for the one or more clients based on synchronization information received from the controlling client; determining a synchronization frequency of each of the one or more clients based on network status information, the synchronization frequency comprises a length of time between synchronization events based on the network status information, the network status information indicating a small upload/download bandwidth of a client; sending updated synchronization information including the updated learning environment information and the determined synchronization frequency to the one or more clients, the updated synchronization information including an update to the synchronization frequency including an increase to the length of time between the synchronizations events to facilitate all of the synchronization information being transferred to and from a client. ### Claim 13 (depends on 12) The method as recited in claim 12, wherein the synchronization information includes augmented reality identifiers indicating one or more face masks, each face mask corresponding to a video signal of a respective client. ### Claim 14 (depends on 13) The method as recited in claim 13, wherein the updated synchronization information further includes the augmented reality identifiers. ### Claim 15 (depends on 12) The method as recited in claim 12, wherein the synchronization information includes object position and orientation information of one or more 3D objects of a 3D scene. ### Claim 16 (depends on 15) The method as recited in claim 15, wherein updating the learning environment includes updating a position and an orientation of one or more 3D objects in the learning environment based on the synchronization information received from the controlling client. ### Claim 17 (depends on 12) The method as recited in claim 12, wherein determining a controlling client includes providing a switch controller to manage which client of the one or more clients is the controlling client.