# US 2023/0058321 A1 · Systems and methods for personalized exercise protocols and tracking thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2023/0058321 A1 - Document ID: US20230058321A1 - Status: Published application - Kind: A1 - Application number: 17/375,518 - Filed: 2021-07-14 - Published: 2023-02-23 - Earliest claimed: 2020-07-15 - Assignees: IncludeHealth, Inc. - Applicants: Includehealth, Inc. - Inventors: James Ryan Eder - Web page: https://patentgrep.com/patent/US20230058321A1 ## CPC - A61B 5/1128: {using image analysis (A61B5/1127 takes precedence)} - A63B 24/0062: {Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance} - A61B 5/1122: {of movement trajectories} - A61B 5/1124: {Determining motor skills} - A61B 5/486: {Biofeedback (using electroencephalography [EEG] A61B5/375)} - A63B 24/0006: {Computerised comparison for qualitative assessment of motion sequences or the course of a movement} - A63B 24/0075: {Means for generating exercise programmes or schemes, e.g. computerized virtual trainer, e.g. using expert databases} - G06V 40/23: {Recognition of whole body movements, e.g. for sport training} - G09B 19/0038: {Sports} - G16H 20/30: relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising - A61B 2503/10: Athletes - A61B 2505/07: Home care - A61B 2505/09: Rehabilitation or training - A63B 2024/0068: {Comparison to target or threshold, previous performance or not real time comparison to other individuals} - A63B 2024/0071: {Distinction between different activities, movements, or kind of sports performed} - A63B 2220/05: Image processing for measuring physical parameters - A63B 2220/806: Video cameras - G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - A63B: APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT (apparatus for passive exercising, massage A61H) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA ## Abstract Systems and methods for providing a customized exercise protocol to a computing device of a user. As the user performs the exercise protocol, one or more cameras of the computing device can track the user's movements. The user's movement are assessed to determine if proper form and technique is being used. ## Claims ### Claim 1 A fitness tracking computing system comprising instructions stored in a memory, which when executed by one or more processors of the fitness tracking computing system, cause the fitness tracking computing system to: receive a personalized exercise protocol associated with a user; store the personalized exercise protocol in a data store; receive video data from a computing device via a communications network, wherein the computing device is operated by the user, wherein the computing device comprises a display and a camera, and wherein the video data comprises metadata and images of the user collected the camera; based on the metadata, determine an operational parameter of the computing device; based on the operational parameter of the computing device, adjust a setting of a body tracking model; cause a personalized movement instruction to be displayed on the display of the computing device, wherein the personalized movement instruction is based on the personalized exercise protocol; subsequent to adjusting the setting of the body tracking model, analyze the video data using the body tracking model to track real-time movements of the user to determine compliance with the personalized movement instruction; and cause visual feedback to be displayed on the display of the computing device. ### Claim 2 (depends on 1) The fitness tracking computing system of claim 1, wherein the personalized exercise protocol comprises an exercise protocol selected from a protocol library by a practitioner. ### Claim 3 (depends on 1) The fitness tracking computing system of claim 1, wherein the personalized exercise protocol comprises a plurality of exercises inputted by a practitioner. ### Claim 4 (depends on 1) The fitness tracking computing system of claim 1, wherein the instructions stored in a memory further cause the fitness tracking computing system to: generate reporting data for the user, wherein the reporting data comprises demographic data of the user and compliance data of the user. ### Claim 5 (depends on 1) The fitness tracking computing system of claim 1, wherein the metadata comprises performance data of the camera and a screen resolution of the display. ### Claim 6 (depends on 5) The fitness tracking computing system of claim 5, wherein the camera is a built-in component of the computing device. ### Claim 7 (depends on 1) The fitness tracking computing system of claim 1, wherein the visual feedback provides real-time range of motion feedback. ### Claim 8 (depends on 7) The fitness tracking computing system of claim 7, wherein the visual feedback provides a repetition counter. ### Claim 9 (depends on 8) The fitness tracking computing system of claim 8, wherein the instructions stored in a memory further cause the fitness tracking computing system to: advance the repetition counter only when real-time movements of the user comply with the personalized movement instruction. ### Claim 10 (depends on 9) The fitness tracking computing system of claim 9, wherein determining compliance with the personalized movement instruction is based on a tolerance window for the user. ### Claim 11 (depends on 1) The fitness tracking computing system of claim 1, wherein the visual feedback comprises real-time images of the user collected by the camera. ### Claim 12 (depends on 1) The fitness tracking computing system of claim 1, wherein the visual feedback comprises a movement tolerance graphic correlated to the personalized exercise protocol, a movement reference indicator, and a real-time biometric marker graphical indicator. ### Claim 13 (depends on 12) The fitness tracking computing system of claim 12, wherein the instructions stored in a memory further cause the fitness tracking computing system to: move the real-time biometric marker graphical indicator on the display relative to the movement tolerance graphic based on the real-time movements of the user. ### Claim 14 (depends on 13) The fitness tracking computing system of claim 13, wherein the instructions stored in a memory further cause the fitness tracking computing system to: modify the visual appearance of the real-time biometric marker graphical indicator when the real-time biometric marker graphical indicator crosses the movement reference indicator. ### Claim 15 (depends on 1) The fitness tracking computing system of claim 1, wherein the setting is a video scale factor. ### Claim 16 (depends on 1) The fitness tracking computing system of claim 1, wherein the setting is a buffer length. ### Claim 17 A method, comprising: receiving a plurality of personalized exercise protocols, wherein each one of the plurality of personalized exercise protocols is associated with a respective one of a plurality of users; receiving video data from a computing device via a communications network, wherein the computing device is operated by a user, wherein the user is one of the plurality of users, wherein the computing device comprises a display and a camera, and wherein the video data comprises metadata and images of the user collected the camera; based on the metadata, determining an operational parameter of the computing device; based on the operational parameter of the computing device, adjusting a setting of a body tracking model; determining which of the plurality of personalized exercise protocols is associated with the user of the computing device; causing a personalized movement instruction to be displayed on the display of the computing device, wherein the personalized movement instruction is based on the personalized exercise protocol associated with the user; subsequent to adjusting the setting of the body tracking model, analyzing the video data using the body tracking model to track real-time movements of the user to determine compliance with the personalized movement instruction; and causing visual feedback to be displayed on the display of the computing device. ### Claim 18 (depends on 17) The method of claim 17, wherein the personalized movement instruction comprises a user position instruction and an exercise instruction. ### Claim 19 (depends on 18) The method of claim 18, further comprising: causing the display of the exercise instruction only after the user has complied with the user position instruction. ### Claim 20 A fitness tracking computing system comprising instructions stored in a memory, which when executed by one or more processors of the fitness tracking computing system, cause the fitness tracking computing system to: receive a personalized exercise protocol associated with a user; receive video data from a computing device via a web-based communications, wherein the computing device is executing a web browsing application, wherein the computing device comprises a display and a camera, and wherein the video data comprises metadata and images of a user of the computing device collected the camera; based on the metadata, determine performance data of the camera and a screen resolution of the display; based on at least one of the performance data of the camera and the screen resolution of the display, adjust a setting of a body tracking model, wherein the setting is any of a video scale factor and buffer length; cause a personalized movement instruction to be displayed on the display of the computing device, wherein the personalized movement instruction is based on the personalized exercise protocol; subsequent to adjusting the setting of the body tracking model, analyze the video data using the body tracking model to track real-time movements of the user; and cause visual feedback to be displayed on the display of the computing device. ### Claim 21 (depends on 20) The fitness tracking computing system of claim 20, wherein the camera is a built-in component of the computing device. ### Claim 22 (depends on 20) The fitness tracking computing system of claim 20, wherein the visual feedback provides real-time range of motion feedback. ### Claim 23 (depends on 20) The fitness tracking computing system of claim 20, wherein the instructions stored in a memory further cause the fitness tracking computing system to: cause a repetition counter to be displayed on the display; and advance the repetition counter only when real-time movements of the user are determined to comply with the personalized movement instruction. ### Claim 24 (depends on 23) The fitness tracking computing system of claim 23, wherein determining compliance with the personalized movement instruction is based on a tolerance window for the user. ### Claim 25 (depends on 20) The fitness tracking computing system of claim 20, wherein the visual feedback comprises a movement tolerance graphic correlated to the personalized exercise protocol, a movement reference indicator, and a real-time biometric marker graphical indicator.