# US 11,896,882 B2 · Extended reality system for training and evaluation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,896,882 B2 - Document ID: US11896882B2 - Status: Granted - Kind: B2 - Application number: 17/519,110 - Filed: 2021-11-04 - Published: 2022-05-05 - Granted: 2024-02-13 - Earliest claimed: 2020-11-04 - Assignees: XReps, LLC - Applicants: Xreps, LLC - Inventors: Joel Stephens; Rohit Chaube; Brandon Fuhr; Greg Elliott - Web page: https://patentgrep.com/patent/US11896882B2 ## CPC - A63B 69/002: {for football (American-football dummies A63B69/34)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G02B 27/017: {Head mounted} - G06F 3/012: {Head tracking input arrangements} - G06F 3/0325: {using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image} - G09B 5/02: with visual presentation of the material to be studied, e.g. using film strip - G09B 9/00: Simulators for teaching or training purposes (for the use of weapons F41; computing aspects G06; {protocols for games, networked simulations or virtual reality H04L67/131}) - G09B 9/006: {for locating or ranging of objects} - G09B 19/0038: {Sports} - A63B: APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT (apparatus for passive exercising, massage A61H) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract A tracking system includes a host station and a sensor station. The sensor station includes transmitters transmitting an IR synchronous signal and IR laser signal. The system includes a head-mounted display and a tracked object, which has a plurality of object sensors. The tracked object determines its location and orientation relative to the sensor station based on the IR signals. The tracked object transmits the location and orientation to the host station. The host station determines an actual flight path of the tracked object during an object tracking event; generates a predicted flight path of the tracked object; and renders an image of a virtual object on a display of the head-mounted display. The image includes a virtual object corresponding to the tracked object, wherein the image is rendered in a VR environment such that the virtual object moves along the actual flight path and the predicted flight path. ## Claims ### Claim 1 A system comprising: a tracking system comprising a host station and a sensor station, said sensor station including a first transmitter transmitting an infrared (IR) synchronous signal, and a second transmitter transmitting an IR laser signal, wherein the IR synchronous signal and the IR laser signal are broadcast across a user-definable area; a head-mounted display including a display displaying a virtual reality (VR) environment; and a tracked object including a plurality of object sensors sensing the IR synchronous signal and the IR laser signal, said tracked object determining an object location and an object orientation of the tracked object relative to the sensor station based on the IR synchronous signal and the IR laser signal, said tracked object transmitting the object location and the object orientation to the host station, said host station comprising a processor coupled in communication to the tracked object and the head-mounted display, said processor programmed to: determine an actual flight path of the tracked object during an object tracking event where the tracked object is moving relative to the sensor station, the actual flight path based on the object location and the object orientation of the tracked object; generate a predicted flight path of the tracked object based on the object location and the object orientation of the tracked object; and render an image of a virtual object on the display of the head-mounted display in the VR environment, wherein the image includes an image of a virtual object corresponding to the tracked object, wherein the image of the virtual object is rendered in the VR environment such that the image of the virtual object moves along the actual flight path rendered in the VR environment on the display and the predicted flight path rendered in the VR environment on the display. ### Claim 2 (depends on 1) The system in accordance with claim 1, wherein the sensor station transmits the IR synchronous signal and the IR laser signal at a frequency in a range between and including about fifty-five (55) times per second (Hz) and about one hundred and five times per second (105 Hz). ### Claim 3 (depends on 2) The system in accordance with claim 2, wherein the sensor station transmits the IR synchronous signal and the IR laser signal at a frequency of about one hundred times per second (100 Hz). ### Claim 4 (depends on 1) The system in accordance with claim 1, further comprising an object capture system including a plurality of apparatus sensors sensing the IR synchronous signal and the IR laser signal, said object capture system determining a frame location and a frame orientation of the object capture system relative to the sensor station based on the IR synchronous signal and the IR laser signal, said object capture system transmitting the frame location and the frame orientation to the host station. ### Claim 5 (depends on 1) The system in accordance with claim 1, said processor further programmed to detect a tracked object release, wherein external influences on the tracked object are only from natural forces. ### Claim 6 (depends on 5) The system in accordance with claim 5, wherein the tracked object transmits the object location and the object orientation of the tracked object to the host station at a frequency in a range between and including about fifty-five (55) times per second (Hz) and about one hundred and five times per second (105 Hz). ### Claim 7 (depends on 6) The system in accordance with claim 6, said operation to detect the tracked object release comprises said processor programmed to: receive data defining a trigger volume located in the user-definable area; and detect when the location of the tracked object has entered the trigger volume. ### Claim 8 (depends on 7) The system in accordance with claim 7, said operation to determine an actual flight path of the tracked object comprises said processor programmed to determine the actual flight path of the tracked object based on continuously updated location data associated with the tracked object within the trigger volume. ### Claim 9 (depends on 6) The system in accordance with claim 6, said operation to detect the tracked object release comprises said processor programmed to determine an angular rotation of the tracked object based on a predefined angular rotation threshold. ### Claim 10 (depends on 6) The system in accordance with claim 6, said processor further programmed to detect a tracked object flight interruption, wherein a trajectory of the tracked object is one or more of the following: interrupted, completed, and stopped. ### Claim 11 (depends on 10) The system in accordance with claim 10, said operation to determine an actual flight path of the tracked object comprises said processor programmed to determine the actual flight path of the tracked object based on the object location and the object orientation when the tracked object is between the tracked object release and the tracked object flight interruption. ### Claim 12 (depends on 1) The system in accordance with claim 1, said head-mounted display including a plurality of HMD sensors sensing the IR synchronous signal and the IR laser signal, said head-mounted display determining an HMD location and an HMD orientation of the head-mounted display relative to the sensor station based on the IR synchronous signal and the IR laser signal, said tracked object transmitting the HMD location and the HMD orientation to the host station, said processor further programmed to detect a tracked object release, wherein external influences on the tracked object are only from natural forces. ### Claim 13 (depends on 12) The system in accordance with claim 12, said operation to detect the tracked object release comprises said processor programmed to determine that the object location is greater than a predetermined distance from the HMD location. ### Claim 14 (depends on 13) The system in accordance with claim 13, wherein said processor is programmed to determine one or more of the following: a field of view of a user of the head-mounted display, eye tracking of the user, and head positioning tracking of the user. ### Claim 15 (depends on 1) The system in accordance with claim 1, said processor further programmed to generate a report including one or more of the following metrics: throwing accuracy, release time, spiral efficiency, spin rate, ball velocity, ball angle, time of flight, throwing motion, and follow through. ### Claim 16 (depends on 1) The system in accordance with claim 1, said processor further programmed to determine one or more of the following physical characteristics of the tracked object during the object tracking event: a launch position, a launch angle, a linear velocity, an angular velocity, a gyroscopic precession, and a gyroscopic drift. ### Claim 17 (depends on 16) The system in accordance with claim 16, wherein the processor includes a projectile motion algorithm generating the predicted flight path based on design parameters and based on the one or more physical characteristics of the tracked object. ### Claim 18 (depends on 17) The system in accordance with claim 17, wherein the predicted flight path is further based on one or more environmental characteristics. ### Claim 19 (depends on 18) The system in accordance with claim 18, the one or more environmental characteristics including one or more of the following: air resistance, Magnus effect, atmospheric pressure, humidity, wind speed, wind direction, rain, snow, and temperature. ### Claim 20 (depends on 1) The system in accordance with claim 1, said processor further programmed to generate one or more performance scores based on the predicted flight path of the tracked object.