# US 12,217,628 B2 · Magnetic tracking in an extended reality training system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,217,628 B2 - Document ID: US12217628B2 - Status: Granted - Kind: B2 - Application number: 18/074,949 - Filed: 2022-12-05 - Published: 2024-06-06 - Granted: 2025-02-04 - Earliest claimed: 2022-12-05 - Assignees: Street Smarts VR, Inc. - Applicants: Street Smarts Vr Inc. - Inventors: Gregory Prodzenko; Jeffrey Jarrard - Web page: https://patentgrep.com/patent/US12217628B2 ## CPC - G09B 9/00: Simulators for teaching or training purposes (for the use of weapons F41; computing aspects G06; {protocols for games, networked simulations or virtual reality H04L67/131}) - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06T 11/00: Two-dimensional [2D] image generation - G09B 9/003: {for military purposes and tactics} - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract In an embodiment, an extended reality training system is disclosed that includes an extended reality display device, an emitter, a receiver attached to an object and a processor. The processor obtains tracking data for the object based at least in part on a detection by the receiver of a magnetic field generated by the emitter. The processor obtains training scenario data corresponding to an extended reality training scenario and generates the extended reality training scenario based at least in part on the tracking data and the training scenario data. The extended reality training scenario comprises a representation of the object at a location and orientation in a virtual space that corresponds to a location and orientation of the object indicated by the tracking data. The processor provides the extended reality training scenario to the extended reality display device to present the representation of the object to a user. ## Claims ### Claim 1 An extended reality training system comprising: an extended reality display device; an emitter located in a physical space, the emitter being configured to generate a magnetic field; a receiver attached to an object located in the physical space, the receiver being configured to detect the magnetic field along an X-axis, a Y-axis, and a Z-axis; at least one processor coupled to memory, the at least one processor being configured to: obtain tracking data for the object based at least in part on the detection of the magnetic field by the receiver, the tracking data indicating a location and orientation of the object; obtain training scenario data corresponding to an extended reality training scenario; generate the extended reality training scenario based at least in part on the tracking data and the training scenario data, the extended reality training scenario comprising a representation of the object at a location and orientation in a virtual space determined based on a transformation of the location and orientation of the object indicated by the tracking data; and provide the extended reality training scenario to the extended reality display device, the extended reality display device being configured to present the representation of the object in the extended reality training scenario to a user of the extended reality display device. ### Claim 2 (depends on 1) The extended reality training system of claim 1, wherein the location and orientation of the object indicated by the tracking data is relative to a location and orientation of the emitter. ### Claim 3 (depends on 2) The extended reality training system of claim 2 wherein the emitter is attached to the extended reality display device and the location and orientation of the object indicated by the tracking data is relative to the location and orientation of the extended reality display device. ### Claim 4 (depends on 1) The extended reality training system of claim 1 wherein: the receiver comprises a first receiver; the tracking data comprises first tracking data; the extended reality system further comprises a second receiver attached to the extended reality display device that is configured to detect the magnetic field generated by the emitter; the at least one processor is further configured to obtain second tracking data for the extended reality display device based at least in part on the detection of the magnetic field by the second receiver, the second tracking data indicating a location and orientation of the extended reality display device; and generating the extended reality training scenario based at least in part on the first tracking data and the training scenario data comprises generating the extended reality training scenario based at least in part on the first tracking data, the second tracking data and the training scenario data, the representation of the object in the extended reality training scenario being at a location and orientation in the virtual space determined based on a transformation of the location and orientation of the object indicated by the first tracking data relative to the location and orientation of the extended reality display device indicated by the second tracking data. ### Claim 5 (depends on 1) The extended reality training system of claim 1 wherein a linear path between the receiver and the emitter in the physical space is blocked by another object. ### Claim 6 (depends on 1) The extended reality training system of claim 1 wherein obtaining the tracking data comprises obtaining the tracking data from the receiver. ### Claim 7 (depends on 1) The extended reality training system of claim 1 wherein the obtained tracking data indicates a plurality of locations and orientations of the object during movements of the object, the representation of the object in the generated extended reality training scenario moving between a plurality of locations and orientations in the virtual space determined based on a transformation of the plurality of locations and orientations of the object during the movements of the object as indicated by the tracking data. ### Claim 8 A method performed by at least one processor comprising hardware, the method comprising: obtaining tracking data for an object located in a physical space based at least in part on a detection of a magnetic field by a receiver attached to the object, the magnetic field being generated by an emitter located in the physical space, the tracking data indicating a location and orientation of the object along an X-axis, a Y-axis, and a Z-axis; obtaining training scenario data corresponding to an extended reality training scenario; generating the extended reality training scenario based at least in part on the tracking data and the training scenario data, the extended reality training scenario comprising a representation of the object at a location and orientation in a virtual space determined based on a transformation of the location and orientation of the object indicated by the tracking data; and providing the extended reality training scenario to an extended reality display device, the extended reality display device being configured to present the representation of the object in the extended reality training scenario to a user of the extended reality display device. ### Claim 9 (depends on 8) The method of claim 8, wherein the location and orientation of the object indicated by the tracking data is relative to a location and orientation of the emitter. ### Claim 10 (depends on 9) The method of claim 9 wherein the emitter is attached to the extended reality display device and the location and orientation of the object indicated by the tracking data is relative to the location and orientation of the extended reality display device. ### Claim 11 (depends on 8) The method of claim 8 wherein: the receiver comprises a first receiver; the tracking data comprises first tracking data; the method further comprises obtaining second tracking data for the extended reality display device based at least in part on a detection of the magnetic field by a second receiver attached to the extended reality display device, the second tracking data indicating a location and orientation of the extended reality display device; and generating the extended reality training scenario based at least in part on the first tracking data and the training scenario data comprises generating the extended reality training scenario based at least in part on the first tracking data, the second tracking data and the training scenario data, the representation of the object in the extended reality training scenario being at a location and orientation in the virtual space determined based on a transformation of the location and orientation of the object indicated by the first tracking data relative to the location and orientation of the extended reality display device indicated by the second tracking data. ### Claim 12 (depends on 8) The method of claim 8 wherein a linear path between the receiver and the emitter in the physical space is blocked by another object. ### Claim 13 (depends on 8) The method of claim 8 wherein: obtaining the tracking data comprises obtaining the tracking data from the receiver. ### Claim 14 (depends on 8) The method of claim 8 wherein the obtained tracking data indicates a plurality of locations and orientations of the object during movements of the object, the representation of the object in the generated extended reality training scenario moving between a plurality of locations and orientations in the virtual space determined based on a transformation of the plurality of locations and orientations of the object during the movements of the object as indicated by the tracking data. ### Claim 15 A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to: obtain tracking data for an object located in a physical space based at least in part on a detection of a magnetic field by a receiver attached to the object, the magnetic field being generated by an emitter located in the physical space, the tracking data indicating a location and orientation of the object along an X-axis, a Y-axis, and a Z-axis; obtain training scenario data corresponding to an extended reality training scenario; generate the extended reality training scenario based at least in part on the tracking data and the training scenario data, the extended reality training scenario comprising a representation of the object at a location and orientation in a virtual space determined based on a transformation of the location and orientation of the object indicated by the tracking data; and provide the extended reality training scenario to an extended reality display device, the extended reality display device being configured to present the representation of the object in the extended reality training scenario to a user of the extended reality display device. ### Claim 16 (depends on 15) The non-transitory computer-readable medium of claim 15, wherein the emitter is attached to the extended reality display device and the location and orientation of the object indicated by the tracking data is relative to the location and orientation of the extended reality display device. ### Claim 17 (depends on 15) The non-transitory computer-readable medium of claim 15 wherein: the receiver comprises a first receiver; the tracking data comprises first tracking data; the instructions, when executed by the at least one processor, cause the at least one processor to obtain second tracking data for the extended reality display device based at least in part on a detection of the magnetic field by a second receiver attached to the extended reality display device, the second tracking data indicating a location and orientation of the extended reality display device; and generating the extended reality training scenario based at least in part on the first tracking data and the training scenario data comprises generating the extended reality training scenario based at least in part on the first tracking data, the second tracking data and the training scenario data, the representation of the object in the extended reality training scenario being at a location and orientation in the virtual space determined based on a transformation of the location and orientation of the object indicated by the first tracking data relative to the location and orientation of the extended reality display device indicated by the second tracking data. ### Claim 18 (depends on 15) The non-transitory computer-readable medium of claim 15 wherein: obtaining the tracking data comprises obtaining the tracking data from the receiver. ### Claim 19 (depends on 15) The non-transitory computer-readable medium of claim 15 wherein the obtained tracking data indicates a plurality of locations and orientations of the object during movements of the object, the representation of the object in the generated extended reality training scenario moving between a plurality of locations and orientations in the virtual space determined based on a transformation of the plurality of locations and orientations of the object during the movements of the object as indicated by the tracking data.