# US 10,118,080 B2 · Systems, devices, and methods for virtual and augmented reality sports training > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,118,080 B2 - Document ID: US10118080B2 - Status: Granted - Kind: B2 - Application number: 15/437,913 - Filed: 2017-02-21 - Published: 2018-08-23 - Granted: 2018-11-06 - Earliest claimed: 2017-02-21 - Assignees: Robosport Technologies, LLC - Applicants: Robosport Technologies, LLC - Inventors: Salvatore Loduca - Web page: https://patentgrep.com/patent/US10118080B2 ## CPC - G09B 19/0038: {Sports} - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract Disclosed are devices, systems, and methods for training a player to hit a ball at a target using a virtual or augmented reality display device, an exemplary method including detecting a position of a real ball, determining a trajectory for a virtual ball, the trajectory intersecting with the detected position of the real ball, displaying, by the virtual or augmented reality display device, a virtual pitch of the virtual ball along the trajectory intersecting with the detected position of the real ball, displaying, by the virtual or augmented reality display device, a target towards which the player should hit the real ball, determining whether the real ball is hit at the target, and providing an indication of whether the real ball is hit at the target. ## Claims ### Claim 1 A system for training a player to hit a real ball at a target using a virtual or augmented reality display device, the system comprising: a virtual or augmented reality display device having a camera, a display, and a computing device disposed therein, the computing device having: one or more processors, and at least one memory coupled to the one or more processors, the at least one memory having instructions stored thereon which, when executed by the one or more processors, cause the computing device to: receive sensor signals from the camera and, based on the sensor signals, detect a position of a real ball; determine a trajectory for a virtual ball, the trajectory intersecting with the detected position of the real ball; transmit a signal that causes the display to display a virtual pitch of the virtual ball along the trajectory intersecting with the detected position of the real ball; transmit a signal that causes the display to display a target towards which the player should hit the real ball; determine whether the real ball is hit at the target; and transmit to a speaker a signal that causes the speaker to provide an indication of whether the real ball is hit at the target; wherein the virtual or augmented reality display device is configured to communicate with a glove worn by a player, the glove including a sensor configured to: detect vibrations caused by an impact between a bat and the real ball; and transmit to the computing device a signal that causes the computing device to determine whether a level of the vibrations is within a predetermined range; and wherein the virtual or augmented reality display device is configured to communicate with the speaker within audible range of the player and cause the speaker to emit an audible tone in response to receiving a signal from the sensor indicating that the level of the vibrations is within the predetermined range. ### Claim 2 (depends on 1) The system according to claim 1, wherein transmitting to the speaker the signal that causes the speaker to provide an indication includes causing the speaker to emit an audible tone when it is determined that the real ball is hit at the target. ### Claim 3 (depends on 1) The system according to claim 1, further comprising: a robotic tee configured to support the real ball thereon. ### Claim 4 (depends on 1) The system according to claim 1, wherein the speaker is included in an earpiece worn by the player. ### Claim 5 (depends on 1) The system according to claim 1, wherein the speaker is included in the virtual or augmented reality display device. ### Claim 6 (depends on 1) The system according to claim 1, wherein the at least one memory stores further instructions that, when executed by the one or more processors, cause the computing device to: receive data from the sensor, the data including the detected level of vibrations; analyze the data received from the sensor to determine analytics and statistics regarding the impact between the bat and the real ball; and display the analytics and statistics on the display of the virtual or augmented reality display device. ### Claim 7 (depends on 1) The system according to claim 1, wherein the at least one memory stores further instructions that, when executed by the one or more processors, cause the computing device to: receive data from the sensor, the data including the detected level of vibrations; analyze the data of the glove received from the sensor to determine one or more of: a hitting pattern, a swing path, a swing style, a swing speed, a swing angle, and a timing metric; and generate guidance based on the determining. ### Claim 8 (depends on 7) The system according to claim 7, wherein the at least one memory stores further instructions that, when executed by the one or more processors, cause the computing device to display the guidance via the display. ### Claim 9 A non-transitory computer-readable storage medium storing a program for using a virtual or augmented reality device having a camera, a display, and a computing device disposed therein for training a player to hit a real ball at a target, the program including instructions which, when executed by a processor, cause the computing device to: receive sensor signals from the camera and, based on the sensor signals, detect a position of a real ball based on an image captured by the camera; determine a trajectory for a virtual ball, the trajectory intersecting with the detected position of the real ball; transmit a signal that causes the display to display a virtual pitch of the virtual ball along the trajectory intersecting with the detected position of the real ball; transmit a signal that causes the display to display a target towards which the player should hit the real ball; determine, based on an image captured by the camera coupled to the virtual or augmented reality display device, whether the real ball is hit at the target; and transmit to a speaker a signal that causes the speaker to provide an indication of whether the real ball is hit at the target. ### Claim 10 (depends on 9) The non-transitory computer-readable storage medium according to claim 9, wherein the real ball is positioned on a robotic tee. ### Claim 11 (depends on 9) The non-transitory computer-readable storage medium according to claim 9, wherein transmitting to the speaker the signal that causes the speaker to provide an indication also causes the speaker to emit an audible tone when it is determined that the real ball is hit at the target. ### Claim 12 (depends on 9) The non-transitory computer-readable storage medium according to claim 9, wherein the instructions, when executed by the processor, further cause the computing device to: receive data from the glove including a detected level of vibrations from a sensor; analyze the data received from the sensor to determine analytics and statistics regarding an impact between a bat and the real ball; and transmit to the display a signal that causes the display to display the analytics and statistics. ### Claim 13 (depends on 9) The non-transitory computer-readable storage medium according to claim 9, wherein the instructions, when executed by the processor, further cause the computing device to: receive data from the sensor of the glove including a detected level of vibrations; analyze the data received from the sensor of the glove to determine one or more of: a hitting pattern, a swing path, a swing style, a swing speed, a swing angle, and a timing metric; and generate guidance based on the determining. ### Claim 14 (depends on 13) The non-transitory computer-readable storage medium according to claim 13, wherein the instructions, when executed by the processor, further cause the computing device to cause the virtual or augmented reality display device to display the guidance on the display. ### Claim 15 A method of training a player to hit a real ball at a target using a virtual or augmented reality display device having a camera, a display, and a computing device disposed therein, the method comprising: detecting, by the camera, a position of a real ball; determining a trajectory for a virtual ball, the trajectory intersecting with the detected position of the real ball; displaying, by the display, a virtual pitch of the virtual ball along the trajectory intersecting with the detected position of the real ball; displaying, by the display, a target towards which the player should hit the real ball; determining whether the real ball is hit at the target; and transmitting a signal to a speaker to cause the speaker to provide an indication of whether the real ball is hit at the target. ### Claim 16 (depends on 15) The method according to claim 15, wherein providing the indication of whether the ball is hit at the target is displayed by the display. ### Claim 17 (depends on 15) The method according to claim 15, wherein providing the indication of whether the ball is hit at the target is provided as an audible tone emitted by a speaker. ### Claim 18 (depends on 15) The method according to claim 15, further comprising: receiving data, the glove configured to be worn by a player, including a detected level of vibrations from a sensor; analyzing the data received from the sensor of the glove to determine analytics and statistics regarding an impact between a bat and the real ball; and displaying, by the display, the analytics and statistics. ### Claim 19 (depends on 15) The method according to claim 15, further comprising: receiving data from the sensor of the glove including a detected level of vibrations; analyzing the data received from the sensor of the glove to determine one or more of: a hitting pattern, a swing path, a swing style, a swing speed, a swing angle, and a timing metric; and generating, guidance based on the determining. ### Claim 20 (depends on 19) The method according to claim 19, further comprising displaying the guidance on the display.