# US 2019/0377407 A1 · Vertical motion simulator and method of implementing virtual reality of vertical motion using the same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0377407 A1 - Document ID: US20190377407A1 - Status: Published application - Kind: A1 - Application number: 16/432,034 - Filed: 2019-06-05 - Published: 2019-12-12 - Earliest claimed: 2018-06-07 - Assignees: Electronics and Telecommunications Research Institute - Applicants: Electronics and Telecommunications Research Institute - Inventors: Dae Hwan KIM; Su Ran PARK; Ki Hong KIM - Web page: https://patentgrep.com/patent/US20190377407A1 ## CPC - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - A63F 13/214: for locating contacts on a surface, e.g. floor mats or touch pads - A63F 13/218: using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player - A63F 13/24: Constructional details thereof, e.g. game controllers with detachable joystick handles - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06N 3/045: Combinations of networks - G06N 3/0464: Convolutional networks [CNN, ConvNet] - G06N 3/08: Learning methods - G06N 3/09: Supervised learning - G06N 20/00: Machine learning - G06T 13/40: of characters, e.g. humans, animals or virtual beings - G06T 19/003: {Navigation within 3D models or images} - G06F 2203/012: Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract A VR motion simulator allowing a user to experience a vertical motion in VR environment by analyzing a pressure distribution of a sole of the user and estimating a posture of the user, and a method of implementing a vertical motion action of a user in VR. The simulator includes a pressure distribution image generating module generating a pressure distribution image of a sole of a user at a time of a vertical motion of the user; a sole position tracking module analyzing the pressure distribution image to detect the sole of the user, and track a position of the sole on the basis of movement of the detected sole to output sole position tracking information; and a posture estimating module estimating a posture of the user on the basis of the sole position tracking information to output posture estimation information. ## Claims ### Claim 1 A vertical motion simulator comprising: a pressure distribution image generating module configured to generate a pressure distribution image of a sole of a user using an electrical signal corresponding to a pressure of the sole detected at a time of a vertical motion of the user; a sole position tracking module configured to analyze the pressure distribution image to detect the sole of the user and track a position of the sole on the basis of movement of the detected sole to output sole position tracking information; and a posture estimating module configured to estimate a posture of the user on the basis of the sole position tracking information to output posture estimation information. ### Claim 2 (depends on 1) The vertical motion simulator of claim 1, wherein the electrical signal used to generate the pressure distribution image of the sole by the pressure distribution image generating module is generated by a pressure sensor for detecting a pressure of a sole of a user at the time of the vertical motion of the user. ### Claim 3 (depends on 1) The vertical motion simulator of claim 1, wherein the pressure distribution image generated by the pressure distribution image generating module includes a plurality of pressure distribution images each generated at a predetermined sampling period. ### Claim 4 (depends on 1) The vertical motion simulator of claim 1, wherein, in order to track the position of the sole, the sole position tracking module uses sole feature information extracted from the sole detected from the pressure distribution image and sole movement feature information generated by analyzing the sole feature information. ### Claim 5 (depends on 1) The vertical motion simulator of claim 1, wherein, in order to estimate the posture of the user, the posture estimating module uses machine learning as the sole position tracking information obtained from the sole position tracking module. ### Claim 6 (depends on 1) The vertical motion simulator of claim 1, further comprising a vertical motion height calculating module configured to calculate a vertical motion height of the user on the basis of the posture estimation information output from the posture estimating module and vertical motion sensing information resulting from sensing the vertical motion of the user to output vertical motion height information. ### Claim 7 (depends on 6) The vertical motion simulator of claim 6, wherein in order to calculate the vertical motion height, the vertical motion height calculating module temporally matches the posture estimation information and the vertical motion sensing information. ### Claim 8 (depends on 6) The vertical motion simulator of claim 6, wherein a sensor for sensing the vertical motion of the user includes a lidar for sensing a position at which the user floats in the air during the vertical motion. ### Claim 9 (depends on 1) The vertical motion simulator of claim 1, further comprising a virtual reality linking module configured to implement a vertical motion action of the user in a virtual reality on the basis of the posture estimation information output from the posture estimating module. ### Claim 10 (depends on 9) The vertical motion simulator of claim 9, wherein the virtual reality linking module is implemented to apply the vertical motion action of the user to a virtual reality character such that the virtual reality character performs the vertical motion action according to the vertical motion action of the user. ### Claim 11 (depends on 6) The vertical motion simulator of claim 6, further comprising a virtual reality linking module configured to implement a vertical motion action of the user in a virtual reality on the basis of the posture estimation information output from the posture estimating module and the vertical motion height information output from the vertical motion height calculating module. ### Claim 12 (depends on 11) The vertical motion simulator of claim 11, wherein the virtual reality linking module is implemented to apply the vertical motion action of the user to a virtual reality character such that the virtual reality character performs the vertical motion action according to the vertical motion action of the user. ### Claim 13 A method of implementing a virtual reality of a vertical motion, the method comprising: generating a pressure distribution image of a sole of a user using an electrical signal corresponding to a pressure of the sole detected at a time of a vertical motion of the user; analyzing the pressure distribution image to detect the sole of the user and tracking a position of the sole on the basis of movement of the detected sole to output sole position tracking information; estimating a posture of the user on the basis of the sole position tracking information to output posture estimation information; and implementing a vertical motion action of the user in a virtual reality on the basis of the posture estimation information. ### Claim 14 A method of implementing a virtual reality, the method comprising: generating a pressure distribution image of a sole of a user using an electrical signal corresponding to a pressure of the sole detected at a time of a vertical motion of the user; analyzing the pressure distribution image to detect the sole of the user and tracking a position of the sole on the basis of movement of the detected sole to output sole position tracking information; estimating a posture of the user on the basis of the sole position tracking information to output posture estimation information; calculating a vertical motion height of the user on the basis of the posture estimation information and sensing information resulting from sensing the vertical motion of the user to output vertical motion height information; and implementing a vertical motion action of the user in a virtual reality on the basis of the posture estimation information and the vertical motion height information.