# US 2019/0168120 A1 · Interactive video game system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0168120 A1 - Document ID: US20190168120A1 - Status: Published application - Kind: A1 - Application number: 15/833,839 - Filed: 2017-12-06 - Published: 2019-06-06 - Earliest claimed: 2017-12-06 - Assignees: Universal City Studios LLC - Applicants: Universal City Studios LLC - Inventors: Travis Jon Cossairt; Wei Cheng Yeh - Web page: https://patentgrep.com/patent/US20190168120A1 ## CPC - A63F 13/52: involving aspects of the displayed game scene - A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) - A63F 13/25: Output arrangements for video game devices - A63F 13/335: using Internet - A63F 13/428: involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes - A63F 13/655: by importing photos, e.g. of the player - A63F 13/843: involving concurrently two or more players on the same game device, e.g. requiring the use of a plurality of controllers or of a specific view of game data for each player - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 16/951: Indexing; Web crawling techniques - G06T 15/08: Volume rendering - G06T 15/60: Shadow generation - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An interactive video game system includes an array of volumetric sensors disposed around a play area and configured to collect respective volumetric data for each of a plurality of players. The system includes a controller communicatively coupled to the array of volumetric sensors. The controller is configured to: receive, from the array of volumetric sensors, respective volumetric data of each of the plurality of players; to combine the respective volumetric data of each of the plurality of players to generate at least one respective model for each of the plurality of players; to generate a respective virtual representation for each player of the plurality of players based, at least in part, on the generated at least one respective model of each player of the plurality of players; and to present the generated respective virtual representation of each player of the plurality of players in a virtual environment. ## Claims ### Claim 1 An interactive video game system, comprising: an array of volumetric sensors disposed around a play area and configured to collect respective volumetric data for each of a plurality of players; and a controller communicatively coupled to the array of volumetric sensors and configured to: receive, from the array of volumetric sensors, the respective volumetric data of each player of the plurality of players; combine the respective volumetric data of each player of the plurality of players to generate at least one respective model for each player of the plurality of players; generate a respective virtual representation for each player of the plurality of players based, at least in part, on the generated at least one respective model of each player of the plurality of players; and present the generated respective virtual representation of each player of the plurality of players in a virtual environment. ### Claim 2 (depends on 1) The interactive video game system of claim 1, wherein the array of volumetric sensors comprises an array of depth cameras, LIDAR devices, or a combination thereof. ### Claim 3 (depends on 1) The interactive video game system of claim 1, wherein the volumetric sensors of the array are symmetrically distributed around a perimeter of the play area. ### Claim 4 (depends on 1) The interactive video game system of claim 1, wherein the generated at least one respective model includes a respective shadow model for each player of the plurality of players, and wherein each respective virtual representation of the plurality of players is generated based on the respective shadow model of each player of the plurality of players. ### Claim 5 (depends on 1) The interactive video game system of claim 1, comprising a display device disposed near the play area, wherein the display device is configured to display the virtual environment to the plurality of players in the play area. ### Claim 6 (depends on 1) The interactive video game system of claim 1, wherein the controller is configured to: determine in-game actions of each player of the plurality of players in the play area and corresponding in-game effects based, at least in part, on the generated at least one respective model; and update the generated respective virtual representation of each player of the plurality of players and the virtual environment based on the determined in-game actions and in-game effects. ### Claim 7 (depends on 1) The interactive video game system of claim 1, wherein each of the generated at least one respective models includes a respective volumetric model for each player of the plurality of players, and the controller is configured to generate a simulated image that includes the volumetric model of a particular player of the plurality of players within the virtual environment when game play concludes. ### Claim 8 (depends on 1) The interactive video game system of claim 1, wherein the play area is a three-dimensional (3D) play area and the array of volumetric sensors is configured to collect the respective volumetric data for each player of the plurality of players with respect to a width, a height, and a depth of the 3D play area. ### Claim 9 (depends on 1) The interactive video game system of claim 1, wherein the play area is a two-dimensional (2D) play area and the array of volumetric sensors is configured to collect the respective volumetric data for each of the plurality of players with respect to a width and a height of the 2D play area. ### Claim 10 An interactive video game system, comprising: a display device disposed near a play area and configured to display a virtual environment to a plurality of players in the play area; an array of sensing units disposed around the play area, wherein each sensing unit of the array is configured to determine a partial model of at least one player of the plurality of players; and a controller communicatively coupled to the array of sensing units, wherein the controller is configured to: receive, from the array of sensing units, the partial models of each player of the plurality of players; generate a respective model of each player of the plurality of players by fusing the partial models of each player of the plurality of players; determine in-game actions of each player of the plurality of players based, at least in part, on the generated respective model of each player of the plurality of players; and display a respective virtual representation of each player of the plurality of players in the virtual environment on the display device based, at least in part, on the generated respective model and the in-game actions of each player of the plurality of players. ### Claim 11 (depends on 10) The interactive video game system of claim 10, wherein each sensing unit of the array of sensing units comprises a respective sensor communicatively coupled to respective processing circuitry, wherein the respective processing circuitry of each sensing unit of the array of sensing units is configured to determine a respective portion of the generated respective model of each player of the plurality of players based on data collected by the respective sensor of the sensing unit. ### Claim 12 (depends on 11) The interactive video game system of claim 11, wherein each sensing unit of the array of sensing units is communicatively coupled to the controller via an internet protocol (IP) network. ### Claim 13 (depends on 10) The interactive video game system of claim 10, wherein the array of sensing units comprises an array of depth cameras, LIDAR devices, or a combination thereof, symmetrically distributed around a perimeter of the play area. ### Claim 14 (depends on 13) The interactive video game system of claim 13, wherein the array of sensing units is disposed above the plurality of players and is directed at a downward angle toward the play area. ### Claim 15 (depends on 14) The interactive video game system of claim 14, wherein the array of sensing units comprises up to eight sensing units. ### Claim 16 (depends on 10) The interactive video game system of claim 10, comprising a radio-frequency (RF) sensor communicatively coupled to the controller, wherein the controller is configured to receive data from the RF sensor, the data indicating an identity, a location, or a combination thereof, for each player of the plurality of players. ### Claim 17 (depends on 10) The interactive video game system of claim 10, comprising an interface panel communicatively coupled to the controller, wherein the interface panel comprises a plurality of input devices configured to receive input from the plurality of players during game play. ### Claim 18 (depends on 17) The interactive video game system of claim 17, wherein the interface panel comprises at least one physical effects device configured to provide the plurality of players with at least one physical effect based, at least in part, on the determined in-game actions of each player of the plurality of players. ### Claim 19 (depends on 10) The interactive video game system of claim 10, comprising a database system communicatively coupled to the controller, wherein the controller is configured to query and receive information related to the plurality of players from the database system. ### Claim 20 (depends on 19) The interactive video game system of claim 19, wherein, to present the respective virtual representation of each player of the plurality of players, the controller is configured to query and receive the information related to the plurality of players, and to determine how to modify the virtual representation based on the received information. ### Claim 21 (depends on 10) The interactive video game system of claim 10, wherein the controller is configured to generate the respective virtual representation of each player of the plurality of players based on the respective models of each player of the plurality of players. ### Claim 22 A method of operating an interactive video game system, comprising: receiving, via processing circuitry of a controller of the interactive video game system, partial models of a plurality of players positioned within a play area from an array of sensing units disposed around the play area; fusing, via the processing circuitry, the received partial models of each player of the plurality of players to generate a respective model of each player of the plurality of players; determining, via the processing circuitry, in-game actions of each player of the plurality of players based, at least in part, on the generated respective models of each player of the plurality of players; and presenting, via a display device, a virtual representation of each player of the plurality of players in a virtual environment based, at least in part, on the generated respective model and the in-game actions of each player of the plurality of players. ### Claim 23 (depends on 22) The method of claim 22, comprising: scanning, using a volumetric sensor of each sensing unit of the array of sensing units, each player of the plurality of players positioned within the play area; generating, via processing circuitry of each sensing unit of the array of sensing units, the partial models of each player of the plurality of players; and providing, via a network, the partial models of each player of the plurality of players to the processing circuitry of the controller. ### Claim 24 (depends on 23) The method of claim 23, wherein each of the generated partial models comprises a partial volumetric model, a partial skeletal model, a partial shadow model, or a combination thereof. ### Claim 25 (depends on 22) The method of claim 22, wherein the plurality of players comprises at least twelve players that are simultaneously playing the interactive video game system.