# US 12,182,949 B2 · Augmented reality system for an amusement ride > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,182,949 B2 - Document ID: US12182949B2 - Status: Granted - Kind: B2 - Application number: 17/962,987 - Filed: 2022-10-10 - Published: 2023-06-08 - Granted: 2024-12-31 - Earliest claimed: 2018-09-24 - Assignees: Universal City Studios LLC - Applicants: Universal City Studios LLC - Inventors: Anthony Melo; Akiva Meir Krauthamer - Web page: https://patentgrep.com/patent/US12182949B2 ## CPC - A63G 31/16: creating illusions of travel - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06T 11/00: Two-dimensional [2D] image generation - G06T 13/40: of characters, e.g. humans, animals or virtual beings - G06V 20/20: in augmented reality scenes - G06V 40/161: {Detection; Localisation; Normalisation} - G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships} - G06V 40/176: {Dynamic expression} - G06V 40/23: {Recognition of whole body movements, e.g. for sport training} - A63G: MERRY-GO-ROUNDS; SWINGS; ROCKING-HORSES; CHUTES; SWITCHBACKS; SIMILAR DEVICES FOR PUBLIC AMUSEMENT - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract An amusement ride system includes a ride vehicle configured to carry a passenger, one or more sensors configured to detect a face and a body of the passenger while the passenger is in the ride vehicle, and a display assembly configured to be viewable by the passenger while the passenger is in the ride vehicle. The amusement ride system also includes a controller configured to generate an animation based on signals received from the one or more sensors and to instruct display of the animation on the display assembly. The signals are indicative of movement of the face and the body of the passenger, and the animation mimics the movement of the face and the body of the passenger. ## Claims ### Claim 1 A system, comprising: one or more processors; memory storing instructions executable by the one or more processors to cause the one or more processors to: process signals received from one or more sensors to determine movement of a body of a guest; generate an animation character that mimics the movement of the body of the guest; and instruct presentation, via a display, of an image of a ride vehicle and the animation character such that the animation character appears to be seated in the ride vehicle. ### Claim 2 (depends on 1) The system of claim 1, wherein the instructions are executable by the one or more processors to cause the one or more processors to: process the signals received from the one or more sensors while the one or more processors determines that the guest is in a position proximate to the display that allows for viewing of the animation character by the guest via the display; and generate the animation character such that the animation character is responsive to the movement of the body of the guest while the one or more processors determines that the guest is in the position. ### Claim 3 (depends on 1) The system of claim 1, wherein the instructions are executable by the one or more processors to cause the one or more processors to: process the signals to determine respective movement of a face of the guest; and generate the animation character that mimics the movement of the body of the guest and the respective movement of the face of the guest. ### Claim 4 (depends on 1) The system of claim 1, wherein the instructions are executable by the one or more processors to cause the one or more processors to: process the signals to determine facial expressions of the guest; and generate the animation character that mimics the movement of the body of the guest and the facial expressions of the guest. ### Claim 5 (depends on 1) The system of claim 1, wherein the animation character comprises an animation body, and the instructions are executable by the one or more processors to cause the one or more processors to generate the animation character by moving the animation body in a manner that mimics the movement of the body of the guest. ### Claim 6 (depends on 1) The system of claim 1, wherein the body of the guest comprises arms of the body of the guest, and the instructions are executable by the one or more processors to cause the one or more processors to generate the animation character by moving respective arms of an animation body of the animation character in a manner that mimics the movement of the arms of the body of the guest. ### Claim 7 (depends on 1) The system of claim 1, wherein the instructions are executable by the one or more processors to cause the one or more processors to: receive an image of the guest; and instruct the presentation, via the display, of the animation character in combination with at least a portion of the image of the guest. ### Claim 8 (depends on 1) The system of claim 1, wherein the instructions are executable by the one or more processors to cause the one or more processors to: receive a video feed of an environment surrounding the guest; and instruct the presentation, via the display, of the animation character overlaid onto the video feed of the environment surrounding the guest. ### Claim 9 (depends on 1) The system of claim 1, wherein the instructions are executable by the one or more processors to cause the one or more processors to: receive an indication of a position of the guest; and instruct the presentation of the animation character via the display in response to the guest being in a defined area in proximity to the display. ### Claim 10 (depends on 1) The system of claim 1, wherein the instructions are executable by the one or more processors to cause the one or more processors to: process the signals to determine a position of the guest relative to a guest ride vehicle carrying the guest; and instruct the presentation, via the display, of the image of the ride vehicle and the animation character such that the animation character appears to be at a respective position in the ride vehicle that corresponds to the position of the guest relative to the guest ride vehicle carrying the guest. ### Claim 11 (depends on 1) The system of claim 1, wherein the instructions are executable by the one or more processors to cause the one or more processors to provide one or more control signals to an animated figure to cause the animated figure to mimic the movement of the body of the guest. ### Claim 12 A system, comprising: one or more processors; memory storing instructions executable by the one or more processors to cause the one or more processors to: process signals received from one or more sensors to determine respective movement of a body of a guest and respective movement of a face of the guest; generate one or more animation control signals based on the respective movement of the body of the guest and the respective movement of the face of the guest; and provide the one or more animation control signals to an animated figure to cause a robotic structure of the animated figure to move to mimic the respective movement of the body of the guest and the respective movement of the face of the guest. ### Claim 13 (depends on 12) The system of claim 12, wherein the instructions are executable by the one or more processors to cause the one or more processors to: generate an animation character that mimics the respective movement of the body of the guest, the respective movement of the face of the guest, or both; and instruct presentation, via a display, of the animation character. ### Claim 14 (depends on 12) The system of claim 12, wherein the instructions are executable by the one or more processors to cause the one or more processors to provide the one or more animation control signals to the animated figure while the one or more processors determines that the guest is in a position proximate to the animated figure. ### Claim 15 (depends on 14) The system of claim 14, comprising a ride vehicle configured to carry the guest into and out of the position. ### Claim 16 (depends on 12) The system of claim 12, wherein the instructions are executable by the one or more processors to cause the one or more processors to: process the signals received from the one or more sensors to determine distinct facial expressions of the guest based on the respective movement of the face of the guest; and provide the one or more animation control signals to the animated figure to cause the animated figure to mimic the facial expressions of the guest. ### Claim 17 (depends on 12) The system of claim 12, wherein the instructions are executable by the one or more processors to cause the one or more processors to: process signals received from the one or more sensors to determine respective movement of a respective body of an additional guest and respective movement of a respective face of the additional guest; generate one or more additional animation control signals based on the respective movement of the respective body of the additional guest and the respective movement of the respective face of the additional guest; and provide the one or more additional animation control signals to an additional animated figure to cause a respective robotic structure of the additional animated figure to move to mimic the respective movement of the respective body of the additional guest and the respective movement of the respective face of the additional guest. ### Claim 18 (depends on 17) The system of claim 17, wherein the instructions are executable by the one or more processors to cause the one or more processors to: provide the one or more animation control signals to the animated figure and the one or more additional animation control signals to the additional animated figure while a ride vehicle carries the guest and the additional guest proximate to the animated figure and the additional animated figure. ### Claim 19 A method, comprising: receiving, at one or more processors, signals from one or more sensors; receiving, at the one or more processors, a video feed of an environment that includes a guest in a ride vehicle; processing, using the one or more processors, the signals to determine respective movement of a body of the guest, respective movement of a face of the guest, facial expressions of the guest, or any combination thereof; generating, using the one or more processors, an animation that mimics the respective movement of the body of the guest, the respective movement of the face of the guest, the facial expressions of the guest, or any combination thereof; and instructing, using the one or more processors and via a display, presentation of the animation overlaid onto the video feed of the environment to replace at least a portion of respective imagery of the guest in the video feed with the animation to enable visualization of the animation by the guest such that the animation appears to be seated in respective imagery of the ride vehicle in the video feed as the ride vehicle carries the guest in a defined area in viewing proximity of the display. ### Claim 20 (depends on 19) The method of claim 19, comprising: instructing, using the one or more processors and via the display that is separate from the ride vehicle, presentation of the animation overlaid onto the video feed of the environment to replace at least the portion of respective imagery of the guest in the video feed with the animation to enable visualization of the animation by the guest as the ride vehicle carries the guest in the defined area along a ride path to pass the display.