# US 2022/0092860 A1 · Extended reality for moving platforms > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2022/0092860 A1 - Document ID: US20220092860A1 - Status: Published application - Kind: A1 - Application number: 17/478,777 - Filed: 2021-09-17 - Published: 2022-03-24 - Earliest claimed: 2020-09-18 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Brian C. CLARK; Krishna RAMAMURTHI; Ivan KOLESOV; Ralf HABEL - Web page: https://patentgrep.com/patent/US20220092860A1 ## CPC - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06V 10/70: using pattern recognition or machine learning (optical pattern recognition or electronic computations therefor G06V10/88) - G06V 20/20: in augmented reality scenes - G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Implementations of the subject technology provide extended reality display devices that can be used on and/or off of a moving platform. Systems and methods are disclosed for separating out the motion of the moving platform from other motions of the device so that virtual content can be displayed without erroneous motions caused by the motion of the moving platform. The subject technology can provide extended reality settings on any suitable moving platform such as in a car, a watercraft, an aircraft, a train, or any other vehicle. ## Claims ### Claim 1 A device, comprising: a display; one or more sensors; and one or more processors configured to: identify device motion of the device using the one or more sensors; determine that the device motion includes a first component associated with a motion of a moving platform and a second component that is separate from the motion of the moving platform; determine an anchoring location that is fixed relative to the moving platform; and display virtual content anchored to the anchoring location that is fixed relative to the moving platform, using at least the second component of the device motion that is separate from the motion of the moving platform. ### Claim 2 (depends on 1) The device of claim 1, wherein the one or more sensors comprises an optical sensor, a depth sensor, and an inertial measurement unit, wherein the one or more processors are configured to identify the device motion with the inertial measurement unit and to display the virtual content anchored to the anchoring location that is fixed relative to the moving platform using the optical sensor, and the depth sensor without further input from the inertial measurement unit. ### Claim 3 (depends on 1) The device of claim 1, wherein the second component of the device motion that is separate from the motion of the moving platform comprises a rotational motion of the device. ### Claim 4 (depends on 3) The device of claim 3, wherein the second component of the device motion that is separate from the motion of the moving platform includes a translational motion of the device relative to the moving platform and the anchoring location. ### Claim 5 (depends on 1) The device of claim 1, wherein the one or more processors are configured to anchor the virtual content to the anchoring location that is fixed relative to the moving platform by: detecting an object with the one or more sensors; determining that the object has an object motion that is equal to the motion of the moving platform; and anchoring the virtual content to the object. ### Claim 6 (depends on 5) The device of claim 5, wherein the one or more processors are further configured to: detect a motion of the object relative to the moving platform and relative to the device; and continue anchoring the virtual content to the object based on the detected motion of the object. ### Claim 7 (depends on 1) The device of claim 1, wherein the one or more processors are further configured to: detect a portion of a physical setting having a motion that is different from the motion of the moving platform and different from the device motion of the device. ### Claim 8 (depends on 7) The device of claim 7, wherein the one or more processors are further configured to: determine that the motion of the portion of the physical setting is different from the motion of the moving platform and different from the device motion of the device by at least a threshold; and identify the portion of the physical setting as ineligible for anchoring of virtual content. ### Claim 9 (depends on 8) The device of claim 8, wherein the one or more processors are further configured to display additional virtual content overlaid on the portion of the physical setting and fixed relative to the moving platform to block a view of the portion of the physical setting. ### Claim 10 (depends on 7) The device of claim 7, wherein the one or more processors are configured to detect the portion of the physical setting having the motion that is different from the motion of the moving platform and different from the device motion of the device by detecting an optical flow associated with the portion of the physical setting using an optical sensor of the one or more sensors. ### Claim 11 (depends on 7) The device of claim 7, wherein the one or more processors are further configured to: receive an input from a user indicating a repositioning of the virtual content; and responsive to the input: de-anchor the virtual content from the anchoring location that is fixed relative to the moving platform; and display the virtual content anchored to the portion of the physical setting. ### Claim 12 (depends on 11) The device of claim 11, wherein the portion of the physical setting includes an object that is fixed to a fixed reference frame for the moving platform and the device. ### Claim 13 (depends on 1) The device of claim 1, wherein the one or more processors are configured to track the motion of the moving platform using a first simultaneous localization and mapping system and to track the second component that is separate from the motion of the moving platform using a second simultaneous localization and mapping system. ### Claim 14 (depends on 13) The device of claim 13, wherein the second simultaneous localization and mapping system comprises the one or more sensors of the device. ### Claim 15 (depends on 14) The device of claim 14, wherein the first simultaneous localization and mapping system comprises at least one additional sensor on the moving platform and configured to provide platform motion information to the one or more processors of the device. ### Claim 16 A method, comprising: identifying device motion of a device using one or more sensors of the device; determining that the device motion includes a first component associated with a motion of a moving platform and a second component that is separate from the motion of the moving platform; determining an anchoring location that is fixed relative to the moving platform; and displaying, with a display of the device, virtual content anchored to the anchoring location that is fixed relative to the moving platform, using at least the second component of the device motion that is separate from the motion of the moving platform. ### Claim 17 (depends on 16) The method of claim 16, wherein displaying the virtual content anchored to the anchoring location that is fixed relative to the moving platform comprises: detecting an object that is stationary relative to the moving platform using the one or more sensors; and anchoring the virtual content to the object. ### Claim 18 (depends on 17) The method of claim 17, further comprising: detecting a motion of the object relative to the moving platform and relative to device; and continuing to anchor the virtual content to the object based on the detected motion of the object. ### Claim 19 A non-transitory computer-readable medium comprising instructions, which when executed by a computing device, cause the computing device to: identify device motion of a device using one or more sensors of the computing device; determine that the device motion includes a first component associated with a motion of a moving platform and a second component that is separate from the motion of the moving platform; determine an anchoring location that is fixed relative to the moving platform; and display virtual content anchored to the anchoring location that is fixed relative to the moving platform, using at least the second component of the device motion that is separate from the motion of the moving platform. ### Claim 20 (depends on 19) The non-transitory computer-readable medium of claim 19, wherein the virtual content is displayed as part of a virtual setting that entirely blocks a physical setting from a view of a user, or to appear as the anchoring location in the physical setting.