# US 2025/0095310 A1 · Process for the alignment of virtual content in physical environments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095310 A1
- Document ID: US20250095310A1
- Status: Published application
- Kind: A1
- Application number: 18/970,039
- Filed: 2024-12-05
- Published: 2025-03-20
- Earliest claimed: 2023-03-13
- Assignees: Avrio Analytics LLC
- Applicants: Avrio Analytics LLC
- Inventors: Michael Bertolli; Alicia Caputo; Jason Therrien
- Web page: https://patentgrep.com/patent/US20250095310A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06T 19/003: {Navigation within 3D models or images}
- G06T 2210/21: Collision detection, intersection
- G06T 2215/16: Using real world measurements to influence rendering
- G06T 2219/2004: Aligning objects, relative positioning of parts
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods for aligning an extended reality (XR) environment with a physical environment such that a physical position and movement of a physical entity within the physical environment is identically aligned and identically mirrored by a corresponding XR position and corresponding movement of an XR entity within the XR environment. The alignment process assigns a position to the XR environment with respect to the physical environment such that certain elements of one environment are defined as being co-planar with certain surfaces of the other environment. Next, two planes or two lines in one environment intersect to define a first intersection. A second intersection in the other environment is located at the intersection of the first environment to align the two environments.

## Claims

### Claim 1

A method for delivering extended reality (XR) content comprising:
providing a physical environment having a physical entity, a first physical surface and a second physical surface;
providing a first projected surface that is co-planar with the first physical surface and a second projected surface that is co-planar the second physical surface, wherein the first projected surface intersects with the second projected surface along a first elongate intersection;
providing an XR system comprising an XR content generation system (XGS) for generating XR content and input-output (I/O) components including an input device for receiving inputs for interacting with the XR content and an output device for outputting XR content including at least visual XR content;
with the XGS, generating a three-dimensional XR environment having an XR entity that corresponds to the physical entity, a first XR surface, a second XR surface, and a XR intersecting plane, wherein the XR environment may be traversed by receiving the inputs via the input device;
aligning the XR environment with the physical environment via an alignment process such that a physical location in three-dimensional physical space, and movement of the physical entity within the physical environment is identically aligned and identically mirrored by a corresponding XR location in three-dimensional XR space, and corresponding movement of the XR entity within the XR environment, the alignment process including assigning a location to the XR environment with respect to the physical environment such that:
the first XR surface is co-planar with the first physical surface;
the second XR surface is co-planar with the second physical surface;
the XR intersecting plane intersects with the first XR surface along a fourth elongate intersection and intersects with the second XR surface along a fifth elongate intersection;
an intersection point is located at an intersection of the fourth elongate intersection with the fifth intersection, such that the intersection point is disposed along the first elongate intersection.

### Claim 2 (depends on 1)

The method of claim 1 further comprising aligning the XR environment with the physical environment such that a physical position, including the physical location and an orientation in three-dimensional physical space, is identically aligned and identically mirrored by a corresponding XR position, including the XR location and an orientation in three-dimensional XR space, the alignment process further including assigning a position, including said location and an orientation, to the XR environment with respect to the physical environment.

### Claim 3 (depends on 1)

The method of claim 1 further comprising:
when the physical entity is in a first physical position, using the output device, outputting visual XR content where the XR entity is located at a corresponding first XR position;
with the input device, receiving an input corresponding to a change in position of the physical entity in the physical environment from the first physical position to a second and different physical position; and
in response to the change of position of the physical entity, with the output device, outputting visual XR content where the XR entity is located at a corresponding second XR position.

### Claim 4 (depends on 3)

The method of claim 3 further comprising, with the output device, outputting visual XR content that identically mirrors movement of the XR entity from the first XR position to the second XR position in the XR environment that identically mirrors the movement of the physical entity from the first physical position to the second physical position in the physical environment.

### Claim 5 (depends on 1)

The method of claim 1 further comprising providing a selected intersecting plane that intersects the first physical surface along a second elongate intersection and that intersects the second physical surface along a third elongate intersection, the alignment further comprising assigning a position to the intersection point at a selected height with respect to the physical environment by positioning the XR intersecting plane at a selected height relative to the selected intersecting plane.

### Claim 6 (depends on 1)

The method of claim 1 further comprising defining a first alignment vector in the physical environment relative to a selected location in the physical environment; defining a second alignment vector in the XR environment relative to a selected location in the XR environment; and aligning the XR environment with the physical environment by aligning the first alignment vector with the second alignment vector.

### Claim 7 (depends on 6)

The method of claim 6 wherein each of the first alignment vector and the second alignment vector has an alignment angle and wherein the alignment angle of the first alignment vector is defined based on an angle formed between the first physical surface and the second physical surface or wherein the alignment angle of the second alignment vector is defined based on an angle formed between the first XR surface and the second XR surface.

### Claim 8 (depends on 7)

The method of claim 7 further comprising:
in defining the first alignment vector, performing a mathematical operation on the angle formed between the first physical surface and the second physical surface; or
in defining the second alignment vector, performing a mathematical operation on the angle formed between the first XR surface and the second XR surface.

### Claim 9 (depends on 6)

The method of claim 6 wherein the first alignment vector extends between a pair of immutable features in physical environment or wherein the second alignment vector extends between a pair of immutable features in XR environment.

### Claim 10 (depends on 1)

The method of claim 1 wherein the XR system includes an XR peripheral and a locator device configured to locate and to track a position and movement of the XR peripheral in the physical environment, the method further including establishing a linkage between the XR peripheral and the locator device to establish an initial position of the XR peripheral within the physical environment; and, using the locator device and while the linkage is established, tracking changes in a position of the XR peripheral in the physical space.

### Claim 11 (depends on 10)

The method of claim 10 wherein, in establishing the linkage between the XR peripheral and the locator device, the locator device is imaged.

### Claim 12 (depends on 10)

The method of claim 10 wherein, in establishing the linkage between the XR peripheral and the locator device, the locator device is contacted by the XR peripheral.

### Claim 13 (depends on 1)

The method of claim 1 wherein the XR system includes at least two I/O components and a calibrated sensor associated with one of the least two I/O components, wherein the calibrated sensor is configured to sense tracked information comprising at least one of location, orientation, or movement of the one I/O component, the method further comprising using the calibrated sensor to sense the tracked information of the one I/O component and making the tracked information available to another one of the at least two I/O components.

### Claim 14 (depends on 13)

The method of claim 13 wherein a separate calibrated sensor is associated with each of the at least two I/O components, the method comprising using each calibrated sensor to sense the tracked information of the associated I/O component and then making the tracked information available to another one of the at least two I/O components.

### Claim 15 (depends on 13)

The method of claim 13 wherein the calibrated sensor is configured to sense tracked information comprising each of the location, orientation, and movement of the one I/O component.

### Claim 16 (depends on 13)

The method of claim 13 wherein the one calibrated sensor comprises a magnetometer.

### Claim 17

An alignment method for extended reality (XR) content comprising:
providing a first environment and a second environment, each having a first surface and a second surface;
in each of the first environment and the second environment, defining an intersection point;
defining at least one of the intersection points by:
providing a first line A that is coplanar with the first surface and a second line B that is coplanar with the second surface;
providing an intersecting plane that intersects the first surface and the second surface;
projecting line A onto the intersecting plane to provide projected line segment AP and projecting line B onto the intersecting plane to provide projected line segment BP, wherein line segment AP and line segment BP are sized and configured to intersect with one another at the at least one intersection point;
aligning a position of the first environment with a position of the second environment via an alignment process comprising aligning the intersection points,
wherein one environment of the first environment and the second environment is a XR environment comprising XR content generated by an XR content generation system (XGS) and wherein another environment of the first environment or the second environment is a physical environment.

### Claim 18 (depends on 17)

The method of claim 17, wherein, in at least one of the first environment and a second environment, providing points A1 and A2 that each has a location defined as co-planar with the first surface and providing points B1 and B2 that each has a location defined as co-planar with the second surface, wherein line A passes through points A1 and A2 and line B passes through points B1 and B2.

### Claim 19 (depends on 18)

The method of claim 18 wherein at least one of points A1, A2, B1, B2 is provided by selecting a portion of the first surface or second surface of the at least one of the first environment and a second environment in order to specify a location of the at least one point.

### Claim 20 (depends on 19)

The method of claim 19 further comprising, using the XGS, automatically selecting at least one of the points A1, A2, B1, B2 in response to the at least one point being selected.

### Claim 21 (depends on 17)

The method of claim 17 further comprising:
providing an alignment vector in each of the first environment and second environment, wherein each alignment has an alignment angle measured relative to either the first surface or the second surface; and
aligning an orientation of the first environment with an orientation of the second environment by aligning the alignment vectors.

### Claim 22 (depends on 17)

The method of claim 17 wherein line segment AP and line segment BP, when not extended, do not intersect one another, the method further comprising extending at least one of line segment AP and line segment BP in order to provide the intersection.

### Claim 23 (depends on 17)

The method of claim 17 wherein:
said one environment further includes a three-dimensional XR environment having an XR entity;
said another environment further includes a three-dimensional physical environment having a physical entity that corresponds to the XR entity; and
the XGS comprising an input device for receiving inputs for interacting with the XR content, and an output device for outputting XR content including at least visual XR content;
the method further comprising:
after the position of the first environment is aligned with a position of the second environment, when the physical entity is in a first physical position, using the output device, outputting visual XR content where the XR entity is located at a corresponding first XR position;
after the position of the first environment is aligned with a position of the second environment, with the input device, receiving an input corresponding to a change in position of the physical entity in the physical environment from the first physical position to a second and different physical position; and
after the position of the first environment is aligned with a position of the second environment, in response to the change of position of the physical entity, with the output device, outputting visual XR content where the XR entity is located at a corresponding second XR position.

### Claim 24 (depends on 23)

The method of claim 23 further comprising, after the position of the first environment is aligned with a position of the second environment, with the output device, outputting visual XR content that identically mirrors movement of the XR entity from the first XR position to the second XR position in the XR environment that identically mirrors the movement of the physical entity from the first physical position to the second physical position in the physical environment.

### Claim 25 (depends on 17)

The method of claim 17 wherein the first environment and the second environment each further comprise an intersecting plane that intersects the first surface and the second surface, the method further comprising placing the first environment at a selected height with respect to the second environment by separating the intersecting plane of the first environment at a selected height H with respect to the intersecting plane of the second environment.

### Claim 26 (depends on 17)

The method of claim 17 wherein the XR system includes at least two I/O components and a calibrated sensor associated with one of the least two I/O components, wherein the calibrated sensor is configured to sense tracked information comprising at least one of location, orientation, or movement of the one I/O component, the method further comprising using the calibrated sensor to sense the tracked information of the one I/O component and making the tracked information available to another one of the at least two I/O components.

### Claim 27 (depends on 26)

The method of claim 26 wherein a separate calibrated sensor is associated with each of the at least two I/O components, the method comprising using each calibrated sensor to sense the tracked information of the associated I/O component and then making the tracked information available to another one of the at least two I/O components.

### Claim 28 (depends on 26)

The method of claim 26 wherein the calibrated sensor is configured to sense tracked information comprising each of the location, orientation, and movement of the one I/O component.

### Claim 29 (depends on 26)

The method of claim 26 wherein the one calibrated sensor comprises a magnetometer.
