US 12,586,326 B2 · Mapping a real-world room for a shared artificial reality environment

Abstract

A room manager can generate mappings for a real-world room that support a shared XR environment. For example, the real-world room can include real-world objects and surfaces, such as a table(s), chair(s), wall(s), door(s), window(s), etc. The room manager can generate XR object definitions based on information received about the real-world room, object(s), and surface(s). For example, the room manager can implement a flow that guides a user equipped with an XR system to provide information for the XR object definitions, such as real-world surfaces that map to the XR object(s), borders (e.g., measured using a component of the XR system), such as borders on real-world surfaces, semantic information (e.g., number of seat assignments at an XR table, size of XR objects, etc.), and other suitable information. Implementations generate previews of the shared XR environment, such as a local preview and a remote preview.

Claims20

Dependent claims

A method for providing a shared XR experience comprising a local version for one or more local users, wherein a remote version is provided for one or more remote users, the method comprising:

rendering, during the shared XR experience by a first XR system, the local version, wherein, in the local version:
the one or more remote users are represented using one or more avatars and the one or more local users are represented using a passthrough video capture of the one or more local users in a real-world room, and
at least part of the real-world room is displayed in passthrough by the first XR system using a video capture of the real-world room;
wherein the remote version is rendered, during the shared XR experience, by a second XR system, and in the remote version:
the one or more remote users and the one or more local users are represented using avatars, and
a virtual room that corresponds to the real-world room is displayed by the second XR system.

3 more elements

A computer-readable storage medium storing instructions, for providing a shared XR experience comprising a local version for one or more local users, wherein a remote version is provided for one or more remote users, the instructions, when executed by a computing system, cause the computing system to:

render, during the shared XR experience by a first XR system, the local version,
wherein, in the local version:
the one or more remote users are represented using one or more avatars and the one or more local users are represented using a passthrough video capture of the one or more local users in a real-world room, and
at least part of the real-world room is displayed in passthrough by the first XR system using a video capture of the real-world room;
wherein the remote version is rendered, during the shared XR experience, by a second XR system, and in the remote version:
the one or more remote users and the one or more local users are represented using avatars, and
a virtual room that corresponds to the real-world room is displayed by the second XR system.

4 more elements

A computing system, for providing a shared XR experience comprising a local version for one or more local users, wherein a remote version is provided for one or more remote users, the computing system comprising:

one or more processors;
and
one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to:
render, during the shared XR experience by a first XR system, the local version, wherein, in the local version:
the one or more remote users are represented using one or more avatars and the one or more local users are represented using a passthrough video capture of the one or more local users in a real-world room, and
at least part of the real-world room is displayed in passthrough by the first XR system using a video capture of the real-world room;
wherein the remote version is rendered, during the shared XR experience, by a second XR system, and in the remote version:
the one or more remote users and the one or more local users are represented using avatars, and
a virtual room that corresponds to the real-world room is displayed by the second XR system.

6 more elements

Dependencies are inferred from the claim text.

Mapping a real-world room for a shared artificial reality environment

Life of this patent

Mapping a real-world room for a shared artificial reality environment

Life of this patent

Abstract

Claims20