US 12,296,264 B2Granted

Systems and methods for rendering a virtual content object in an augmented reality environment

OwnerNicholas T. Haritoninventor

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems and methods for rendering of a virtual content object in an augmented reality environment based on a physical marker are discussed herein. Virtual content objects may be rendered by a display device in an augmented reality environment based on the field of view seen through the display device and a position of a marker (and one or more linkage points associated with the marker) in the real world. When rendered in the augmented reality environment, the virtual content objects may be visualized from any angle, from the exterior or interior of the object, and manipulated in response to user input. Virtual content objects and/or user visualizations of virtual content objects may be shared with other users (local and/or remote), enabling multiple users to potentially build, modify, and/or interact with a virtual content object simultaneously and/or cooperatively.

Claims10

Dependent claims

A system configured to convey virtual content in an augmented reality environment, via a presentation device, by causing superimposition of images of the virtual content over physical objects and/or physical surroundings visible within a field of view of a user as if the images of the virtual content were present in a real world, wherein the augmented reality environment includes (i) the physical objects and/or the physical surroundings visible within the field of view of the user and (ii) the images of the virtual content presented in conjunction with the physical objects and/or the physical surroundings, the system comprising:

electronic storage that stores information related to virtual surfaces that are applied to physical surfaces in the augmented reality environment visible within the field of view of the user;
and
one or more processors configured by machine-readable instructions to:
generate a user interface that enables the user to provide user input related to the physical objects visible within the field of view of the user;
obtain, via the user interface, the user input, wherein the user input specifies (i) sets of linkage points on the physical surfaces of some of the physical objects within the field of view of the user upon which the virtual surfaces are to be applied to, and (ii) surface definitions that define the virtual surfaces;
store the sets of linkage points and the surface definitions to the electronic storage;
receive, via the user interface, selections of one of the physical surfaces visible within the field of view of the user and one of the surface definitions from the electronic storage;
generate, based on the selections, an image of a virtual surface for the selected physical surface to be presented in the augmented reality environment;
and
cause the image to be presented in the augmented reality environment via the presentation device so that the virtual surface is covering the selected physical surface in accordance with the set of linkage points for the selected physical surface.

7 more elements

A method, implemented using one or more processors, for conveying virtual content in an augmented reality environment, via a presentation device, by causing superimposition of images of the virtual content over physical objects and/or physical surroundings visible within a field of view of a user as if the images of the virtual content were present in a real world, wherein the augmented reality environment includes (i) the physical objects and/or the physical surroundings visible within the field of view of the user and (ii) the images of the virtual content presented in conjunction with the physical objects and/or the physical surroundings, the method comprising:

generating a user interface that enables the user to provide user input related to the physical objects visible within the field of view of the user;
obtaining, via the user interface and using the one or more processors, the user input, wherein the user input specifies (i) sets of linkage points on physical surfaces of some of the physical objects in the augmented reality environment visible within the field of view of the user upon which virtual surfaces are to be applied to, and (ii) surface definitions that define the virtual surfaces;
storing the sets of linkage points and the surface definitions to electronic storage;
receiving, via the user interface, selections of one of the physical surfaces visible within the field of view of the user and one of the surface definitions from the electronic storage;
generating, using the one or more processors, an image of a virtual surface for the selected physical surface to be presented in the augmented reality environment based on the selections;
and
causing, using the one or more processors, the image to be presented in the augmented reality environment via the presentation device so that the virtual surface is covering the selected physical surface in accordance with the set of linkage points for the selected physical surface.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application: 18/359,357Filed 26 Jul 2023 · continuation
Priority: 27 Oct 2017
Published: US 2023/0364512 A116 Nov 2023
Granted: 13 May 2025
Term ends: Not estimatedThe source records don’t support an estimate.

Classification25 codes

A63F 13/53
Controlling the output signals based on the game progress: involving additional visual information provided to the game scene, e.g. by overlay to…
A63F 13/216
Characterised by their sensors, purposes or types: using geographical information, e.g. location of the game device or player using GPS
A63F 13/26
Output arrangements for video game devices: having at least one additional display device, e.g. on the game controller or outside a game booth
A63F 13/52
Controlling the output signals based on the game progress: involving aspects of the displayed game scene

Family

Application15/796,716Parent of this continuation · filed 27 Oct 2017
Application16/162,947Parent of this continuation · filed 17 Oct 2018
US 10,105,601 B1Parent of this continuation · filed 23 Oct 2018
Application16/855,306Parent of this continuation · filed 22 Apr 2020
US 10,661,170 B2Parent of this continuation · filed 26 May 2020
Application17/537,027Parent of this continuation · filed 29 Nov 2021
US 11,185,775 B2Parent of this continuation · filed 30 Nov 2021
US 2023/0364512 A1Pre-grant publication · published 16 Nov 2023
US 11,752,431 B2Parent of this continuation
US 2019/0126149 A1Published application
US 2020/0246699 A1Published application
US 2022/0080311 A1Published application
US 12,296,264 B2This patent

From the US filing history. Foreign family members aren’t listed.