US 11,080,935 B2Granted

Systems and methods for scene-independent augmented reality interfaces

AssigneeWayfair LLC

InventorsShrenik Sadalgi, Kunal Rajesh Khona

Life of this patent

Estimating the term…

Loading patent…

Abstract

Some embodiments include a method comprising using a first computing device to perform: obtaining an image of a scene captured using a camera coupled to the first computing device; obtaining camera setting values used to capture the image; determining, using the image, surface attribute values characterizing at least one surface shown in the image of the scene; generating an augmented reality (AR) interface at least in part by using the camera setting values and the surface attribute values to create a first composite image by overlaying a selected virtual furniture object onto the image so that the virtual furniture object is displayed in the AR interface as being on a first surface of the at least one surface shown in the image; and transmitting, to a second computing device and via at least one communication network, the first composite image, the camera setting values and the surface attribute values.

Claims20

Dependent claims

A method, comprising:

using a first computing device associated with a first user to perform:
obtaining an image of a scene captured using a camera coupled to the first computing device;
obtaining camera setting values used to capture the image;
determining, using the image, surface attribute values characterizing at least one surface shown in the image of the scene;
generating an augmented reality (AR) interface at least in part by using the camera setting values and the surface attribute values to create a first composite image by overlaying a first virtual object onto the image so that the first virtual object is displayed in the AR interface as being on a first surface of the at least one surface shown in the image of the scene;
transmitting, to a second computing device and via at least one communication network, the first composite image, the camera setting values and the surface attribute values;
receiving, from the second computing device, at least one second composite image obtained by changing the first composite image by a second user;
and
generating a first graphical user interface (GUI) using the at least one second composite image, the camera setting values and the surface attribute values;
and
at the second computing device and before receiving the at least one second composite image at the first computing device:
receiving, from the first computing device and via the at least one communication network, the first composite image, the camera setting values, and the surface attribute values;
generating a second GUI using the first composite image, the camera setting values, and the surface attribute values;
receiving, via the second GUI, user input indicating a second virtual object to add to the first composite image, indicating a change to the first virtual object in the first composite image, and/or indicating to remove the first virtual object from the first composite image;
and
generating the at least one second composite image based on the received user input.

13 more elements

A method, comprising:

using a second computing device to perform:
receiving, from a first computing device and via at least one communication network:
(1) a first composite image of a scene obtained by overlaying a first virtual object on an image of the scene;
(2) camera setting values used to capture the image of the scene;
and (3) surface attribute values characterizing at least one surface in the image of the scene;
generating a graphical user interface (GUI) using the first composite image, the camera setting values, and the surface attribute values;
receiving, via the GUI, user input indicating a second virtual object to add to the first composite image, indicating a change to the first virtual object in the first composite image, and/or indicating to remove the first virtual object from the first composite image;
and
generating a second composite image based on the received user input.

6 more elements

At least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by at least one processor of a second computing device, cause the at least one processor to perform:

receiving, from a first computing device and via at least one communication network:
(1) a first composite image of a scene obtained by overlaying a first virtual object on an image of the scene;
(2) camera setting values used to capture the image of the scene;
and (3) surface attribute values characterizing at least one surface in the image of the scene;
generating a graphical user interface (GUI) using the first composite image, the camera setting values, and the surface attribute values;
receiving, via the GUI, user input indicating a second virtual object to add to the first composite image, indicating a change to the first virtual object in the first composite image, and/or indicating to remove the first virtual object from the first composite image;
and
generating a second composite image based on the received user input.

5 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/691,952Filed 22 Nov 2019 · us provisional application
Priority: 3 Apr 2019
Published: US 2020/0320792 A18 Oct 2020
Granted: 3 Aug 2021
Term ends: Not estimatedThe source records don’t support an estimate.

Classification15 codes

G06T 19/006
Manipulating three-dimensional [3D] models or images for computer graphics: mixed reality
G02B 27/017
Head-up displays: head mounted
G06F 3/011
Input arrangements or combined input and output arrangements for interaction between user and computer: arrangements for interaction with the…
G06F 3/017
Input arrangements or combined input and output arrangements for interaction between user and computer: gesture based interaction, e.g. based on a…