# US 2022/0044492 A1 · Systems and methods for spatial remodeling in extended reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044492 A1
- Document ID: US20220044492A1
- Status: Published application
- Kind: A1
- Application number: 17/509,833
- Filed: 2021-10-25
- Published: 2022-02-10
- Earliest claimed: 2020-04-27
- Assignees: AT&T Intellectual Property I, L.P.
- Applicants: AT&T Intellectual Property I, L.P.
- Inventors: Eric Zavesky; Jean-Francois Paiement; Tan Xu; David Crawford Gibbon; Jianxiong Dong
- Web page: https://patentgrep.com/patent/US20220044492A1

## CPC

- G06Q 30/0275: {Auctions}
- G06F 18/231: Hierarchical techniques, i.e. dividing or merging pattern sets so as to obtain a dendrogram
- G06F 30/13: Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
- G06N 3/0475: Generative networks
- G06N 3/09: Supervised learning
- G06N 3/094: Adversarial learning
- G06N 20/00: Machine learning
- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- G06T 7/75: {involving models}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06V 10/7625: {Hierarchical techniques, i.e. dividing or merging patterns to obtain a tree-like representation; Dendograms}
- G06V 10/82: using neural networks
- G06V 10/945: {User interactive design; Environments; Toolboxes}
- G06V 20/20: in augmented reality scenes
- G06F 2111/16: Customisation or personalisation
- G06F 2111/18: using virtual or augmented reality
- G06N 3/045: Combinations of networks
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Aspects of the subject disclosure may include, for example, storing, in a database, a decorating style preference of a user; receiving, from user equipment of the user, one or more images (and/or one or more 2D environment models and/or one or more 3D environment models) depicting an environment in which remodeling is desired; generating, via a machine learning process, a first model to present by the user equipment, the generating the first model being based upon the decorating style preference and the one or more images (and/or the one or more 2D environment models and/or the one or more 3D environment models), the first model comprising a first remodeling proposal for the environment; sending, to the user equipment, the first model, the sending of the first model facilitating display by the user equipment of a first depiction of the environment as proposed by the first remodeling proposal; receiving, from the user equipment, feedback information regarding the first remodeling proposal; generating, via the machine learning process, a second model to present by the user equipment, the generating the second model being based upon the decorating style preference, the one or more images (and/or the one or more 2D environment models and/or the one or more 3D environment models), and the feedback information, the second model comprising a second remodeling proposal for the environment; and sending, to the user equipment, the second model, the sending of the second model facilitating display by the user equipment of a second depiction of the environment as proposed by the second remodeling proposal. Other embodiments are disclosed.

## Claims

### Claim 1

A device, comprising:
a processing system including a processor; and
a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising:
generating a first model to present by user equipment of a user, the generating the first model being based upon a decorating style preference of the user and one or more images that are received from the user equipment, the decorating style preference comprising a textual label from a taxonomy of visual descriptors, the one or more images depicting an environment in which remodeling is desired, and the first model comprising a first remodeling proposal for the environment;
sending, to the user equipment, the first model, the sending of the first model facilitating display by the user equipment of a first depiction of the environment as proposed by the first remodeling proposal; and
generating a second model to present by the user equipment, the generating the second model being based upon the decorating style preference, the one or more images, and feedback information that is received from the user equipment, the feedback information regarding the first remodeling proposal, and the second model comprising a second remodeling proposal for the environment.

### Claim 2 (depends on 1)

The device of claim 1, wherein:
the operations further comprise sending, to the user equipment, the second model, the sending of the second model facilitating display by the user equipment of a second depiction of the environment as proposed by the second remodeling proposal;
the generating the first model and the generating the second model are via a machine learning process; and
the machine learning process comprises a generative adversarial network (GAN).

### Claim 3 (depends on 2)

The device of claim 2, wherein the generating the second model comprises utilization of a randomly seeded model.

### Claim 4 (depends on 3)

The device of claim 3, wherein the feedback information comprises a single input from the user which causes utilization of the randomly seeded model.

### Claim 5 (depends on 1)

The device of claim 1, wherein the one or more images comprises a single image, a plurality of images, a video stream, volumetric video, one or more three dimensional point cloud models, one or more polygonal meshes, one or more level sets, one or more computer-aided design (CAD) models, or any combination thereof.

### Claim 6 (depends on 1)

The device of claim 1, wherein the user equipment comprises a camera, a webcam, an augmented reality application, a virtual reality application, a head-mounted device, an eyeglasses device, or any combination thereof.

### Claim 7 (depends on 1)

The device of claim 1, wherein:
the decorating style preference comprises a plurality of decorating style preferences;
the operations further comprise receiving from the user the plurality of decorating style preferences;
the generating the first model is based upon the plurality of decorating style preferences; and
the generating the second model is based upon the plurality of decorating style preferences.

### Claim 8 (depends on 1)

The device of claim 1, wherein the environment comprises a room in a building, an exterior of a building, or any combination thereof.

### Claim 9 (depends on 8)

The device of claim 8, wherein the building comprises a single-family home, a multi-family home, an apartment unit, an apartment building, an office building or any combination thereof.

### Claim 10 (depends on 1)

The device of claim 1, wherein:
the first model that is sent to the user equipment comprises first data that facilitates presenting to the user, by the user equipment, the first depiction of the environment as proposed by the first remodeling proposal;
the operations further comprise sending, to the user equipment, the second model, the sending of the second model facilitating display by the user equipment of a second depiction of the environment as proposed by the second remodeling proposal;
the second model that is sent to the user equipment comprises second data that facilitates presenting to the user, by the user equipment, the second depiction of the environment as proposed by the second remodeling proposal; and
the user equipment comprises a smartphone, goggles, a holographic display, a volumetric display, or any combination thereof.

### Claim 11 (depends on 1)

The device of claim 1, wherein:
the first model that is sent to the user equipment comprises a single image, a plurality of images, a video stream, volumetric video, one or more three dimensional point cloud models, one or more polygonal meshes, one or more level sets, one or more computer-aided design (CAD) models, or any combination thereof;
the operations further comprise sending, to the user equipment, the second model; and
the second model that is sent to the user equipment comprises a single image, a plurality of images, a video stream, volumetric video, one or more three dimensional point cloud models, one or more polygonal meshes, one or more level sets, one or more CAD models, or any combination thereof.

### Claim 12 (depends on 1)

The device of claim 1, wherein the operations further comprise:
sending, to the user equipment, the second model, the sending of the second model facilitating display by the user equipment of a second depiction of the environment as proposed by the second remodeling proposal;
sending, to the user equipment, vendor information depicting a suggested feature for inclusion in the second depiction of the environment; and
billing a vendor of the suggested feature responsive to the sending of the vendor information.

### Claim 13 (depends on 12)

The device of claim 12, wherein the operations further comprise receiving, from the user equipment, a request for the vendor information, the sending the vendor information to the user equipment being responsive to receipt of the request.

### Claim 14

A non-transitory machine-readable medium comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations, the operations comprising:
producing a first model to present at user equipment of a user, the producing the first model being based upon a decorating style preference of the user, the decorating style preference comprising a textual label from a taxonomy of visual descriptors, the producing the first model further being based upon one or more images depicting an environment in which remodeling is desired, and the first model comprising a first remodeling proposal for the environment;
transmitting, to the user equipment, the first model, the transmitting of the first model enabling presentation by the user equipment of a first depiction of the environment as proposed by the first remodeling proposal; and
producing a second model to present at the user equipment, the producing the second model being based upon the decorating style preference, the producing the second model being further based upon the one or more images, and the producing the second model being further based upon feedback information, the feedback information being information from the user regarding the first remodeling proposal, and the second model comprising a second remodeling proposal for the environment.

### Claim 15 (depends on 14)

The non-transitory machine-readable medium of claim 14, wherein:
the producing the first model and the producing the second model are via a machine learning process; and
the operations further comprise:
receiving, from the user, the decorating style preference;
storing, in a database, the decorating style preference that is received;
receiving, from the user equipment, the one or more images depicting the environment in which remodeling is desired;
receiving, from the user equipment, the feedback information regarding the first remodeling proposal; and
transmitting, to the user equipment, the second model, the transmitting of the second model enabling presentation by the user equipment of a second depiction of the environment as proposed by the second remodeling proposal.

### Claim 16 (depends on 14)

The non-transitory machine-readable medium of claim 14, wherein the one or more images comprises a single image, a plurality of images, a video stream, volumetric video, one or more three dimensional point cloud models, one or more polygonal meshes, one or more level sets, one or more computer-aided design (CAD) models, or any combination thereof.

### Claim 17 (depends on 14)

The non-transitory machine-readable medium of claim 14, wherein the user equipment comprises a camera, a webcam, an augmented reality application, a virtual reality application, a head-mounted device, an eyeglasses device, or any combination thereof.

### Claim 18

A method, comprising:
generating, by a processing system including a processor, a model comprising a remodeling proposal for a first environment, the generating the model being based upon a decorating style preference of a first user and the generating the model being based upon one or more images that are received from an augmented reality device used by the first user in the first environment, the decorating style preference of the first user comprising a textual label from a taxonomy of visual descriptors, and the one or more images depicting the first environment; and
sending by the processing system, to a virtual reality device used by a second user in a second environment, the model, the second environment being physically remote from the first environment, the sending of the model facilitating display to the second user via the virtual reality device of a depiction of the first environment as proposed by the remodeling proposal.

### Claim 19 (depends on 18)

The method of claim 18, wherein:
the generating is via a machine learning process; and
the model that is sent to the virtual reality device comprises data that facilitates presenting to the second user, by the virtual reality device, the depiction of the first environment as proposed by the remodeling proposal.

### Claim 20 (depends on 18)

The method of claim 18, wherein:
the model that is sent to the virtual reality device comprises a single image, a plurality of images, a video stream, volumetric video, one or more three dimensional point cloud models, one or more polygonal meshes, one or more level sets, one or more computer-aided design (CAD) models, or any combination thereof.
