# US 12,762,611 B2 · System and method for creating virtual reality stores optimized for product uses

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,762,611 B2
- Document ID: US12762611B2
- Status: Granted
- Kind: B2
- Application number: 18/239,205
- Filed: 2023-08-29
- Published: 2025-03-06
- Granted: 2026-10-13
- Earliest claimed: 2023-08-29
- Assignees: Adeia Guides Inc.
- Applicants: Adeia Guides Inc.
- Inventors: Mona Singh
- Web page: https://patentgrep.com/patent/US12762611B2

## CPC

- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06Q 30/0631: {Recommending goods or services}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems and methods for creating an optimized virtual reality store based on a user's product selections are disclosed. A user selects a product of interest from a virtual store. Based on metadata of the product of interest, a product use for the product of interest is identified. Associated products which supplement the product of interest in accomplishing the product use are identified. A level of importance for each associated product is determined based on the product of interest, product use, user data, and the difficulty in finding it in the virtual store. A set of associated products is recommended to the user based on their levels of importance. An optimized layout is generated based on the recommended products. Sections of the optimized layout are assigned a level of importance. The recommended products are displayed in the sections based on a corresponding level of importance of the recommended product.

## Claims

### Claim 1

A method comprising:
generating for display, according to a field of view, a virtual reality (VR) shopping interface based on a layout for a plurality of products, wherein:
the generating for display the VR shopping interface based on the layout comprises, in a first state, representing the plurality of products in a virtual store,
wherein the layout is based on a pre-established, originally authored VR model, and
wherein the layout indicates a different position with respect to the field of view for each of the plurality of products according to which the plurality of products are to be displayed;
determining a product of interest from the plurality of products, the layout indicating a position with respect to the field of view for the product of interest, wherein the product of interest is located at a first virtual location with respect to the virtual store;
based at least in part on the determined product of interest, identifying a product use, wherein the product use comprises an activity to be performed by way of the product of interest;
identifying a recommended product from the plurality of products based on the product use comprising the activity to be performed by way of the product of interest, the layout indicating a first position with respect to the field of view for the recommended product, wherein the recommended product is located at a second virtual location with respect to the virtual store;
comparing a first relationship between the product of interest and the product use with a second relationship between the recommended product and the product use; and
based at least in part on the identifying the recommended product based on the product use comprising the activity to be performed by way of the product of interest:
generating, based at least in part on the pre-established, originally authored VR model, an optimized layout to indicate a second position with respect to the field of view for the recommended product, wherein the position and the second position in the optimized layout are determined based at least in part on the compared first and second relationships; and
generating for display the VR shopping interface based on the optimized layout, wherein:
the generating for display the VR shopping interface based on the optimized layout comprises, in a second state, representing simultaneously both the product of interest at the position with respect to the field of view for the product of interest and the recommended product at the second position with respect to the field of view for the recommended product, and
wherein the pre-established, originally authored VR model remains unmodified between the generating for display the VR shopping interface in the first state and the generating for display the VR shopping interface in the second state.

### Claim 2 (depends on 1)

The method of claim 1, wherein the product use associated with the product of interest is identified based on at least one of metadata associated with the product of interest, metadata associated with a similar product to the product of interest, or user data.

### Claim 3 (depends on 1)

The method of claim 1, wherein the recommended product supplements the product of interest in accomplishing the product use.

### Claim 4 (depends on 1)

The method of claim 1:
wherein each of the plurality of products is associated with a product importance level;
wherein each position in the optimized layout is associated with a position importance level;
wherein a product importance level of the product of interest corresponds with a position importance level of the position in the optimized layout; and
wherein a product importance level of the recommended product corresponds with a position importance level of the second position in the optimized layout.

### Claim 5 (depends on 4)

The method of claim 4, wherein the product importance level of the recommended product is based on a status of the recommended product, the status being one of a required status or an optional status;
wherein the recommended product has a required status if the recommended product is necessary to accomplish the product use; and
wherein the recommended product has an optional status if the recommended product is not necessary to accomplish the product use.

### Claim 6 (depends on 5)

The method of claim 5, wherein the status of the recommended product is determined based on at least one of: (i) the product of interest, (ii) metadata associated with a similar product to the product of interest, or (iii) user data.

### Claim 7 (depends on 4)

The method of claim 4, wherein the product importance level of the recommended product comprises a composite score based on a level of difficulty of finding the recommended product in the first position of the layout from the position of the product of interest in the layout.

### Claim 8 (depends on 4)

The method of claim 4, wherein positions of lower position importance levels are located toward a periphery of the optimized layout and wherein positions of higher position importance levels are located toward a center of the optimized layout.

### Claim 9 (depends on 1)

The method of claim 1, wherein the position and the second position are relocated in the optimized layout when the recommended product is selected.

### Claim 10 (depends on 1)

The method of claim 1, wherein display attributes associated with displaying each of the product of interest and the recommended product comprise at least one of: distance between the product of interest and the recommended product, centrality of position with respect to the field of view, size of area occupied in the field of view, rendered object size, luminosity, transparency, focus, coloring, or labeling.

### Claim 11 (depends on 10)

The method of claim 10, wherein the display attributes of the recommended product is based on whether the recommended product has a required status or an optional status,
wherein the recommended product is required if the recommended product is necessary for accomplishing the product use, and
wherein the recommended product is optional if the recommended product is not necessary for accomplishing the product use.

### Claim 12 (depends on 10)

The method of claim 10, wherein the display attributes of the recommended product are based on a product importance level of the recommended product.

### Claim 13 (depends on 10)

The method of claim 10, further comprising:
in response to receiving a selection of the recommended product displayed in the second position of the optimized layout:
relocating the product of interest to a third position in the optimized layout or removing the product of interest from display;
relocating the recommended product to the position in the optimized layout; and
displaying a second recommended product in the second position in the optimized layout.

### Claim 14 (depends on 1)

The method of claim 1, further comprising:
displaying a transaction status associated with the product of interest and the recommended product.

### Claim 15 (depends on 1)

The method of claim 1, wherein the product of interest is determined based on at least one of: a user motion, a gesture, a speech command, an input received from a control device selecting the product of interest, or a user gaze on the product of interest for a period of time.

### Claim 16 (depends on 1)

The method of claim 1:
wherein the first state of the VR shopping interface comprises a first VR interface layer,
wherein the first VR interface layer comprises the representing of, based on the layout, the plurality of products in the virtual store; and
wherein the second state of the VR shopping interface comprises a second VR interface layer overlaid on the first VR interface layer,
wherein the second VR interface layer comprises the representing simultaneously of, based on the optimized layout, both the product of interest at the position with respect to the field of view for the product of interest and the recommended product at the second position with respect to the field of view for the recommended product.

### Claim 17

A system comprising:
control circuitry configured to:
generate for display, according to a field of view, a virtual reality (VR) shopping interface based on a layout for a plurality of products, wherein;
the generating for display the VR shopping interface based on the layout comprises, in a first state, representing the plurality of products in a virtual store,
wherein the layout is based on a pre-established, originally authored VR model, and
wherein the layout indicates a different position with respect to the field of view for each of the plurality of products according to which the plurality of products are to be displayed;
determine a product of interest from the plurality of products, the layout indicating a position with respect to the field of view for the product of interest, wherein the product of interest is located at a first virtual location with respect to the virtual store;
based at least in part on the determined product of interest, identify a product use, wherein the product use comprises an activity to be performed by way of the product of interest;
identify a recommended product from the plurality of products based on the product use comprising the activity to be performed by way of the product of interest, the layout indicating a first position with respect to the field of view for the recommended product, wherein the recommended product is located at a second virtual location with respect to the virtual store;
compare a first relationship between the product of interest and the product use with a second relationship between the recommended product and the product use; and
based at least in part on the identifying the recommended product based on the product use comprising the activity to be performed by way of the product of interest:
generate, based at least in part on the pre-established, originally authored VR model, an optimized layout to indicate a second position with respect to the field of view for the recommended product, wherein the position and the second position in the optimized layout are determined based at least in part on the compared first and second relationships; and
generate for display the VR shopping interface based on the optimized layout, wherein:
the generating for display the VR shopping interface based on the optimized layout comprises, in a second state, representing simultaneously both the product of interest at the position with respect to the field of view for the product of interest and the recommended product at the second position with respect to the field of view for the recommended product, and
wherein the pre-established, originally authored VR model remains unmodified between the generating for display the VR shopping interface in the first state and the generating for display the VR shopping interface in the second state.

### Claim 18 (depends on 17)

The system of claim 17, wherein the product use associated with the product of interest is identified based on at least one of metadata associated with the product of interest, metadata associated with a similar product to the product of interest, or user data; and
wherein the recommended product supplements the product of interest in accomplishing the product use.

### Claim 19 (depends on 17)

The system of claim 17:
wherein each of the plurality of products is associated with a product importance level;
wherein each position in the optimized layout is associated with a position importance level;
wherein a product importance level of the product of interest corresponds with a position importance level of the position in the optimized layout; and
wherein a product importance level of the recommended product corresponds with a position importance level of the second position in the optimized layout.

### Claim 20

A method comprising:
generating, for display within a virtual reality (VR) shopping interface in a first state, a representation of a virtual store environment based on a predefined layout corresponding to a field of view,
wherein the predefined layout is based on a pre-established, originally authored VR model, and
wherein the predefined layout comprises positional data with respect to the field of view for a plurality of products, wherein each product of the plurality of products is assigned a distinct virtual location within the virtual store environment;
determining a product of interest from among the plurality of products, the predefined layout indicating a position of the product of interest, wherein the position of the product of interest corresponds to a first virtual location within the virtual store environment;
identifying, based at least in part on the product of interest, a corresponding product use, the product use comprising an activity to be performed by way of the product of interest;
selecting, from the plurality of products, a recommended product based on the identified product use, wherein the recommended product is associated with facilitating or enhancing the activity to be performed by way of the product of interest, and the predefined layout indicating a first position of the recommended product, wherein the first position of the recommended product corresponds to a second virtual location within the virtual store environment;
comparing a first relationship between the product of interest and the product use with a second relationship between the recommended product and the product use;
optimizing the predefined layout by repositioning the recommended product from the first position to a second position,
wherein the position and the second position in the optimized layout are determined based at least in part on the compared first and second relationships,
wherein the second position is determined further based on at least one of: the field of view or the position of the product of interest, such that display of the recommended product is within a certain distance of display of the product of interest in the VR shopping interface regardless of a distance between the first virtual location and the second virtual location, and
wherein the pre-established, originally authored VR model remains unmodified in the optimizing of the predefined layout; and
generating, for display, the VR shopping interface in a second state based on the optimized layout, wherein:
both the product of interest at the position and the recommended product at the second position are simultaneously rendered,
wherein the positional data of the product of interest and the recommended product in the optimized layout corresponds to respective levels of natural human visual focus with respect to the field of view, and
wherein the pre-established, originally authored VR model remains unmodified between the generating for display the VR shopping interface in the first state and the generating for display the VR shopping interface in the second state.