# US 2023/0054420 A1 · Placing and manipulating multiple three-dimensional (3d) models using mobile augmented reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0054420 A1
- Document ID: US20230054420A1
- Status: Published application
- Kind: A1
- Application number: 18/045,688
- Filed: 2022-10-11
- Published: 2023-02-23
- Earliest claimed: 2020-11-30
- Assignees: A9.com, Inc.
- Applicants: A9.com, Inc.
- Inventors: Mukul AGARWAL; Jonathan BERNADEL-HUEY; Kevin MAY; Xing ZHANG; Karl HILLESLAND; Jack MOUSSEAU; Simon FOX
- Web page: https://patentgrep.com/patent/US20230054420A1

## CPC

- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06Q 30/0643: {graphically representing goods, e.g. 3D product representation}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 2210/12: Bounding box
- G06T 2210/21: Collision detection, intersection
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Techniques for placing and manipulating multiple three-dimensional (3D) models using mobile augmented reality (AR) are described. One technique includes receiving a first request to initialize an AR simulation of a first product for sale within a physical environment. In response to the first request, a first 3D model of the first product for sale is rendered onto the screen. After rendering the first 3D model, a second request to visualize a second product for sale within the physical environment is received during the AR simulation of the first product for sale. In response to the second request, a second 3D model of the second product for sale is rendered onto the screen with the first 3D model.

## Claims

### Claim 1

A computer-implemented method comprising:
rendering a first virtual representation of a first item on a screen of a computing device;
after rendering the first virtual representation, rendering a second virtual representation of a second item on the screen with the first virtual representation;
detecting a collision between the first virtual representation and the second virtual representation on the screen; and
refraining from providing an indication of the collision to a user, when at least one of the first item or the second item satisfies a predetermined condition.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising, in response to detecting the collision, rendering the first virtual representation on top of the second virtual representation when (i) the first virtual representation is selected and (ii) the first item and the second item satisfy the predetermined condition.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, further comprising, in response to detecting the collision, rendering the second virtual representation on top of the first virtual representation when (i) the second virtual representation is selected and (ii) the first item and the second item satisfy the predetermined condition.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the predetermined condition is a predefined item type.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the predetermined condition is based on at least one of a size or one or more dimensions.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein:
detecting the collision comprises determining that a first bounding box of the first virtual representation at least partially collides with a second bounding box of the second virtual representation on the screen; and
the first bounding box and the second bounding box are not visible on the screen.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein refraining from providing the indication of the collision comprises at least one of:
refraining from rendering at least one of a first bounding box of the first virtual representation or a second bounding box of the second virtual representation on the screen; or
refraining from generating a haptic feedback signal on the computing device.

### Claim 8

A computing device, comprising:
a screen;
one or more processors; and
a memory storing instructions, which, when executed on the one or more processors perform an operation comprising:
rendering a first virtual representation of a first item on the screen;
after rendering the first virtual representation, rendering a second virtual representation of a second item on the screen with the first virtual representation;
detecting a collision between the first virtual representation and the second virtual representation on the screen; and
refraining from providing an indication of the collision to a user, when at least one of the first item or the second item satisfies a predetermined condition.

### Claim 9 (depends on 8)

The computing device of claim 8, the operation further comprising, in response to detecting the collision, rendering the first virtual representation on top of the second virtual representation when (i) the first virtual representation is selected and (ii) the first item and the second item satisfy the predetermined condition.

### Claim 10 (depends on 8)

The computing device of claim 8, the operation further comprising, in response to detecting the collision, rendering the second virtual representation on top of the first virtual representation when (i) the second virtual representation is selected and (ii) the first item and the second item satisfy the predetermined condition.

### Claim 11 (depends on 8)

The computing device of claim 8, wherein the predetermined condition is a predefined item type.

### Claim 12 (depends on 8)

The computing device of claim 8, wherein the predetermined condition is based on at least one of a size or one or more dimensions.

### Claim 13 (depends on 8)

The computing device of claim 8, wherein:
detecting the collision comprises determining that a first bounding box of the first virtual representation at least partially collides with a second bounding box of the second virtual representation on the screen; and
the first bounding box and the second bounding box are not visible on the screen.

### Claim 14 (depends on 8)

The computing device of claim 8, wherein refraining from providing the indication of the collision comprises at least one of:
refraining from rendering at least one of a first bounding box of the first virtual representation or a second bounding box of the second virtual representation on the screen; or
refraining from generating a haptic feedback signal on the computing device.

### Claim 15

A non-transitory computer-readable storage medium having computer-executable code stored thereon, the computer-executable code being executable by one or more processors to perform an operation comprising:
rendering a first virtual representation of a first item on a screen of a computing device;
after rendering the first virtual representation, rendering a second virtual representation of a second item on the screen with the first virtual representation;
detecting a collision between the first virtual representation and the second virtual representation on the screen; and
refraining from providing an indication of the collision to a user, when at least one of the first item or the second item satisfies a predetermined condition.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, the operation further comprising, in response to detecting the collision, rendering the first virtual representation on top of the second virtual representation when (i) the first virtual representation is selected and (ii) the first item and the second item satisfy the predetermined condition.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, the operation further comprising, in response to detecting the collision, rendering the second virtual representation on top of the first virtual representation when (i) the second virtual representation is selected and (ii) the first item and the second item satisfy the predetermined condition.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the predetermined condition is a predefined item type.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the predetermined condition is based on at least one of a size or one or more dimensions.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein:
detecting the collision comprises determining that a first bounding box of the first virtual representation at least partially collides with a second bounding box of the second virtual representation on the screen; and
the first bounding box and the second bounding box are not visible on the screen.
