# US 2025/0166376 A1 · Virtualizing objects using object models and object position data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0166376 A1
- Document ID: US20250166376A1
- Status: Published application
- Kind: A1
- Application number: 19/029,670
- Filed: 2025-01-17
- Published: 2025-05-22
- Earliest claimed: 2017-12-13
- Assignees: Lowe's Companies, Inc.
- Applicants: Lowe's Companies, Inc.
- Inventors: Mason E. Sheffield; Josh Shabtai
- Web page: https://patentgrep.com/patent/US20250166376A1

## CPC

- G06V 20/20: in augmented reality scenes
- G06F 16/5854: {using shape and object relationship}
- G06F 16/9537: Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
- G06N 20/00: Machine learning
- G06T 7/75: {involving models}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Described herein are techniques for receiving, from a device, at least one of image data or depth sensor data about one or more physical objects located in a physical space. The techniques further include determining whether an event occurred to the physical space where the one or more physical objects were located. The techniques further include identifying whether any of the one or more physical object were impacted by the event by comparing at least the image data or the depth sensor data to a catalog of objects storing object data about the one or more physical objects. The techniques further include assessing an impact of the event based at least in part on the one or more physical objects that are identified as having been impacted by the event. The techniques further include causing an output indicating the impact of the event.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A method comprising:
receiving, from a device, at least one of image data or depth sensor data about one or more physical objects located in a physical space;
determining whether an event occurred to the physical space where the one or more physical objects were located;
identifying whether any of the one or more physical objects were impacted by the event by comparing at least the image data or the depth sensor data to a catalog of objects storing object data about the one or more physical objects;
assessing an impact of the event based at least in part on the one or more physical objects that are identified as having been impacted by the event; and
causing an output indicating the impact of the event.

### Claim 22 (depends on 21)

The method of claim 21, wherein determining the event comprises using at least one of the image data or the depth sensor data to determine variances in at least one of color or texture of the one or more physical objects or the physical space.

### Claim 23 (depends on 21)

The method of claim 21, further comprising:
before receiving the image data or the depth sensor data from the device, receiving at least one of second image data or second depth sensor data about the one or more physical objects located in the physical space; and
storing, in the catalog of objects, the object data about the one or more physical objects and obtained from at least one of the second image data or the second depth sensor data.

### Claim 24 (depends on 23)

The method of claim 23, wherein identifying whether any of the one or more physical objects were impacted by the event includes comparing the image data to the catalog of objects to determine at least one of a first change in location of the one or more physical objects or a second change in color of the one or more physical objects.

### Claim 25 (depends on 23)

The method of claim 23, wherein identifying whether any of the one or more physical objects were impacted by the event includes comparing the depth sensor data to the catalog of objects storing the object data about the one or more physical objects to determine at least one of a first change in location of the one or more physical objects or a second change in texture of the one or more physical objects.

### Claim 26 (depends on 21)

The method of claim 21, wherein identifying whether any of the physical objects were impacted by the event comprises:
determining bounds of an area impacted by the event; and
determining which of the one or more physical objects were located within the bounds of the area impacted by the event.

### Claim 27 (depends on 26)

The method of claim 26, wherein the bounds are determined based at least in part on input received from a user interface.

### Claim 28 (depends on 26)

The method of claim 26, wherein the bounds are determined based at least in part on at least one of discontinuities in brightness, color, or texture represented by at least one of the image data or the depth sensor data.

### Claim 29 (depends on 26)

The method of claim 26, wherein assessing the impact of the event is based at least in part on which of the one or more physical objects were located within the bounds of the area impacted by the event.

### Claim 30 (depends on 21)

The method of claim 21, wherein assessing the impact of the event is based at least in part on which of the one or more physical objects were impacted by the event and at least one attribute associated with the one or more of the physical objects that were impacted.

### Claim 31

A system comprising:
one or more processors; and
one or more memory storing instructions that upon execution by the one or more processors, configure the system to:
receive, from a device, at least one of image data or depth sensor data about one or more physical objects located in a physical space;
determine whether an event occurred to the physical space where the one or more physical objects were located;
identify whether any of the one or more physical objects were impacted by the event by comparing at least the image data or the depth sensor data to a catalog of objects storing object data about the one or more physical objects;
assess an impact of the event based at least in part on the one or more physical objects that are identified as having been impacted by the event; and
cause an output indicating the impact of the event.

### Claim 32 (depends on 31)

The system of claim 31, wherein determining the event comprises using at least one of the image data or the depth sensor data to determine variances in at least one of color or texture of the one or more physical objects or the physical space.

### Claim 33 (depends on 31)

The system of claim 31, wherein, upon execution, the instructions further configure the system to:
before receiving the image data or the depth sensor data from the device, receive at least one of second image data or second depth sensor data about the one or more physical objects located in the physical space; and
store, in the catalog of objects, the object data about the one or more physical objects and obtained from at least one of the second image data or the second depth sensor data.

### Claim 34 (depends on 33)

The system of claim 33, wherein identifying whether any of the one or more physical objects were impacted by the event includes comparing the image data to the catalog of objects to determine at least one of a first change in location of the one or more physical objects or a second change in color of the one or more physical objects.

### Claim 35 (depends on 33)

The system of claim 33, wherein identifying whether any of the one or more physical objects were impacted by the event includes comparing the depth sensor data to the catalog of objects storing object data about the one or more physical objects to determine at least one of a first change in location of the one or more physical objects or a second change in texture of the one or more physical objects.

### Claim 36 (depends on 31)

The system of claim 31, wherein the instructions to identify whether any of the one or more physical objects were impacted by the event comprise instructions, upon execution by the one or more processors, that further configure the system to perform operations comprising:
determining bounds of an area impacted by the event; and
determining which of the one or more physical objects were located within the bounds of the area impacted by the event.

### Claim 37

One or more non-transitory computer-readable storage media storing instructions that upon execution on a system, cause the system to perform operations comprising:
receiving, from a device, at least one of image data or depth sensor data about one or more physical objects located in a physical space;
determining whether an event occurred to the physical space where the one or more physical objects were located;
identifying whether any of the one or more physical objects were impacted by the event by comparing at least the image data or the depth sensor data to a catalog of objects storing object data about the one or more physical objects;
assessing an impact of the event based at least in part on the one or more physical objects that are identified as having been impacted by the event; and
causing an output indicating the impact of the event.

### Claim 38 (depends on 37)

The one or more non-transitory computer-readable storage media of claim 37, wherein determining the event comprises using at least one of the image data or the depth sensor data to determine variances in at least one of color or texture of the one or more physical objects or the physical space.

### Claim 39 (depends on 37)

The one or more non-transitory computer-readable storage media of claim 37, wherein upon execution on the system, the instructions further cause the system to perform the operations comprising:
before receiving the image data or the depth sensor data from the device, receiving at least one of second image data or second depth sensor data about the one or more physical objects located in the physical space; and
storing, in the catalog of objects, the object data about the one or more physical objects and obtained from at least one of the second image data or the second depth sensor data.

### Claim 40 (depends on 37)

The one or more non-transitory computer-readable storage media of claim 37, wherein the output is caused to be presented by a user interface of a user device.
