# US 2021/0334538 A1 · Systems and methods for a 3d model for viewing potential placement of an object

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0334538 A1
- Document ID: US20210334538A1
- Status: Published application
- Kind: A1
- Application number: 17/240,993
- Filed: 2021-04-26
- Published: 2021-10-28
- Earliest claimed: 2020-04-27
- Assignees: State Farm Mutual Automobile Insurance Company
- Applicants: State Farm Mutual Automobile Insurance Company
- Inventors: Nicholas Carmelo Marotta; Laura Kennedy; JD Johnson Willingham
- Web page: https://patentgrep.com/patent/US20210334538A1

## CPC

- G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders
- G06V 20/653: {by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces}
- B64C 39/024: {of the remote controlled vehicle type, i.e. RPV}
- G01C 21/206: {specially adapted for indoor navigation}
- G01C 21/343: {Calculating itineraries (travelling salesman problem G06Q10/04; optimisation of routes G06Q10/047)}
- G01C 21/3446: {Details of route searching algorithms, e.g. Dijkstra, A*, arc-flags or using precalculated routes}
- G01S 7/4802: {using analysis of echo signal for target characterisation; Target signature; Target cross-section}
- G01S 7/4808: {Evaluating distance, position or velocity data}
- G01S 7/51: Display arrangements
- G01S 17/06: Systems determining position data of a target
- G01S 17/89: for mapping or imaging
- G01S 17/894: Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
- G01S 19/45: by combining measurements of signals from the satellite radio beacon positioning system with a supplementary measurement
- G02B 27/0172: {characterised by optical features}
- G06F 18/24: Classification techniques
- G06F 30/13: Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
- G06K 7/1413: {1D bar codes}
- G06K 7/1417: {2D bar codes}
- G06K 7/1447: {extracting optical codes from image or text carrying said optical code}
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/08: Learning methods
- G06Q 10/08743: {using optimisation of routes}
- G06Q 10/0877: {by inventory control or reporting using inventory tracking or counting}
- G06Q 20/085: {involving remote charge determination or related payment systems}
- G06Q 20/12: specially adapted for electronic shopping systems
- G06Q 30/0601: Electronic shopping [e-shopping]
- G06Q 30/0633: {Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087)}
- G06Q 30/0639: {Locating goods or services, e.g. based on physical position of the goods or services within a shopping facility}
- G06T 7/60: Analysis of geometric attributes
- G06T 7/75: {involving models}
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 17/05: Geographic models
- G06T 19/003: {Navigation within 3D models or images}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06V 10/82: using neural networks
- G06V 20/17: taken from planes or by drones
- G06V 20/20: in augmented reality scenes
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- B64U 2101/30: for imaging, photography or videography
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G06F 16/29: Geographical information databases
- G06N 3/049: Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
- G06N 5/04: Inference or reasoning models
- G06N 20/00: Machine learning
- G06T 7/90: Determination of colour characteristics
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/10044: Radar image
- G06T 2207/30184: Infrastructure
- G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes
- H04W 84/18: Self-organising networks, e.g. ad-hoc networks or sensor networks
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B64C: AEROPLANES; HELICOPTERS
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

The following relates generally to light detection and ranging (LIDAR) and artificial intelligence (AI). In some embodiments, a system: measures dimensional data of each object of the plurality of objects based upon processor analysis of received LIDAR data; presents, to a user, a list of objects of the plurality of objects; receives, from the user, a selection from the list of objects; and displays the 3D model of the room with a representation of the selected object.

## Claims

### Claim 1

A computer-implemented method for viewing potential placement of an object, the method comprising, via one or more processors, sensors, servers, and/or transceivers:
receiving light detection and ranging (LIDAR) data generated from a LIDAR camera;
measuring a plurality of dimensions of the object based upon processor analysis of the LIDAR data;
receiving or generating a 3D model of a room, the 3D model of the room including dimensional data of the room;
inserting a representation of the object into the 3D model of the room based upon processor analysis of: (i) the plurality of dimensions of the object measured from the LIDAR data; and (ii) the dimensional data of the room; and
displaying the 3D model of the room with the inserted representation of the object.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the object comprises a piece of furniture comprising one of:
(1) a chair;
(2) a couch;
(3) a table;
(4) a desk; and/or
(5) a lamp.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the object comprises an appliance comprising one of:
(1) a refrigerator;
(2) a stove;
(3) a microwave;
(4) a dishwasher;
(5) an air fryer;
(6) a laundry machine; or
(7) a dryer.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the displaying of the 3D model of the room with the inserted representation of the object comprises displaying the 3D model of the room with the inserted representation of the object on a pair of glasses.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein:
the object is a first object, and the LIDAR data is first LIDAR data; and
the computer-implemented further comprises, via the one or more processors, transceivers, sensors, and/or servers:
receiving second LIDAR data generated from the LIDAR camera;
measuring a plurality of dimensions of a second object based upon processor analysis of the second LIDAR data; and
replacing the representation of the first object with a representation of the second object in the 3D model of the room.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the displaying of the 3D model of the room with the inserted object comprises displaying a price of the object.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, further comprising, via the one or more processors, transceivers, sensors, and/or servers:
determining that it is not possible to bring the object into the room based upon processor analysis of: (i) dimensional data of a door of the room, and (ii) the plurality of dimensions of the object measured from the LIDAR data;
wherein the displaying of the 3D model of the room with the inserted representation of the object further comprises displaying a warning indicating that it is not possible to bring the object into the room.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein the object is an object of a plurality of objects, and the computer-implemented method further comprises, via the one or more processors, transceivers, sensors, and/or servers:
measuring dimensional data of each object of the plurality of objects based upon processor analysis of received LIDAR data;
presenting, to a user, a list of objects of the plurality of objects, the list including a price of each object of the plurality of objects;
receiving, from the user, a selection from the list of objects; and
displaying the 3D model of the room with a representation of the selected object.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein:
the measured plurality of dimensions includes a measured height and width of an object; and
the displaying the representation of the 3D model further comprises overlaying numerical values of the height and width of the object onto the representation of the object in the displayed 3D model.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, further comprising, via the one or more processors, transceivers, sensors, and/or servers:
receiving camera data including color data and transparency data of the object;
wherein the representation of the object is built based upon the color data and the transparency data of the object.

### Claim 11 (depends on 1)

The computer-implemented method of claim 1, further comprising, via the one or more processors, transceivers, sensors, and/or servers:
changing a placement of the inserted representation of the object in the 3D model based upon a command from a user.

### Claim 12

A computer system configured to display a potential placement of an object, the computer system comprising one or more processors, sensors, servers, and/or transceivers configured to:
receive light detection and ranging (LIDAR) data generated from a LIDAR camera;
measure a plurality of dimensions of the object based upon processor analysis of the LIDAR data;
receive or generate a 3D model of a room, the 3D model of the room including dimensional data of the room;
insert a representation of the object into the 3D model of the room based upon processor analysis of: (i) the plurality of dimensions of the object measured from the LIDAR data; and (ii) the dimensional data of the room; and
display the 3D model of the room with the inserted representation of the object.

### Claim 13 (depends on 12)

The computer system of claim 12, further configured to, via the one or more processors, sensors, servers, and/or transceivers:
display, on a pair of glasses, the 3D model of the room with the inserted representation of the object.

### Claim 14 (depends on 12)

The computer system of claim 12, further configured to, via the one or more processors, sensors, servers, and/or transceivers:
display a price of the object when displaying the 3D model.

### Claim 15 (depends on 12)

The computer system of claim 12, wherein the object is an object of a plurality of objects, and wherein the computer system is further configured to, via the one or more processors, sensors, servers, and/or transceivers:
measure dimensional data of each object of the plurality of objects based upon processor analysis of received LIDAR data;
present, to a user, a list of objects of the plurality of objects;
receive, from the user, a selection from the list of objects; and
display the 3D model of the room with a representation of the selected object.

### Claim 16 (depends on 12)

The computer system of claim 12, wherein:
the measured plurality of dimensions includes a measured height and width of an object; and
the computer system is further configured to, via the one or more processors, sensors, servers, and/or transceivers, display the representation of the 3D model by overlaying numerical values of the height and width of the object onto the representation of the object in the displayed 3D model.

### Claim 17

A computer system configured to display a potential placement of an object, comprising:
one or more processors; and
a program memory coupled to the one or more processors and storing executable instructions that when executed by the one or more processors cause the computer system to:
receive light detection and ranging (LIDAR) data generated from a LIDAR camera;
measure a plurality of dimensions of the object based upon processor analysis of the LIDAR data;
receive or generate a 3D model of a room, the 3D model of the room including dimensional data of the room;
insert a representation of the object into the 3D model of the room based upon processor analysis of: (i) the plurality of dimensions of the object measured from the LIDAR data; and (ii) the dimensional data of the room; and
display the 3D model of the room with the inserted representation of the object.

### Claim 18 (depends on 17)

The computer system of claim 17, further comprising computerized glasses;
wherein the executable instructions further cause the computer system to display the 3D model of the room with the inserted representation of the object on the computerized glasses.

### Claim 19 (depends on 17)

The computer system of claim 17, wherein the executable instructions further cause the computer system to:
display a price of the object when displaying the 3D model.

### Claim 20 (depends on 17)

The computer system of claim 17, wherein the object is an object of a plurality of objects, and wherein the executable instructions further cause the computer system to:
measure dimensional data of each object of the plurality of objects based upon processor analysis of received LIDAR data;
present, to a user, a list of objects of the plurality of objects;
receive, from the user, a selection from the list of objects; and
display the 3D model of the room with a representation of the selected object.
