# US 2024/0403940 A1 · Systems and methods for commercial inventory mapping including a lidar-based virtual map

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0403940 A1
- Document ID: US20240403940A1
- Status: Published application
- Kind: A1
- Application number: 18/804,506
- Filed: 2024-08-14
- Published: 2024-12-05
- Earliest claimed: 2020-04-27
- Assignees: State Farm Mutual Automobile Insurance Company
- Applicants: State Farm Mutual Automobile Insurance Company
- Inventors: Nicholas Carmelo Marotta; Laura Kennedy; JD Johnson Willingham
- Web page: https://patentgrep.com/patent/US20240403940A1

## CPC

- G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders
- G06V 20/653: {by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces}
- B64C 39/024: {of the remote controlled vehicle type, i.e. RPV}
- G01C 21/206: {specially adapted for indoor navigation}
- G01C 21/343: {Calculating itineraries (travelling salesman problem G06Q10/04; optimisation of routes G06Q10/047)}
- G01C 21/3446: {Details of route searching algorithms, e.g. Dijkstra, A*, arc-flags or using precalculated routes}
- G01S 7/4802: {using analysis of echo signal for target characterisation; Target signature; Target cross-section}
- G01S 7/4808: {Evaluating distance, position or velocity data}
- G01S 7/51: Display arrangements
- G01S 17/06: Systems determining position data of a target
- G01S 17/89: for mapping or imaging
- G01S 17/894: Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
- G01S 19/45: by combining measurements of signals from the satellite radio beacon positioning system with a supplementary measurement
- G02B 27/0172: {characterised by optical features}
- G06F 18/24: Classification techniques
- G06F 30/13: Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
- G06K 7/1413: {1D bar codes}
- G06K 7/1417: {2D bar codes}
- G06K 7/1447: {extracting optical codes from image or text carrying said optical code}
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/08: Learning methods
- G06Q 10/08743: {using optimisation of routes}
- G06Q 10/0877: {by inventory control or reporting using inventory tracking or counting}
- G06Q 20/085: {involving remote charge determination or related payment systems}
- G06Q 20/12: specially adapted for electronic shopping systems
- G06Q 30/0601: Electronic shopping [e-shopping]
- G06Q 30/0633: {Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087)}
- G06Q 30/0639: {Locating goods or services, e.g. based on physical position of the goods or services within a shopping facility}
- G06T 7/60: Analysis of geometric attributes
- G06T 7/75: {involving models}
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 17/05: Geographic models
- G06T 19/003: {Navigation within 3D models or images}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06V 10/82: using neural networks
- G06V 20/17: taken from planes or by drones
- G06V 20/20: in augmented reality scenes
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- B64U 2101/30: for imaging, photography or videography
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G06F 16/29: Geographical information databases
- G06N 3/049: Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
- G06N 5/04: Inference or reasoning models
- G06N 20/00: Machine learning
- G06T 7/90: Determination of colour characteristics
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/10044: Radar image
- G06T 2207/30184: Infrastructure
- G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes
- H04W 84/18: Self-organising networks, e.g. ad-hoc networks or sensor networks
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B64C: AEROPLANES; HELICOPTERS
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

The following relates generally to light detection and ranging (LIDAR) and artificial intelligence (AI). In some embodiments, a system: receives light detection and ranging (LIDAR) data generated from a LIDAR camera via wireless communication or data transmission over one or more radio frequency links, the LIDAR data associated with a store or a store layout; generates a LIDAR-based virtual map of the store from processor analysis of the LIDAR data; determines locations of individual goods in the store; overlays the locations of the individual goods onto the LIDAR-based virtual map; and generates an updated LIDAR-based virtual map of the store displaying aisles of the store and the overlaid locations of the individual goods within the store.

## Claims

### Claim 1

A computer-implemented method for commercial inventory mapping, the method comprising, via one or more local or remote processors, sensors, servers, light detection and ranging (LIDAR) devices, and/or transceivers:
receiving LIDAR data generated from a LIDAR camera, the LIDAR data associated with a store or a store layout;
generating a LIDAR-based virtual map of the store from processor analysis of the LIDAR data;
determining locations of individual goods in the store;
overlaying the locations of the individual goods onto the LIDAR-based virtual map;
generating an updated LIDAR-based virtual map of the store displaying aisles of the store and the overlaid locations of the individual goods within the store;
receiving, from a customer, a purchase order of an item; and
in response to receiving the purchase order of the item, blocking an additional order of the item from another customer.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, the method further comprising, via the one or more local or remote processors, sensors, servers, LIDAR devices, and/or transceivers:
overlaying customer flow through the store on top of the updated LIDAR-based virtual map; and
displaying the updated LIDAR-based virtual map including the overlaid customer flow though the store on a mobile device of the customer.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, the method further comprising, via the one or more local or remote processors, sensors, servers, LIDAR devices, and/or transceivers:
receiving a virtual or electronic customer list for items to be purchased from an App installed on a customer mobile device via one or more radio frequency links, and/or via wireless communication or data transmission.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, the method further comprising, via the one or more local or remote processors, sensors, servers, LIDAR devices, and/or transceivers:
verifying that one or more of the items on the virtual or electronic customer list of items will be available for purchase when the customer arrives at the store at a subsequent hour by comparing the virtual or electronic customer list of items with current electronic orders received from other customers.

### Claim 5 (depends on 3)

The computer-implemented method of claim 3, the method further comprising, via the one or more local or remote processors, sensors, servers, LIDAR devices, and/or transceivers:
generating a virtual route through the store on top of the updated LIDAR-based virtual map that displays locations of items on the virtual or electronic customer list of items received from the customer's mobile device; and
displaying the virtual route on top of the updated LIDAR-based virtual map of store so as to depict the route for a customer or employee to travel though the store, and pick up items with a displayed location.

### Claim 6 (depends on 3)

The computer-implemented method of claim 3, the method further comprising, via the one or more local or remote processors, sensors, servers, LIDAR devices, and/or transceivers:
further updating the updated LIDAR-based virtual map to depict a route through the store for the customer or an employee to pick up one or more items on the virtual or electronic customer list.

### Claim 7 (depends on 3)

The computer-implemented method of claim 3, the method further comprising, via the one or more local or remote processors, sensors, servers, LIDAR devices, and/or transceivers:
further updating the updated LIDAR-based virtual map to depict a route through the store for the customer or an employee to pick up one or more items on the virtual or electronic customer list, and displaying the route on top of the updated LIDAR-based virtual map of the store on a mobile device, wherein: (i) the route is highlighted and reflects a pre-determined customer flow through the store, and (ii) icons representing aisle or other locations of items on the virtual or electronic customer list are virtually depicted.

### Claim 8

A computer system configured for commercial inventory mapping, the computer system comprising one or more local or remote processors, sensors, servers, LIDAR devices, and/or transceivers configured to:
receive light detection and ranging (LIDAR) data generated from a LIDAR camera via wireless communication or data transmission over one or more radio frequency links, the LIDAR data associated with a store or a store layout;
generate a LIDAR-based virtual map of the store from processor analysis of the LIDAR data;
determine locations of individual goods in the store;
overlay the locations of the individual goods onto the LIDAR-based virtual map;
generate an updated LIDAR-based virtual map of the store displaying aisles of the store and the overlaid locations of the individual goods within the store;
receive, from a customer, a purchase order of an item; and
in response to receiving the purchase order of the item, bock an additional order of the item from another customer.

### Claim 9 (depends on 8)

The computer system of claim 8, the computer system and/or the one or more local or remote processors, sensors, servers, LIDAR devices, and/or transceivers further configured to:
overlay customer flow through the store on top of the updated LIDAR-based virtual map; and
display the updated LIDAR-based virtual map including the overlaid customer flow though the store on a mobile device of the customer or an employee.

### Claim 10 (depends on 8)

The computer system of claim 8, the computer system and/or the one or more local or remote processors, sensors, servers, LIDAR devices, and/or transceivers further configured to:
receive a virtual or electronic customer list for items to be purchased from an App installed on a customer mobile device via one or more radio frequency links, and/or via wireless communication or data transmission.

### Claim 11 (depends on 10)

The computer system of claim 10, the computer system and/or the one or more local or remote processors, sensors, servers, LIDAR devices, and/or transceivers further configured to:
verify that one or more of the items on the virtual or electronic customer list of items will be available for purchase when the customer arrives at the store at a subsequent hour by comparing the virtual or electronic list of items with current electronic orders received from other customers.

### Claim 12 (depends on 10)

The computer system of claim 10, the computer system and/or the one or more local or remote processors, sensors, servers, LIDAR devices, and/or transceivers further configured to:
generate a virtual route through the store on top of the updated LIDAR-based virtual map that displays locations of items on the virtual or electronic customer list of items received from the customer's mobile device; and
display the virtual route on top of the updated LIDAR-based virtual map of store so as to depict the route for a customer or employee to travel though the store, and pick up items with a displayed location.

### Claim 13 (depends on 10)

The computer system of claim 10, the computer system and/or the one or more local or remote processors, sensors, servers, LIDAR devices, and/or transceivers further configured to:
update the updated LIDAR-based virtual map to depict a route through the store for the customer or an employee to pick up one or more items on the virtual or electronic customer list.

### Claim 14 (depends on 10)

The computer system of claim 10, the computer system and/or the one or more local or remote processors, sensors, servers, LIDAR devices, and/or transceivers further configured to:
update the updated LIDAR-based virtual map to depict a route through the store for the customer or an employee to pick up one or more items on the virtual or electronic customer list, and display the route on top of the updated LIDAR-based virtual map of the store on a mobile device, wherein: (i) the route is highlighted and reflects a pre-determined customer flow through the store, and (ii) icons representing aisle or other locations of items on the virtual or electronic customer list are virtually depicted.

### Claim 15

A computer system configured for commercial inventory mapping, comprising:
one or more processors; and
a program memory coupled to the one or more processors and storing executable instructions that, when executed by the one or more processors, cause the computer system to:
receive light detection and ranging (LIDAR) data generated from a LIDAR camera via wireless communication or data transmission over one or more radio frequency links, the LIDAR data associated with a store or a store layout;
generate a LIDAR-based virtual map of the store from processor analysis of the LIDAR data;
determine locations of individual goods in the store;
overlay the locations of the individual goods onto the LIDAR-based virtual map;
generate an updated LIDAR-based virtual map of the store displaying aisles of the store and the overlaid locations of the individual goods within the store;
receive, from a customer, a purchase order of an item; and
in response to receiving the purchase order of the item, bock an additional order of the item from another customer.

### Claim 16 (depends on 15)

The computer system of claim 15, wherein the executable instructions, when executed, further cause the computer system to:
overlay customer flow through the store on top of the updated LIDAR-based virtual map; and
display the updated LIDAR-based virtual map including the overlaid customer flow though the store on a mobile device of the customer or an employee.

### Claim 17 (depends on 15)

The computer system of claim 15, wherein the executable instructions, when executed, further cause the computer system to:
receive a virtual or electronic customer list for items to be purchased from an App installed on a customer mobile device via one or more radio frequency links, and/or via wireless communication or data transmission.

### Claim 18 (depends on 17)

The computer system of claim 17, wherein the executable instructions, when executed, further cause the computer system to:
update the updated LIDAR-based virtual map to depict a route through the store for the customer or an employee to pick up one or more items on the virtual or electronic customer list.

### Claim 19 (depends on 17)

The computer system of claim 17, wherein the executable instructions, when executed, further cause the computer system to:
update the updated LIDAR-based virtual map to depict a route through the store for the customer or an employee to pick up one or more items on the virtual or electronic customer list, and display the route on top of the updated LIDAR-based virtual map of the store on a mobile device, wherein: (i) the route is highlighted and reflects a pre-determined customer flow through the store, and (ii) icons representing aisle or other locations of items on the virtual or electronic customer list are virtually depicted.

### Claim 20 (depends on 17)

The computer system of claim 17, wherein the executable instructions, when executed, further cause the computer system to:
receive confirmation that items of the virtual or electronic customer list have been picked up or delivered;
charge a virtual pay account for the picked up or delivered items; and
receive payment for the picked up or delivered items from the virtual pay account.
