Back to results
US 12,008,665 B2Granted
Methods and system for sensor-based layout generation
AssigneeBlock, Inc.
InventorsArjun Mahanti, Matthew T. Kursmark, Brian Stegall
Life of this patent
Estimating the term…
Abstract
This disclosure describes, in part, techniques for enabling merchant devices to interoperate with one another in a more robust manner, such that overall operation and efficiency within a merchant establishment is improved. For instance, the techniques described herein may enable the intelligent routing of requests between devices within the merchant establishment based on real-time locations of the devices, which devices are associated with which orders, and the like.
Claims17
A method comprising:
- generating data of a physical establishment of a merchant using one or more LiDAR sensors of a merchant device;
- collecting, by the merchant device, an amount and a timing of a glare or reflection of at least one light emitted by the one or more LiDAR sensors;
- analyzing the data to identify at least a first surface and a second surface as possible seating areas within the physical establishment, wherein analyzing the data comprises identifying at least the first surface and the second surface within the physical establishment based on a level of glare or reflection calculated from the amount and the timing of the glare or reflection of the at least one light;
- determining, based at least in part on the amount and timing of the glare or reflection of the at least one light, one or more first coordinates of a first location of the first surface in the physical establishment and one or more second coordinates of a second location of the second surface in the physical establishment, wherein determining at least the first location and the second location comprises inputting the analyzed data to a first machine-trained model and receiving output of at least the first surface at the one or more first coordinates of the first location and the second surface at the one or more second coordinates of the second location, wherein the first machine-trained model is trained using historical data indicating at least one of size, flatness, or planar orientation of a plurality of items including seating areas;
- presenting, on a display of the merchant device of the merchant, a graphical user interface comprising a representation of at least a portion of the physical establishment overlaid with:
- (i) a first indication that the first surface has been identified at the one or more first coordinates of the first location, and (ii) a second indication that the second surface has been identified at the one or more second coordinates of the second location;
- receiving, via the graphical user interface, a first selection of the first surface, the first selection comprising a verification that the first surface represents a seating area;
- receiving, via the graphical user interface, a second selection of the second surface, the second selection comprising an indication that the second surface does not represent a seating area;
- generating, based at least in part on the first selection and the second selection, a representation of a current layout of the physical establishment including a representation of the seating area, wherein the representation of the current layout is generated based on the one or more first coordinates of the first location of the first surface and the one or more second coordinates of the second location of the second surface;
- presenting the representation of the current layout via the graphical user interface;
- based at least in part on inputting the representation of the current layout to a second machine-trained model, generating a representation of a suggested layout of seating areas in the physical establishment based on the one or more first coordinates of the first location of the first surface and the one or more second coordinates of the second location of the second surface, the representation of the suggested layout indicating that the first surface is a seating area at the first location, wherein the suggested layout represents at least a change in quantity or arrangement of seating areas;
- and
- presenting the representation of the suggested layout on the display of the merchant device.
10 more elements
A method comprising:
- receiving data from a device in an environment, wherein the device comprises one or more LiDAR sensors, wherein the data includes an amount and a timing of a glare or reflection of at least one light emitted by the one or more LiDAR sensors;
- analyzing the data to identify a first surface as a possible seating area within the environment, wherein analyzing the data comprises identifying the first surface within the environment based on a level of glare or reflection calculated from the amount and the timing of the glare or reflection of the at least one light;
- determining, based at least in part on the amount and timing of the glare or reflection of the at least one light, one or more first coordinates of a first location associated with the first surface in the environment, wherein determining one or more first coordinates of the first location comprises inputting the analyzed data into a first machine-trained model and receiving output of at least the first surface at the one or more first coordinates of the first location, wherein the first machine-trained model is trained using historical data indicating at least one of size, flatness, or planar orientation of a plurality of items including seating areas;
- generating a user interface (UI) indicating the first surface, the UI comprising a representation of at least a portion of the environment overlaid with a first indication that the first surface has been identified at the one or more first coordinates of the first location;
- sending the UI to the device;
- receiving, from the device and via the UI, a selection of the first surface comprising a verification that the first surface represents a seating area in the environment;
- generating, based at least in part on the selection, a representation of a current layout of the environment including a representation of the seating area, wherein the representation of the current layout is generated based on the one or more first coordinates of the first location of the first surface;
- based at least in part on inputting the representation of the current layout to a second machine-trained model, generating a representation of a suggested layout of seating areas in the environment based on the one or more first coordinates of the first location of the first surface;
- and
- sending the representation of the suggested layout to the device for display on the device.
7 more elements
A system comprising:
- one or more processors;
- and
- one or more computer-readable media storing computer-executable instructions that, when executed, cause the one or more processors to perform acts comprising:
- receiving data from a device in an environment, wherein the device comprises one or more LiDAR sensors, wherein the data includes an amount and a timing of a glare or reflection of at least one light emitted by the one or more LiDAR sensors;
- analyzing the data to identify a first surface as a possible seating area within the environment, wherein analyzing the data comprises identifying the first surface within the environment based on a level of glare or reflection calculated from the amount and the timing of the glare or reflection of the at least one light;
- determining, based at least in part on the amount and timing of the glare or reflection of the at least one light, one or more first coordinates of a first location associated with the first surface in the environment, wherein determining one or more first coordinates of the first location comprises inputting the analyzed data into a first machine-trained model and receiving output of at least the first surface at the one or more first coordinates of the first location, wherein the first machine-trained model is trained using historical data indicating at least one of size, flatness, or planar orientation of a plurality of items including seating areas;
- generating a user interface (UI) indicating the first surface, the UI comprising a representation of at least a portion of the environment overlaid with a first indication that the first surface has been identified at the one or more first coordinates of the first location;
- sending the UI to the device;
- receiving, from the device and via the UI, a selection of the first surface comprising a verification that the first surface represents a seating area in the environment;
- generating, based at least in part on the selection, a representation of a current layout of the environment including a representation of the seating area, wherein the representation of the current layout is generated based on the one or more first coordinates of the first location of the first surface;
- based at least in part on inputting the representation of the current layout to a second machine-trained model, generating a representation of a suggested layout of seating areas in the environment based on the one or more first coordinates of the first location of the first surface;
- and
- sending the representation of the suggested layout to the device for display on the device.
10 more elements
Dependencies are inferred from the claim text.