System, apparatus and method of item location, list creation, routing, imaging and detection
AssigneeGhost House Technology, LLC
InventorsDavid Paul Stout, Ethan Michael Baird
Life of this patent
Estimating the term…
Abstract
A system for enabling in store routing of a user generated shopping list using existing store cameras and artificial intelligence and machine learning is provided. The system uses a pixelbuffer comparison of items imaged in real time to compared to a database of machine learned images. The system further provides item recognition and detection through machine learning so as to improve a shoppers experiences. The system and method further includes drone assistance means and radio signal item and biological detection so as to improve accuracy. Other features to improve guidance and accuracy include landmark navigation and masking to improve accuracy of item recognition and detection.
Claims56
A system for enabling in store routing of a user generated shopping list, the system comprising:
- a global positioning system, the global positioning system determining the location of the user so as to determine a specific store that the user is currently located at;
- a processor connecting to the SKU database of said specific store, said SKU database including product price, product location and product availability information;
- said processor determining a most efficient route based on location information exclusively from said specific store SKU database, each product categorized by aisle and/or location;
- and
- mapping location information on a predetermined store layout map using mapped points so as to determine the fastest route between said mapped points wherein each mapped point designates a specific product location.
A system allowing a user to check out at a store, the apparatus and system comprising:
- a processor;
- a kiosk in wireless communication with the processor, the processor in communication with a database of learned images, the kiosk having at least one camera, then at least one camera in communication with the database, said database continuously being updated based on prior transactions within;
- the processor comparing items physically present with said database of images to authenticate products during the checkout process, the processor storing product information in said database so as to improve accuracy and precision by way of machine learning.
A system for authenticating items gathered by a user in a store, the system comprising:
- at least one camera in a shopping location of a store, the camera capable of viewing a user and their surroundings in a frame in the shopping location of the store;
- the camera configured to detect a trained item that a user picks up in real-time, the camera only detecting the trained item wherein the trained item is a product with data stored in a database of images corresponding to said store;
- a processor in communication with the database of images, using machine learning the processor compares the trained item in real-time to the database of images to determine the specific product.
A system and method for authenticating an item during a checkout process, the system and method comprising:
- a database of images containing a plurality of database images, the database of images including multiple images of an individual item;
- at least one camera configured to take a checkout photo of an item during the checkout process to authenticate the item;
- and
- an authentication system configured to compare the checkout image to the database images to authenticate the item using pixelbuffer comparison;
- wherein the system is configured to store the checkout image into the database of images so that the checkout image becomes a database image thereby increasing the database of images to improve accuracy and precision by way of machine learning.
A system and method using artificial intelligence to recognize an item in a store using a mobile device camera, the method and system comprising:
- a database of images containing a plurality of database images, the database of images including multiple images of an individual item;
- the mobile device camera configured to view an image in real-time, a processor in communication with the database of images, the processor configured to compare the image in real-time to the plurality of database images to determine the item the user is pointing the mobile device camera at;
- and
- a system configured to allow a user to interact with a recognized item within the application wherein interaction function includes tap, voice, click, and/or gestures.
A bag configured to weigh items, the bag comprising:
- a holding portion configured to hold a product selected by a user while shopping;
- a weighing device configured to weigh items placed in the holding portion;
- an accelerometer configured to detect rotation or movement so as to prevent false readings;
- and
- wherein the bag and corresponding system is configured to zero out the weight reading after the user weighs a first item thereby allowing the user to weigh a second item in the same bag without having to remove the first item from the bag.
A drone assistance system for use in a store configured to assist a user while shopping, the drone assistance system comprising:
- a drone in communication with a mobile device of a user, the drone having light projection features;
- the drone in communication with a processor, the processor having the specific location of an item in a store;
- the drone is configured to receive item location from the processor after item location is requested from the user, the drone configured to find said item within a store and illuminate a single item within the store to indicate to the user the item's exact location.
A drone system comprising:
- a shelving unit having an uppermost shelf;
- a wireless charging pad configured to charge a drone, the wireless charging pad positioned on said uppermost shelf.
A system for item imaging, the system comprising:
- a radio transmitter configured to send signals that project onto desired objects or areas, the signals traveling through solid surfaces and creating a return signal when they interact with surfaces or objects that are received by a radio receiver;
- and
- a processor configured to interpret the signals received by the radio receiver so as to determine if there are additional items behind an object not viewable by a traditional camera.
A detection system comprising:
- an artificial intelligence program in communication with a processor and a radio transmitter, the radio transmitter configured to transmit signals onto an object or a being;
- a radio receiver configured to receive return waves from said radio transmitter, the processor configured to receive and interpret data received from the radio receiver, the processor in communication with the artificial intelligence program to interpret said data from said return waves;
- and
- the processor configured to determine a confidence threshold;
- if the confidence threshold is met, then the processor outputs said data in a predetermined desired format;
- if the confidence threshold is not met, then the radio transmitter sends a new signal to tighten said data.
A system for landmark navigation within a store, the system comprising:
- a mobile application on a mobile device, the mobile application having a user interface configured to allow the user to select a landmark navigation option;
- a processor configured to process a route based on the user's shopping list or based on a specific item the user is shopping for;
- a route matrix evaluating the distance between existing navigation points, if said distance meets or exceed a landmark requirement threshold, then the system inserts a landmark navigation point between qualifying navigation steps thereby informing the user that a specific product is located near a specific landmark.
A system for improving image processing, the system comprising:
- at least one depth sensing camera, the depth sensing camera finding a focal point within a frame;
- a processor configured to retrieve depth data from the corresponding area in the frame where the focal point is located, the processor configured to use said depth data to determine a background contained within the frame;
- the processor then placing a binary mask over said background so as to block out unnecessary imagery in the camera's field of view thereby improving accuracy.
A kiosk for use in a store, the kiosk comprising:
- a main body, the main body having at least one camera mounted thereto, the at least one camera configured to visually detect, by means of machine learning, user selected products in a store;
- a processor in communication with the kiosk, the processor in communication with the at least one camera;
- the processor using a pixelbuffer comparison between data previously known to data collected by the at least one camera;
- and
- the processor collecting and storing said data collected by the at least one camera so as to continuously improve accuracy of the system.
Dependencies are inferred from the claim text.