System having a bar of relocatable distance sensors that detect stock changes in a storage area

#One or more embodiments of the invention are related to the fields of image analysis, artificial intelligence, automation, camera calibration, camera placement optimization and computer interaction with a point of sale system. More particularly, but not by way of limitation, one or more embodiments of the invention enable a camera-based system that analyzes images from multiple cameras to track items in an autonomous store, such as products on store shelves, and to determine which items shoppers have taken, moved, or replaced. One or more embodiments utilizes quantity sensors that measure or infer a quantity of a product in combination with image analysis to increase accuracy of attribution of items with shoppers. In one or more embodiments, the quantity sensors may be relocatable distance sensors integrated into a bar of distance sensors that may be installed behind a shelf. Image analysis may also be used to infer the type of a product based on the visual appearance.

#Previous systems involving security cameras have had relatively limited people tracking, counting, loiter detection and object tampering analytics. These systems employ relatively simple algorithms that have been utilized in cameras and NVRs (network video recorders).

#Other systems such as retail analytics solutions utilize additional cameras and sensors in retail spaces to track people in relatively simple ways, typically involving counting and loiter detection.

#The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.

#The above and other aspects, features and advantages of the invention will be more apparent from the following more particular description thereof, presented in conjunction with the following drawings wherein:

#FIG. 1 illustrates operation of an embodiment of the invention that analyzes images from cameras in a store to detect that a person has removed a product from a shelf.

#A bar of relocatable distance sensors that detect stock changes in a storage area, as used for example in an autonomous store system that tracks shoppers and items, will now be described. Embodiments may track a person by analyzing camera images and may therefore extend an authorization obtained by this person at one point in time and space to a different point in time or space. Embodiments may also enable an autonomous store system that analyzes camera images to track people and their interactions with items and may also enable camera calibration, optimal camera placement and computer interaction with a point of sale system. The computer interaction may involve a mobile device and a point of sale system for example. Camera images of a shelf may be combined with other sensor data, for example from distance sensors in a bar located behind a shelf, to track stock changes on the shelf. In the following exemplary description, numerous specific details are set forth in order to provide a more thorough understanding of embodiments of the invention. It will be apparent, however, to an artisan of ordinary skill that the present invention may be practiced without incorporating all aspects of the specific details described herein. In other instances, specific features, quantities, or measurements well known to those of ordinary skill in the art have not been described in detail so as not to obscure the invention. Readers should note that although examples of the invention are set forth herein, the claims and the full scope of any equivalents, are what define the metes and bounds of the invention.

#FIG. 1 shows an embodiment of an automated store. A store may be any location, building, room, area, region, or site in which items of any kind are located, stored, sold, or displayed, or through which people move. For example, without limitation, a store may be a retail store, a warehouse, a museum, a gallery, a mall, a display room, an educational facility, a public area, a lobby, an office, a home, an apartment, a dormitory, or a hospital or other health facility. Items located in the store may be of any type, including but not limited to products that are for sale or rent.

#In the illustrative embodiment shown in FIG. 1, store 101 has an item storage area 102, which in this example is a shelf. Item storage areas may be of any type, size, shape and location. They may be of fixed dimensions or they may be of variable size, shape, or location. Item storage areas may include for example, without limitation, shelves, bins, floors, racks, refrigerators, freezers, closets, hangers, carts, containers, boards, hooks, or dispensers. In the example of FIG. 1, items 111, 112, 113 and 114 are located on item storage area 102. Cameras 121 and 122 are located in the store and they are positioned to observe all or portions of the store and the item storage area. Images from the cameras are analyzed to determine the presence and actions of people in the store, such as person 103 and in particular to determine the interactions of these people with items 111-114 in the store. In one or more embodiments, camera images may be the only input required or used to track people and their interactions with items. In one or more embodiments, camera image data may be augmented with other information to track people and their interactions with items. One or more embodiments of the system may utilize images to track people and their interactions with items for example without the use of any identification tags, such as RFID tags or any other non-image based identifiers associated with each item.