A vision system that is capable of computing the crowd densities, shopper movement speed and direction, and queue lengths at different locations in a shopping center makes recommendations for least-cost path through a set of destinations. Well-known person-counting techniques may be employed. One type of output display is a map display with an overlay an optimal route through a shopping venue.
Drawings
Claims21
A method for assisting a user in navigating a three-dimensional space with multiple destinations, comprising:
imaging at least two scenes of said destinations to produce first and second images;
calculating, from a result of said imaging, numbers of persons in said scenes and costs including crowd density depending thereon;
generating an output responsive to said costs.
A shopper information system, comprising:
a controller with an input adapted to receive video data responsive to multiple scenes of shoppers at a shopping venue, each scene being of a different respective physical three-dimensional location of said shopping venue;
said controller being programmed to calculate a current density of occupancy of said physical three-dimensional locations responsively to said video data;
said controller being further programmed to calculate and output an indication of an optimum route or next destination based on said current density of occupancy;
said controller being located for access by shoppers at said shopping venue.
1 more element
A method of providing navigation guidance to visitors of a shopping venue, comprising the steps of:
receiving input at a controller providing real-time data responsive to at least one of a three-dimensional density and rate of movement of shoppers at various locations of a shopping venue;
calculating at said controller a local variation in three-dimensional density or rate of movement of shoppers at said various locations;
recognizing in at least one of said various locations a queue and predicting a delay from a series of images of said queue;
outputting at a terminal, accessible to shoppers at said shopping venue, data indicating an optimal route responsively to said delay.
1 more element
A shopper information system, comprising:
a controller with an input adapted to receive video data responsive to multiple scenes of shoppers at a shopping venue, each scene being of a different respective three-dimensional physical location of said shopping venue;
said controller being programmed to a calculate a current density of occupancy of said three-dimensional physical locations responsively to said video data;
said controller being further programmed to calculate an indication of an optimum route or next destination based on said current density of occupancy;
said controller having a wireless output for outputting messages to wireless devices, said messages indicating said optimum route or next destination.
21 Oct 2021Estimated · howhide20 years from earliest known nonprovisional domestic filing plus recorded patent term adjustment, including 160 days of adjustment. Maintenance-fee lapses, terminal disclaimers and statutory extensions have not been checked. The continuity chain may be incomplete; this is not an enforceability determination.
#The invention relates to automated crowd pattern classification systems and also to systems that automatically detect movement of groups of people and route persons based on crowd pattern and movement.
#FIGS. 1A and 1B are perspective views of a public space such as an exhibit hall or shopping mall with video camera monitoring equipment and display terminals located throughout.
#FIG. 2 is a block diagram of a hardware environment for implementing an automated people monitoring system according to an embodiment of the invention.
#FIG. 3 is a block diagram of a hardware environment for implementing an automated people monitoring system according to another embodiment of the invention.
Detailed description3,543 words
#Referring to FIG. 1A, a space 101 where visitors 115 are gathered is monitored by cameras 100, each aimed at a respective portion (e.g., 130 and 140) of the space 101. The space 101 could be a trade show, shopping mall, an amusement park, an office, or any other space where people move and gather. Display terminals 150 are located throughout the space to permit the visitors 115 to obtain information derived from the video data gathered by the cameras 100, such as the shortest route to a destination or the area with the smallest crowds. Alternatively, this information may be provided to a remote terminal (not shown) or to a portable terminal 155.
#As illustrated in FIG. 1A, some areas of a venue, such as indicated at 130 may be more crowded than others, such as indicated at 140. The terminals, 150 and 155 may be programmed to permit users to enter requests for information, for example, to show a map of the space 101 indicating the crowd density by highlighting the map or overlaying with a suitable symbol or symbols. The user may make choices based on the feedback received and request navigation instructions. For example, the user could request the fastest route between retail stores or attractions, the least or most crowded attractions or areas, or the stores with the shortest lines. Armed with the requested information about the space 101 and navigation instructions, which may also be responsive to the requirements of the user the user can maximize his/her experience in the space 101 by avoiding crowds, moving quickly, attending the most popular attractions, or whatever the preferences indicate. Referring to FIG. 1B, in an alternative embodiment, a pan-tilt base 175 controls a zoom camera 170, the combination providing pan-tilt-zoom (PTZ) capability under control of a controller (not shown). In this embodiment, adequate information about the concentrations of visitors at the various locations is determined from a single camera vantage.
#Referring to FIG. 2, the infrastructure for providing the functionality, which will be described in greater detail below, may include one or more fixed and/or portable terminals 200 and 220, respectively. These may be connected to a classification engine and server 260 by wireless or wired data links. The classification engine and server 260 may be connected to one or more cameras 270 such as CCD cameras. The classification engine and server 260 may be connected to one or more other classification engines and servers 261 (with additional terminals and cameras) to share data with other locations or the system could be centralized with only one classification engine and server 260, with all cameras and terminals connected to it. The classification engine and server 260 receives raw video data from the one or more cameras 270 and uses it to generate a real time indicator of patterns, such as crowd density by region. This data is further utilized by a user interface process running on the classification engine and server 260 for selective display responsive to user commands on the terminals 200 and/or 220.