# US 11,443,259 B2 · Automatic floor-level retail operation decisions using video analytics

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,443,259 B2
- Document ID: US11443259B2
- Status: Granted
- Kind: B2
- Application number: 16/055,131
- Filed: 2018-08-05
- Published: 2018-12-06
- Granted: 2022-09-13
- Earliest claimed: 2014-01-07
- Assignees: DoorDash, Inc.
- Applicants: DoorDash, Inc.
- Inventors: Lee A. Carbonell; Tsz S. Cheng; Jeffrey L. Edgington; Pandian Mariadoss
- Web page: https://patentgrep.com/patent/US11443259B2

## CPC

- G06Q 10/063118: {Staff planning in a project environment}
- G06Q 10/063119: {Staff planning or adjustment in a physical establishment based on arrival predictions or arrival tracking}
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A floor operations automation system can include an intelligent video module, profiles, decision rules, and a decision module. The intelligent video module can be configured to generate video analytics data from video captured by video cameras within a retail location. The profiles can contain data that represents a business practice or policy of the retail location and/or user-specified preferences for decision-related variables. The decision rules can express actions to be performed in response to predefined conditions within the retail location. The decision module can be configured to decide upon action to be performed, based upon the video analytics data, the profiles, and the decision rules. The decision can be made without direct input from a human agent of the retail location. The actions can affect a business system and/or a human agent associated with the retail location.

## Claims

### Claim 1

A computer-implemented method performed within a floor operations automation system having a plurality of video cameras mounted to a ceiling mounted track located within a physical site, comprising:
receiving, as an event and by the automation system, a request to verify stock of an item;
determining, using the event and a profile associated with the item, a location of the item within the physical site;
directing, using a track diagram of the ceiling-mounted track and a planogram of the physical site, one of the plurality of cameras towards the location of the item;
obtaining video analytics data pertaining to the location of the item;
analyzing the video analytics data to determine a number of the items at the location;
comparing the number of items to a minimum number of items indicated within the profile; and
forwarding, based upon the comparison, a time-stamped picture of the location to an initiator of the request to verify stock of the item.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
issuing, based upon the comparison and the profile, a restock notice.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
issuing, based upon the comparison, an out-of-stock notification to an initiator of the request to verify stock of the item.

### Claim 4

A floor operations automation system, comprising:
a plurality of video cameras mounted to a ceiling mounted track located within a physical site; and
a computer hardware system configured to perform:
receiving, as an event, a request to verify stock of an item;
determining, using the event and a profile associated with the item, a location of the item within the physical site;
directing, using a track diagram of the ceiling-mounted track and a planogram of the physical site, one of the plurality of cameras towards the location of the item;
obtaining video analytics data pertaining to the location of the item;
analyzing the video analytics data to determine a number of the items at the location;
comparing the number of items to a minimum number of items indicated within the profile; and
forwarding, based upon the comparison, a time-stamped picture of the location to an initiator of the request to verify stock of the item.

### Claim 5 (depends on 4)

The system of claim 4, wherein the computer hardware system is further configured to perform:
issuing, based upon the comparison and the profile, a restock notice.

### Claim 6 (depends on 4)

The system of claim 4, wherein the computer hardware system is further configured to perform:
issuing, based upon the comparison, an out-of-stock notification to an initiator of the request to verify stock of the item.

### Claim 7

A computer program product, comprising
a computer readable hardware storage device having computer usable program code embodied therewith,
the computer usable program code, which when executed by a floor operations automation system including a plurality of video cameras mounted to a ceiling mounted track located within a physical site; cause the floor operations automation system to perform:
receiving, as an event, a request to verify stock of an item;
determining, using the event and a profile associated with the item, a location of the item within the physical site;
directing, using a track diagram of the ceiling-mounted track and a planogram of the physical site, one of the plurality of cameras towards the location of the item;
obtaining video analytics data pertaining to the location of the item;
analyzing the video analytics data to determine a number of the items at the location;
comparing the number of items to a minimum number of items indicated within the profile; and
forwarding, based upon the comparison, a time-stamped picture of the location to an initiator of the request to verify stock of the item.

### Claim 8 (depends on 7)

The computer program product of claim 7, wherein the computer usable program code further causes the floor operations automation system to perform:
issuing, based upon the comparison and the profile, a restock notice.

### Claim 9 (depends on 7)

The computer program product of claim 7, wherein the computer usable program code further causes the floor operations automation system to perform:
issuing, based upon the comparison, an out-of-stock notification to an initiator of the request to verify stock of the item.
