# US 2020/0401815 A1 · Computer vision with identification of common movement pathways within a space

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401815 A1
- Document ID: US20200401815A1
- Status: Published application
- Kind: A1
- Application number: 16/449,495
- Filed: 2019-06-24
- Published: 2020-12-24
- Earliest claimed: 2019-06-24
- Assignees: RoundhouseOne Inc.
- Applicants: RoundhouseOne Inc.
- Inventors: Mark Raymond Miller; Archana Ramachandran; Christopher C. Anderson
- Web page: https://patentgrep.com/patent/US20200401815A1

## CPC

- G06Q 30/0241: Advertisements
- G06V 20/53: {Recognition of crowd images, e.g. recognition of crowd congestion}
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/09: Supervised learning
- G06N 20/00: Machine learning
- G06T 7/248: {involving reference images or patches}
- G06N 3/045: Combinations of networks
- G06N 3/105: {Shells for specifying net layout}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20081: Training; Learning
- G06T 2207/30196: Human being; Person
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A computer vision system includes a camera that captures a plurality of image frames in a target field. A user interface is coupled to the camera. The user interface is configured to perform accelerated parallel computations in real-time on the plurality of image frames acquired by the camera. The system provides identification of common movement pathways within a space.

## Claims

### Claim 1

A computer vision system, comprising:
a camera that captures a plurality of image frames in a target field;
a processor coupled to the camera, the processor configured to receive the plurality of image frames and detect occupants in the space from the image frames, assign an ID for each of a person and a location of a person in a field of view, an input image or a series of input images are processed by the processor for occupant detection and location, and occupants visible in the image are assigned IDs and locations in the image frame;
a user interface that allows for the delineation and definition of a reference object including one or more of: shape, dimensions, and location in the image;
a server that calculates the dimensions of the actual space shown in the input image based on the reference object information, calculates distances between at least one of: detected occupants, and classifies each occupant as being within a delineated and defined area of interest; and
wherein the system provides identification of common movement pathways within a physical space.

### Claim 2 (depends on 1)

The system of claim 1, wherein a video feed captured by the camera and relayed to the processing unit for processing and automated analysis is not stored in the system.

### Claim 3 (depends on 1)

The system of claim 1, wherein images are processed in real time and data regarding the space and its occupants is extracted, and the next frames of the video overwrite those frames that were just processed.

### Claim 4 (depends on 1)

The system of claim 1, wherein only data extracted from each frame is stored locally and/or relayed to the system servers.

### Claim 5 (depends on 1)

The system of claim 1, wherein the space includes a plurality of grid square.

### Claim 6 (depends on 5)

The system of claim 5, wherein a number of pixels in each grid square can vary.

### Claim 7 (depends on 1)

The system of claim 1, wherein the system creates a model of the conditions of an establishment that is informed by historical data, and runs scenarios of known intervention options through the model to assess intervention options based on their cost, impact, and any other factors of interest to the establishment owner, when current conditions are observed by the system to be of interest or concern, the system generates an intervention recommendation for the establishment that is based on modeled outcomes, when a modeled intervention is employed, the system observes the impact of the intervention on the conditions, and if the observed impact is different than the modeled impact, the system updates the model based on the observed data.

### Claim 8 (depends on 7)

The system of claim 7, wherein an observed impact of the intervention is compared with a modeled impact of the action, and then updates the model.

### Claim 9 (depends on 8)

The system of claim 8, wherein the systems provide for a continual improvement to the model.

### Claim 10 (depends on 1)

The system of claim 1, wherein the system is configured to provide a recommendation that is model directed to at least one of: an interest; and concern of the establishment.

### Claim 11 (depends on 1)

The system of claim 1, wherein the system is configured to make one or more recommendations to a human.

### Claim 12 (depends on 11)

The system of claim 11, wherein the system is configured to provide a mechanism by which the human can take the one or more recommendations or other action.

### Claim 13 (depends on 12)

The system of claim 12, wherein the other action that is modeled to best address a condition of interest to an establishment.

### Claim 14 (depends on 1)

The system of claim 1, wherein the system measures at least one: conditions post an intervention; and action, and compares an observed result to the modeled result.

### Claim 15 (depends on 1)

The system of claim 1, wherein the system updates a model selected from at least one of: f machine learning and artificial intelligence.

### Claim 16 (depends on 1)

The system of claim 1, wherein the system is used with at least one establishment selected from: retail; the food industry; and the beverage industry.

### Claim 17 (depends on 1)

The system of claim 1, wherein the system is used relative to advertising costs of an establishment.

### Claim 18 (depends on 1)

The system of claim 1, wherein the system provides near real time information relative to an establishment's current occupancy and provides information selected from at least one of: the ratio of an establishment's customers to employees; the number of establishment customers compared to establishment inventory; and the number of people who are entering and/or exiting an establishment.

### Claim 19 (depends on 1)

The system of claim 1, wherein the system identifies a condition of interest with regard to occupant count, occupant activity, occupant location, occupant ratios, and/or some derivative or combination thereof and generates information summarizing the identified condition.

### Claim 20 (depends on 1)

The system of claim 1, wherein the system sends out an alert to an establishment describing the identified condition of interest e.g. that the establishment capacity has dropped below a target capacity.
