# US 2016/0259980 A1 · Systems and methodologies for performing intelligent perception based real-time counting

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0259980 A1
- Document ID: US20160259980A1
- Status: Published application
- Kind: A1
- Application number: 15/060,173
- Filed: 2016-03-03
- Published: 2016-09-08
- Earliest claimed: 2015-03-03
- Assignees: Umm Al-Qura University
- Applicants: Umm Al-Qura University
- Inventors: Ehab MLYBARI; AbdelRahman Hedar; Gamal Elsayed; Esam Yosry; Alaa E. Abdelhakim; Moussa Elbissy; Amr Gadelrab
- Web page: https://patentgrep.com/patent/US20160259980A1

## CPC

- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/277: involving stochastic approaches, e.g. using Kalman filters
- G06V 20/53: {Recognition of crowd images, e.g. recognition of crowd congestion}
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30196: Human being; Person
- G06T 2207/30242: Counting objects in image
- G06V 10/454: {Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems and methods are provided for people counting. The method includes acquiring video data from one or more sensors and learning parameters associated with the one or more sensors. The method further includes detecting one or more objects and extracting learned features from each of the one or more objects. The learned features are identified based on the learning parameters. The method further include detecting, using the processing circuitry and based on the learned features, one or more individuals from the one or more objects. Then, the one or more individuals are tracked based on a filter. The method further includes updating a people counter as a function of a position of each tracked individual.

## Claims

### Claim 1

A method comprising:
acquiring video data from one or more sensors;
acquiring learning parameters associated with the one or more sensors, wherein the learning parameters are previously generated;
detecting, using processing circuitry, one or more objects;
extracting, using the processing circuitry, learned features from each of the one or more objects, wherein the learned features are identified based on the learning parameters;
detecting, using the processing circuitry and based on the learned features, one or more individuals from the one or more objects;
tracking, using the processing circuitry and based on a filter, the one or more individuals; and
updating, using the processing circuitry, a people counter as a function of a position of each tracked individual.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
acquiring one or more videos from a sensor;
identifying a set from the one or more videos, wherein the set includes videos representing extrema levels of crowdedness;
subtracting a background to detect one or more moving objects;
extracting features from the one or more moving objects;
applying a people learning process to determine the learning parameters associated with the sensor; and
storing the learning parameters.

### Claim 3 (depends on 2)

The method of claim 2, wherein extracting the features is a function of a hybrid technique.

### Claim 4 (depends on 3)

The method of claim 3, wherein the hybrid technique includes at least one of a granular computing process and a deep learning and meta-heuristics process.

### Claim 5 (depends on 2)

The method of claim 2, further comprising:
determining whether a predetermined condition is met; and
repeating the extracting and applying steps until the predetermined condition is met.

### Claim 6 (depends on 5)

The method of claim 5, wherein determining whether the predetermined condition is met includes comparing a learning rate with a predetermined learning rate.

### Claim 7 (depends on 2)

The method of claim 2, wherein the people learning process is based on a convolutional neural network.

### Claim 8 (depends on 2)

The method of claim 2, wherein the set includes videos of individuals with predetermined wear.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
applying a multiclass regression model to detect predetermined categories of the one or more individuals.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
defining a virtual line in a field of view of the video data;
determining a movement direction of each tracked individual; and
updating the people counter as a function of the virtual line and the movement direction of each tracked individual.

### Claim 11 (depends on 1)

The method of claim 1, wherein the learning features are acquired based on metadata information received with the video data and wherein the metadata indicates a unique sensor identifier of the one or more sensors.

### Claim 12 (depends on 1)

The method of claim 1, wherein the crowd includes individuals with predetermined wear.

### Claim 13 (depends on 1)

The method of claim 1, wherein the learned features include features associated with Muslim wear.

### Claim 14 (depends on 1)

The method of claim 1, wherein the learning parameters are associated with predetermined times.

### Claim 15

A system for people counting, the system comprising:
one or more sensors; and
processing circuitry configured to
acquire video data from the one or more sensors,
acquire learning parameters associated with the one or more sensors,
detect one or more objects,
extract learned features from each of the one or more objects, wherein the learned features are identified based on the learning parameters,
detect one or more individuals from the one or more objects based on the learned features,
track the one or more individuals based on a filter, and
update a people counter as a function of a position of each tracked individual.

### Claim 16 (depends on 15)

The system of claim 15, wherein the processing circuitry is further configured to:
acquire one or more videos from a sensor;
identify a set from the one or more videos, wherein the set includes videos representing extrema levels of crowdedness;
subtract a background to detect one or more moving objects;
extract features from the one or more moving objects;
apply a people learning process to determine the learning parameters associated with the sensor; and
store the learning parameters.

### Claim 17 (depends on 16)

The system of claim 16, wherein the features are extracted as a function of a hybrid technique.

### Claim 18 (depends on 17)

The system of claim 17, wherein the hybrid technique includes at least one of a granular computing process and a deep learning and meta-heuristics process.

### Claim 19

A non-transitory computer readable medium storing computer-readable instructions therein which when executed by a computer cause the computer to perform a method for people counting, the method comprising:
acquiring video data from one or more sensors;
acquiring learning parameters associated with the one or more sensors;
detecting one or more objects;
extracting learned features from each of the one or more objects, wherein the learned features are identified based on the learning parameters;
detecting one or more individuals from the one or more objects based on the learned features;
tracking the one or more individuals based on a filter; and
updating a people counter as a function of a position of each tracked individual.
