# US 2025/0148796 A1 · Method for detecting and counting individuals in a crowd

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0148796 A1
- Document ID: US20250148796A1
- Status: Published application
- Kind: A1
- Application number: 18/891,008
- Filed: 2024-09-20
- Published: 2025-05-08
- Earliest claimed: 2023-09-29
- Assignees: Idemia Identity & Security France
- Applicants: Idemia Identity & Security France
- Inventors: Pierre PERRAULT; Siwar MHADHBI
- Web page: https://patentgrep.com/patent/US20250148796A1

## CPC

- G06V 20/53: {Recognition of crowd images, e.g. recognition of crowd congestion}
- G06V 10/23: {based on positionally close patterns or neighbourhood relationships}
- G06V 10/267: {by performing operations on regions, e.g. growing, shrinking or watersheds}
- G06V 10/82: using neural networks
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method, implemented by computer, for locating and counting individuals in a crowd, said method takes, as input data, one or more images of a crowd of individuals, and provides, as output data, one or more binary images of connected components corresponding to the heads of the individuals of the crowd including providing a convolutional neural network previously trained on a training set of images of crowds of individuals whose heads are annotated, the annotations having previously been modified using a process of tiling as adjacent cells, generating, for each image of a crowd, a prediction map processing said image through the convolutional neural network, binarizing each prediction map using a binarization module configured to generate a threshold value or a map of threshold values specific to said prediction map PM, each binarized prediction map being a binary image of connected components corresponding to the heads of the individuals.

## Claims

### Claim 1

A method, implemented by computer, for locating and counting individuals in a crowd, said method takes, as input data, one or more images of a crowd of individuals, and provides, as output data, one or more binary images of connected components corresponding to heads of the individuals of the crowd, said method comprising:
(a) providing a convolutional neural network (CNN) previously trained on a training set (TDS) composed of images of crowds of individuals whose heads are annotated, the annotations of each image of said training set TDS having previously been modified using a process of tiling as adjacent cells;
(b) generating, for each image of a crowd supplied as input data, a prediction map (PM) by processing said image through the convolutional neural network (CNN) provided in step (a); and
(c) binarizing each prediction map (PM) generated in step (b) using a threshold value (T) or a map of threshold values (TM), each binarized prediction map (BPM) being a binary image of connected components corresponding to the heads of the individuals.

### Claim 2 (depends on 1)

The method as claimed in claim 1, wherein, in step (a), the heads of the individuals of the images of the training set (TDS) are annotated using boxes encompassing said heads.

### Claim 3 (depends on 1)

The method as claimed in claim 1, wherein, in step (a), the heads of the individuals of the images of the training set TDS are annotated using boxes centered on said heads, sizes of the boxes in superposed condition are reduced such that a distance, d, separating them is greater than a quarter of a smallest dimension, (L-a, L-b, H-a, H-b).

### Claim 4 (depends on 1)

The method as claimed in claim 1, wherein, in step (a), the tiling is a Voronoi breakdown.

### Claim 5 (depends on 1)

The method as claimed in claim 1, wherein, in step (a), the tiling process further comprises reduction of each adjacent cell into a sub-cell, said sub-cell is inscribed in said adjacent cell and is separated from the other adjacent cells at a boundary between said adjacent cell and the other adjacent cells by a separation zone of a given width.

### Claim 6 (depends on 5)

The method as claimed in claim 5, wherein the width of the separation zone is at most 5 pixels.

### Claim 7 (depends on 5)

The method as claimed in claim 5, wherein, for each sub-cell, the width of the separation zone is less than or equal to an eighth of the minimum value out of geometrical dimensions of the annotations corresponding to first neighbor adjacent cells of the adjacent cell in which the sub-cell is inscribed, a number of first neighbor cells being at least 3.

### Claim 8 (depends on 5)

The method as claimed in claim 5, wherein an area of an intersection of each sub-cell with the annotation associated with the adjacent cell in which said sub-cell is inscribed is greater than or equal to half an area of said annotation.

### Claim 9 (depends on 1)

The method as claimed in claim 1, wherein, in step (a), the training of the convolutional neural network CNN further comprises use of an objective function, said objective function includes a penalty parameter associated with pixels of the image situated on common boundaries of the adjacent cells and/or in separation zones between sub-cells.

### Claim 10 (depends on 1)

The method as claimed in claim 1, wherein the convolutional neural network (CNN) is an HRNet convolutional neural network.

### Claim 11

A data processing device comprising:
processing circuitry for locating and counting individuals in a crowd that takes, as input data, one or more images of a crowd of individuals, and provides, as output data, one or more binary images of connected components corresponding to heads of the individuals of the crowd, the processing circuitry being configured to:
provide a convolutional neural network (CNN) previously trained on a training set (TDS) composed of images of crowds of individuals whose heads are annotated, the annotations of each image of said training set TDS having previously been modified using a process of tiling as adjacent cells;
generate, for each image of a crowd supplied as input data, a prediction map (PM) by processing said image through the convolutional neural network (CNN); and
binarize each prediction map (PM) using a threshold value (T) or a map of threshold values (TM), each binarized prediction map (BPM) being a binary image of connected components corresponding to the heads of the individuals.

### Claim 12 (depends on 1)

A non-transitory computer readable medium having stored thereon a computer program having instructions which, when the program is run by a computer, cause the computer to implement the method as claimed in claim 1.

### Claim 13

(canceled)

### Claim 14 (depends on 11)

A system for locating and counting individuals in a crowd, said system comprising:
an acquisition module for acquiring one or more images of a crowd of individuals; and
the data processing device as claimed in claim 11 and configured to receive and process one or more images acquired by the acquisition module.

### Claim 15 (depends on 14)

The system as claimed in claim 14, wherein the acquisition module is configured for the acquisition of images of a perspective overhead image of a crowd of individuals.

### Claim 16 (depends on 5)

The method as claimed in claim 5, wherein the width of the separation zone is at most 2 pixels.

### Claim 17 (depends on 5)

The method as claimed in claim 5, wherein the width of the separation zone is at most 1 pixels.

### Claim 18 (depends on 5)

The method as claimed in claim 5, wherein a number of first neighbor cells being at least 5.

### Claim 19 (depends on 2)

The method as claimed in claim 2, wherein, in step (a), the tiling is a Voronoi breakdown.

### Claim 20 (depends on 3)

The method as claimed in claim 3, wherein, in step (a), the tiling is a Voronoi breakdown.

### Claim 21 (depends on 2)

The method as claimed in claim 2, wherein, in step (a), the tiling process further comprises reduction of each adjacent cell into a sub-cell, said sub-cell is inscribed in said adjacent cell and is separated from the other adjacent cells at a boundary between said adjacent cell and the other adjacent cells by a separation zone of a given width.
