# US 12,111,382 B2 · Methods and systems for improving target detection performance of an indoor radar sensor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,111,382 B2
- Document ID: US12111382B2
- Status: Granted
- Kind: B2
- Application number: 18/302,765
- Filed: 2023-04-18
- Published: 2023-08-10
- Granted: 2024-10-08
- Earliest claimed: 2020-06-22
- Assignees: Honeywell International Inc.
- Applicants: Honeywell International Inc.
- Inventors: Armin Wellig
- Web page: https://patentgrep.com/patent/US12111382B2

## CPC

- G01S 13/04: Systems determining presence of a target (based on relative movement of target G01S13/56)
- G01S 13/06: Systems determining position data of a target
- G01S 13/56: for presence detection {(presence detection using near field arrangements G01V3/00, e.g. G01V3/08, G01V3/12; burglar, theft or intruder alarms with electrical actuation G08B13/22 - G08B13/26)}
- G01S 13/58: Velocity or trajectory determination systems; Sense-of-movement determination systems
- G06F 18/24: Classification techniques
- G06V 10/147: Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19)
- G06V 20/13: Satellite images
- G06V 20/53: {Recognition of crowd images, e.g. recognition of crowd congestion}
- G06V 20/64: Three-dimensional [3D] objects
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A computer assisted method for processing output from a mmWave sensor to derive a more reliable count of people in a room, zone or space being monitored by the sensor. In some examples, damping is applied to a varying “people count” signal from the sensor. The damping reduces volatility of the people count and avoids counting anomalous false positive detections. When the people count value decreases, damping may be applied more heavily to disregard intermittent false negatives where the sensor momentarily fails to detect an actual person. In some examples, the mmWave sensor provides point clouds representing the approximate shape and location of detected apparent objects, some of which may be people. Some example methods define digital targets corresponding to the point clouds. The targets are deemed to represent real people if the objects and their corresponding targets have sufficient lifespan and exhibit movement within a predetermined normal range.

## Claims

### Claim 1

A method for determining a number of people in a space, the method comprising:
monitoring the space using a mmWave sensor, wherein the mmWave sensor detects each of one or more apparent objects in the space each of which has a corresponding detection duration while in the space;
identifying one or more false objects of the one or more apparent objects based at least partially on the corresponding detection duration of the one or more false objects being equal to or less than a predetermined minimum detection duration;
determining a credible object count of one or more credible objects of the apparent objects, the credible object count is representative of a number of the apparent objects in the space that are not identified as one or more of the false objects; and
determining the number of people in the space based at least partially on the credible object count.

### Claim 2 (depends on 1)

The method of claim 1, comprising:
monitoring a condition associated with the space using an auxiliary sensor that is different from the mmWave sensor, wherein the condition is responsive to an action of one or more of the credible objects; and
using sensor fusion to fuse information from the mmWave sensor and the auxiliary sensor when determining the number of people in the space.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
monitoring a location of each of the one or more credible objects while each of the one or more credible objects remain within the space;
decreasing the credible object count in response to the one or more credible objects being undetected in the space by the mmWave sensor for at least a predetermined period of time while a most recent location of the one or more credible objects was in a predetermined exit zone of the space; and
leaving the credible object count unaffected in response to the one or more credible objects being currently undetected in the space by the mmWave sensor while the most recent location of the one or more credible objects is within the space but outside the predetermined exit zone of the space.

### Claim 4 (depends on 1)

The method of claim 1, wherein the corresponding detection duration of a particular apparent object is a cumulative value of a plurality of momentary detection durations of the particular apparent object in the space.

### Claim 5 (depends on 1)

The method of claim 1, wherein when a particular apparent object is detected momentarily a plurality of times in the space each for a corresponding momentary detection duration, the corresponding detection duration for that particular apparent object is representative of a cumulative value of the corresponding momentary detection durations of the particular apparent object.

### Claim 6

A system for determining a number of people in a space, the system comprising:
an indoor radar sensor for detecting objects in the space;
a controller operatively coupled to the indoor radar sensor, the controller configured to:
monitor an output of the indoor radar sensor;
detect each of one or more apparent objects in the space based on the output of the indoor radar sensor;
determine for each of the one or more apparent objects detected in the space a corresponding object detection duration while in the space;
determine when one or more of the apparent objects in the space corresponds to a ghost object that is not actually present in the space;
determine the number of people in the space based at least partially on:
a number of the one or more apparent objects in the space; and
a number of apparent objects that are determined to be ghost objects.

### Claim 7 (depends on 6)

The system of claim 6, wherein to determine when one or more of the apparent objects corresponds to a ghost object, the controller is configured to:
determine which of the one or more of the apparent objects in the space have an object detection duration that is less than a predetermined detection duration threshold.

### Claim 8 (depends on 6)

The system of claim 6, wherein to determine when one or more of the apparent objects corresponds to a ghost object, the controller is configured to:
track a speed of movement of each of the one or more of the apparent objects while in the space; and
determine which of the one or more of the apparent objects have had a speed of movement that is above a predetermined maximum speed threshold.

### Claim 9 (depends on 6)

The system of claim 6, wherein the controller is configured to:
allow the determined number of people in the space to increase faster than the determined number of people is allowed to decrease.

### Claim 10 (depends on 6)

The system of claim 6, wherein the controller is configured to:
determine when an object that is actually present in the space no longer has a corresponding apparent object detected by the indoor radar sensor; and
determining the number of people in the space based at least partially on a number of objects that are determined to be actually present in the space but no longer have a corresponding apparent object.

### Claim 11 (depends on 10)

The system of claim 10, wherein to determine when an object that is actually present in the space no longer has a corresponding apparent object detected by the indoor radar sensor, the controller is configured to:
assign a confidence score to each of the one or more apparent objects that are detected by the indoor radar sensor to be in the space, wherein the confidence score is dependent at least in part on the object detection duration of the corresponding apparent object; and
determine that an object is actually present in the space even though the object no longer has a corresponding apparent object detected by the indoor radar sensor when the object has a confidence score that is above a confidence score threshold.

### Claim 12 (depends on 6)

The system of claim 6, wherein the controller is configured to:
identifying a coordinate location of each of the number of people determined to be in the space; and
correlate the coordinate location of each of the number of people determined to be in the space to one of a plurality of defined zones of the space.

### Claim 13 (depends on 12)

The system of claim 12, wherein the controller is configured to identify which of the plurality of defined zones of the space are currently occupied by at least one person.

### Claim 14 (depends on 12)

The system of claim 12, wherein the controller is configured to identify a count of people in each of the plurality of defined zones of the space.

### Claim 15 (depends on 6)

The system of claim 6, wherein the controller is configured to:
determine the space is occupied when the controller determines the number of people in the space is greater than zero for at least a first predetermined duration of time; and
determine the space is no longer occupied when the controller determines the number of people in the space is zero for at least a second predetermined duration of time, wherein the first predetermined duration of time is less than the second predetermined duration of time.

### Claim 16 (depends on 6)

The system of claim 6, wherein the controller is configured to:
monitor the output of the indoor radar sensor at a first rate; and
determine the number of people in the space at a second rate, where the first rate is more than twice as fast as the second rate.

### Claim 17

A method for determining a number of people in a space, the method comprising:
monitoring the space using an indoor radar sensor, wherein the indoor radar sensor detects each of one or more apparent objects in the space and each of the one or more apparent objects are tracked while remaining in the space;
determining the space is occupied when at least one of the one or more apparent objects are detected by the indoor radar sensor and are determined to remain in the space for at least a first predetermined duration of time;
determining the space is no longer occupied when no apparent objects are detected by the indoor radar sensor to be in the space for at least a second predetermined duration of time, wherein the first predetermined duration of time is less than the second predetermined duration of time; and
determining and reporting the number of people in the space.

### Claim 18 (depends on 17)

The method of claim 17, wherein determining the number of people in the space comprises:
determining when one or more of the apparent objects corresponds to a ghost object that is not actually present in the space;
determining when an object that is actually present in the space no longer has a corresponding apparent object;
determining the number of people in the space based at least partially on:
a number of apparent objects that are determined to be ghost objects; and
a number of apparent objects that are determined to be actually present in the space but no longer have a corresponding apparent object.

### Claim 19 (depends on 18)

The method of claim 18, wherein determining when an object that is actually present in the space no longer has a corresponding apparent object comprises:
assigning a confidence score to each of the one or more apparent objects, wherein the confidence score is dependent at least in part on how long the corresponding apparent object has been detected by the indoor radar sensor; and
determining that an object is actually present in the space even though the object no longer has a corresponding apparent object detected by the indoor radar sensor when the object has a confidence score that is above a confidence score threshold.

### Claim 20 (depends on 17)

The method of claim 17, further comprising:
identifying a coordinate location of each of the number of people determined to be in the space;
correlate the coordinate location of each of the number of people determined to be in the space to one of a plurality of defined zones of the space; and
indicating which of the plurality of defined zones are occupied.
