# US 2019/0172330 A1 · Security system and method to detect motions and features associated with a traveler

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172330 A1
- Document ID: US20190172330A1
- Status: Published application
- Kind: A1
- Application number: 16/260,801
- Filed: 2019-01-29
- Published: 2019-06-06
- Earliest claimed: 2017-03-31
- Assignees: The Government of the United States of America, as represented by the Secretary of Homeland Security
- Applicants: The Government of the United States of America, as represented by the Secretary of Homeland Security
- Inventors: Mark A. Fry; Barry T. Smith
- Web page: https://patentgrep.com/patent/US20190172330A1

## CPC

- G08B 13/19697: {Arrangements wherein non-video detectors generate an alarm themselves}
- G06T 5/20: using local operators
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- H04N 7/183: {for receiving images from a single remote source}
- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A security system to detect motions and/or features associated with a traveler, the security system includes a camera configured to capture an image series of the traveler in an Eulerian or Lagrangian frame of reference, wherein the captured image series contains motions and features associated with the traveler; an alarm system configured to produce an alert signal; and an electronic control unit. The electronic control unit is configured to magnify the motions and features associated with the traveler to generate frame of reference perceptible motions and features, detect characteristic kinematic behaviors of the perceptible motions and features, measure characteristic kinematic quantities of the characteristic kinematic behaviors, determine the presence of features that deviate from a threshold value for the characteristic kinematic quantities, and activate the alarm system to produce the alert signal.

## Claims

### Claim 1

A security system to detect motions associated with a traveler, the security system comprising:
a camera configured to capture an image series of the traveler in one of an Eulerian frame of reference and a Lagrangian frame of reference, wherein the captured image series contains motions associated with the traveler;
an alarm system that produces an alert signal; and
an electronic control unit configured to:
magnify the motions associated with the traveler to generate frame of reference perceptible motions;
detect characteristic kinematic behaviors of the perceptible motions;
measure characteristic kinematic quantities of the characteristic kinematic behaviors;
determine a presence of motions that deviate from a predetermined threshold value for the characteristic kinematic quantities; and
activate the alarm system to produce the alert signal.

### Claim 2 (depends on 1)

The security system of claim 1, wherein the electronic control unit is further configured to:
extract a pixel value time series for each image of the input image series; and
apply a magnification function to the pixel value time series;
wherein the magnification function depends on spatial frequencies of the pixel value time series.

### Claim 3 (depends on 2)

The security system of claim 2, wherein the magnification function provides a maximum amplification when the spatial frequencies are lower than a critical spatial frequency and an attenuation when the spatial frequencies exceed the critical spatial frequency.

### Claim 4 (depends on 2)

The security system of claim 2, wherein the electronic control unit is further configured to apply a bandpass filter to the pixel value time series.

### Claim 5 (depends on 4)

The security system of claim 4, wherein the bandpass filter has a pass band that is centered on a key frequency of the traveler in motion.

### Claim 6 (depends on 5)

The security system of claim 5, wherein the bandpass filter is constructed with a first first-order lowpass infinite impulse response filter having a first cutoff frequency and a second first-order lowpass infinite impulse response filter having a second cutoff frequency.

### Claim 7 (depends on 1)

The security system of claim 1, wherein the characteristic kinematic behaviors include body motions.

### Claim 8 (depends on 7)

The security system of claim 7, wherein the characteristics kinematic quantities include moments of the body motions.

### Claim 9 (depends on 1)

The security system of claim 1, wherein the electronic control unit is further configured to select a specific zone of interest for each image of the captured image series.

### Claim 10 (depends on 1)

The security system of claim 1, wherein the electronic control unit is further configured to alert authorities in response to the alert signal.

### Claim 11 (depends on 1)

The security system of claim 1, wherein the traveler is in motion.

### Claim 12

A method to detect motions associated with a traveler, the method comprising:
capturing an image series of the traveler in one of an Eulerian frame of reference and a Lagrangian frame of reference, via a camera, wherein the captured image series contains motions generated by the traveler;
magnifying the motions associated with the traveler, via the processing circuitry, to generate perceptible motions;
detecting characteristic kinematic behaviors of the perceptible motions, via the processing circuitry;
measuring characteristic kinematic quantities of the characteristic kinematic behaviors, via processing circuitry;
determining a presence of motions that deviate from a predetermined threshold value for the characteristic kinematic quantities, via processing circuitry; and
producing an alert signal via an alarm system.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
extracting pixel value time series for each image of the captured image series, via the processing circuitry; and
applying a magnification function to the pixel value time series, via processing circuitry;
wherein the magnification function depends on spatial frequencies of the pixel value time series.

### Claim 14 (depends on 13)

The method of claim 13, wherein applying the magnification function further comprises providing a maximum amplification, via the processing circuitry, when the spatial frequencies are lower than a critical spatial frequency and an attenuation when the spatial frequencies exceed the critical spatial frequency.

### Claim 15 (depends on 13)

The method of claim 13, wherein extracting the pixel value time series further comprises applying a bandpass filter to the pixel value time series, via the processing circuitry.

### Claim 16 (depends on 15)

The method of claim 15, wherein the bandpass filter has a pass band that is centered on a key frequency of the traveler in motion.

### Claim 17 (depends on 16)

The method claim 16, wherein the bandpass filter is constructed with a first first-order lowpass infinite impulse response filter having a first cutoff frequency and a second first-order lowpass infinite impulse response filter having a second cutoff frequency.

### Claim 18 (depends on 12)

The method of claim 12, wherein the characteristic kinematic behaviors include body motions.

### Claim 19 (depends on 18)

The method of claim 18, wherein the characteristics kinematic quantities include moments of the body motions.

### Claim 20 (depends on 12)

The method of claim 12, further comprising selecting a specific zone of interest for each image of the input image series, via the processing circuitry.

### Claim 21 (depends on 12)

The method of claim 12, further comprising alerting the authorities, via a network interface of the electronic control unit, in response to the alert signal.

### Claim 22

A security system to detect features associated with a traveler, the security system comprising:
a camera configured to capture an image series of the traveler in one of an Eulerian frame of reference and a Lagrangian frame of reference, wherein the captured image series contains features generated by the traveler;
an alarm system that produces an alert signal; and
an electronic control unit configured to:
magnify the features associated with the traveler to generate frame of reference perceptible features;
detect characteristic kinematic behaviors of the perceptible features;
measure characteristic kinematic quantities of the characteristic kinematic behaviors;
determine a presence of features that deviate from a threshold value for the characteristic kinematic quantities; and
activate the alarm system to produce the alert signal.
