# US 2019/0156492 A1 · Video Analysis Methods and Apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0156492 A1
- Document ID: US20190156492A1
- Status: Published application
- Kind: A1
- Application number: 16/253,640
- Filed: 2019-01-22
- Published: 2019-05-23
- Earliest claimed: 2015-12-16
- Assignees: Vi Dimensions Pte Ltd
- Applicants: Vi Dimensions Pte Ltd
- Inventors: Yosua Michael Maranatha; Christopher Tay Meng Keat; Raymond Looi; Ashish Sriram
- Web page: https://patentgrep.com/patent/US20190156492A1

## CPC

- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06F 18/217: {Validation; Performance evaluation; Active pattern learning techniques}
- G06F 18/23: Clustering techniques
- G06F 18/254: {of classification results, e.g. of results related to same input data}
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/251: {involving models}
- G06V 10/776: Validation; Performance evaluation
- G06V 10/809: {of classification results, e.g. where the classifiers operate on the same input data}
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06T 2207/20081: Training; Learning
- G06T 2207/30232: Surveillance
- G06V 20/44: {Event detection}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Video analysis methods are described in which abnormalities are detected by comparing features extracted from a video sequence or motion patterns determined from the video sequence with a statistical model. The statistical model may be updated during the video analysis.

## Claims

### Claim 1

A method of identifying abnormal events in a video sequence, the method comprising:
extracting features from the video sequence;
determining motion patterns from the extracted features;
determining an abnormality measure for each motion pattern by comparing the motion patterns with a statistical model; and
identifying an abnormal event using the abnormality measure.

### Claim 2 (depends on 1)

A method according to claim 1, wherein the motion patterns comprise tracks indicating motion between frames of the video sequence.

### Claim 3 (depends on 1)

A method according to claim 1, further comprising quantizing the extracted features.

### Claim 4 (depends on 1)

A method according to claim 1, further comprising updating the statistical model using the motion patterns.

### Claim 5 (depends on 1)

A method according to claim 1, wherein identifying an abnormal event using the abnormality measure comprises comparing the abnormality measure with a threshold and identifying an abnormal event when the abnormality measure is greater than the threshold.

### Claim 6 (depends on 1)

A method according to claim 1, wherein the statistical model comprises a set of clustered motion patterns.

### Claim 7 (depends on 6)

A method according to claim 6, wherein determining an abnormality measure for a motion pattern comprises identifying a set of clustered motion patterns of the statistical model closest to the motion pattern.

### Claim 8 (depends on 7)

A method according to claim 7, wherein the abnormality measure is a distance measure between the set of clustered motion patterns closest to the motion pattern and the motion pattern.

### Claim 9 (depends on 1)

A method according to claim 1, wherein the features are optical flow.

### Claim 10 (depends on 1)

A method according to claim 1, further comprising detecting an event according to a pre-defined rule and wherein identifying an abnormal event comprises using the abnormality measure and the result of the pre-defined rule.

### Claim 11 (depends on 1)

A non-transitory computer readable carrier medium carrying processor executable instructions which when executed on a processor cause the processor to carry out a method according to claim 1.

### Claim 12

An apparatus for identifying abnormal events in a video sequence, the apparatus comprising:
a computer processor and a data storage device, the data storage device having a feature extraction module; a motion pattern generation module and a classifier module comprising non-transitory instructions operative by the processor to:
extract features from the video sequence;
determine motion patterns from the extracted features;
determine an abnormality measure for each motion pattern by comparing the motion patterns with a statistical model; and
identify an abnormal event using the abnormality measure.

### Claim 13 (depends on 12)

An apparatus according to claim 12, wherein the motion patterns comprise tracks indicating motion between frames of the video sequence.

### Claim 14 (depends on 12)

An apparatus according to claim 12, the data storage device further comprising a quantization module comprising non-transitory instructions operative by the processor to: quantize the extracted features.

### Claim 15 (depends on 12)

An apparatus according to claim 12, the data storage device further comprising a compare a compare and build statistical model module comprising non-transitory instructions operative by the processor to: update the statistical model using the motion patterns.

### Claim 16 (depends on 12)

An apparatus according to claim 12, wherein the classifier module comprises non-transitory instructions operative by the processor to: identify an abnormal event using the abnormality measure by comparing the abnormality measure with a threshold and identifying an abnormal event when the abnormality measure is greater than the threshold.

### Claim 17 (depends on 12)

An apparatus according to claim 12, wherein the statistical model comprises a set of clustered motion patterns.

### Claim 18 (depends on 17)

An apparatus according to claim 17, wherein the classifier module comprises non-transitory instructions operative by the processor to: determine an abnormality measure for a motion pattern by identifying a set of clustered motion patterns of the statistical model closest to the motion pattern.

### Claim 19 (depends on 18)

An apparatus according to claim 18, wherein the abnormality measure is a distance measure between the set of clustered motion patterns closest to the motion pattern and the motion pattern.

### Claim 20 (depends on 12)

An apparatus according to claim 12, wherein the features are optical flow.

### Claim 21 (depends on 12)

An apparatus according to claim 12, wherein the storage device further comprises a rule based classifier module comprising non-transitory instructions operative by the processor to: detecting an event according to a pre-defined rule and wherein identifying an abnormal event comprises using the abnormality measure and the result of the pre-defined rule.
