# US 2013/0259316 A1 · Identifying spatial locations of events within video image data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0259316 A1
- Document ID: US20130259316A1
- Status: Published application
- Kind: A1
- Application number: 13/903,237
- Filed: 2013-05-28
- Published: 2013-10-03
- Earliest claimed: 2009-03-19
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Michael J. Desimone; Arun Hampapur; Zuoxuan Lu; Carl P. Mercier; Christopher S. Milite; Stephen R. Russo; Chiao-Fe Shu; Chek K. Tan
- Web page: https://patentgrep.com/patent/US20130259316A1

## CPC

- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06F 16/444: {Spatial browsing, e.g. 2D maps, 3D or virtual spaces}
- G06F 16/532: Query formulation, e.g. graphical querying
- G06F 16/7328: {Query by example, e.g. a complete video frame or video sequence (graphical querying G06F16/7335)}
- G06F 16/785: {using colour or luminescence}
- G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)}
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G06T 2207/30232: Surveillance
- G06T 2207/30241: Trajectory
- G06V 20/44: {Event detection}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An invention for identifying a spatial location of an event within video image data is provided. Disclosed are embodiments for generating trajectory data of a trajectory of an object for a plurality of pixel regions of an area of interest within video image data, the generating comprising: identifying one or more pixel regions from the plurality of pixel regions containing trajectory data; performing a multi-point neighborhood scan within the one or more pixel regions from the plurality of pixel regions containing trajectory data; and generating a transition chain code based on the multi-point neighborhood scan. Embodiments further generate a set of compressed spatial representations of the trajectory data of the trajectory of the object for an event based on the transition chain code, and generate a lossless contour code of the trajectory data of the trajectory of the object for the event based on the transition chain code.

## Claims

### Claim 1

A method for identifying a spatial location of an event within video image data comprising:
generating trajectory data of a trajectory of an object for a plurality of pixel regions of an area of interest within video image data, the generating comprising:
identifying one or more pixel regions from the plurality of pixel regions containing trajectory data;
performing a multi-point neighborhood scan within the one or more pixel regions from the plurality of pixel regions containing trajectory data; and
generating a transition chain code based on the multi-point neighborhood scan, the transition chain code defining a direction of trajectory of the object;
generating a set of compressed spatial representations of the trajectory data of the trajectory of the object for an event based on the transition chain code; and
generating a lossless contour code of the trajectory data of the trajectory of the object for the event based on the transition chain code.

### Claim 2 (depends on 1)

The method according to claim 1, further comprising inputting each of the set of compressed spatial representations of the trajectory data of the trajectory of the object for the event and the lossless contour code of the trajectory data of the trajectory of the object for the event into a relational database.

### Claim 3 (depends on 2)

The method according to claim 2, further comprising searching the relational database to identify a spatial location of the event within the video image data.

### Claim 4 (depends on 3)

The method according to claim 3, the searching comprising:
converting the area of interest to a lossy query code; and
comparing the lossy query code to a searchable code of the trajectory data of the event within the video image data.

### Claim 5 (depends on 4)

The method according to claim 4, further comprising:
decompressing a contour-coded blob corresponding to the lossy query code based on the comparing; and
plotting a trajectory of the event within the video image data from the contour-coded blob.

### Claim 6

A system for identifying a spatial location of an event within video image data comprising:
at least one processing unit;
memory operably associated with the at least one processing unit; and
a spatial representation tool storable in memory and executable by the at least one processing unit, the spatial representation tool comprising:
a compression component configured to:
generate trajectory data of a trajectory of an object for a plurality of pixel regions of an area of interest within video image data, the trajectory data generated by:
identifying one or more pixel regions from the plurality of pixel regions containing trajectory data;
performing a multi-point neighborhood scan within the one or more pixel regions from the plurality of pixel regions containing trajectory data; and
generating a transition chain code based on the multi-point neighborhood scan, the transition chain code defining a direction of trajectory of the object;
generate a set of compressed spatial representations of the trajectory data of the trajectory of the object for an event based on the transition chain code; and
generate a lossless contour code of the trajectory data of the trajectory of the object for the event based on the transition chain code.

### Claim 7 (depends on 6)

The system of claim 6, the spatial representation tool further comprising a database component configured to input each of the set of compressed spatial representations of the trajectory data of the trajectory of the object for the event and the lossless contour code of the trajectory data of the trajectory of the object for the event into a relational database.

### Claim 8 (depends on 7)

The system of claim 7, further comprising a search component configured to search the relational database to identify a spatial location of the event within the video image data.

### Claim 9 (depends on 8)

The system of claim 8, the search component further configured to:
convert the region of interest to a lossy query code; and
compare the lossy query code to a searchable code of the trajectory data of the event within the video image data.

### Claim 10 (depends on 9)

The spatial representation tool according to claim 9 further comprising a display component configured to:
decompress a contour-coded blob corresponding to the lossy query code based on the comparison of the lossy query code to the searchable code of the trajectory data of the event within the video image data; and
plot a trajectory of the event within the video image data from the contour-coded blob.

### Claim 11

A computer-readable storage device storing computer instructions, which when executed, enables a computer system to identify a spatial location of an event within video image data, the computer instructions comprising:
generating trajectory data of a trajectory of an object for a plurality of pixel regions of an area of interest within video image data, the generating comprising:
identifying one or more pixel regions from the plurality of pixel regions containing trajectory data;
performing a multi-point neighborhood scan within the one or more pixel regions from the plurality of pixel regions containing trajectory data; and
generating a transition chain code based on the multi-point neighborhood scan, the transition chain code defining a direction of trajectory of the object;
generating a set of compressed spatial representations of the trajectory data of the trajectory of the object for an event based on the transition chain code; and
generating a lossless contour code of the trajectory data of the trajectory of the object for the event based on the transition chain code.

### Claim 12 (depends on 11)

The computer-readable storage device according to claim 11, further comprising computer instructions for inputting each of the set of compressed spatial representations of the trajectory data of the trajectory of the object for the event and the lossless contour code of the trajectory data of the trajectory of the object for the event into a relational database.

### Claim 13 (depends on 12)

The computer-readable storage device according to claim 12, further comprising computer instructions for searching the relational database to identify a spatial location of the event within the video image data.

### Claim 14 (depends on 13)

The computer-readable storage device according to claim 13, the computer instructions for searching comprising:
converting the area of interest to a lossy query code; and
comparing the lossy query code to a searchable code of the trajectory data of the event within the video image data.

### Claim 15 (depends on 14)

The computer-readable storage device according to claim 14, further comprising computer instructions for:
decompressing a contour-coded blob corresponding to the lossy query code based on the comparing; and
plotting a trajectory of the event within the video image data from the contour-coded blob.
