# US 2001/0024513 A1 · Surveillance apparatus and recording medium recorded surveillance program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2001/0024513 A1
- Document ID: US20010024513A1
- Status: Published application
- Kind: A1
- Application number: 09/859,509
- Filed: 2001-05-18
- Published: 2001-09-27
- Earliest claimed: 1999-12-27
- Assignees: Hitachi, Ltd.
- Inventors: Takafumi Miyatake; Shigeki Nagaya; Akio Nagasaka; Takehiro Fujita
- Web page: https://patentgrep.com/patent/US20010024513A1

## CPC

- G08B 13/19602: {Image analysis to detect motion of the intruder, e.g. by frame subtraction}
- G06T 7/254: involving subtraction of images
- G06V 10/255: {Detecting or recognising potential candidate objects based on visual cues, e.g. shapes}
- G08B 13/19604: {involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change}
- G08B 13/19606: {Discriminating between target movement or movement in an area of interest and other non-signicative movements, e.g. target movements induced by camera shake or movements of pets, falling leaves, rotating fan}
- G08B 13/19671: {Addition of non-video data, i.e. metadata, to video stream}
- G08B 13/19676: {Temporary storage, e.g. cyclic memory, buffer storage on pre-alarm}
- G08B 13/1968: {Interfaces for setting up or customising the system}
- G08B 13/19682: {Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system}
- G08B 13/19691: {Signalling events for better perception by user, e.g. indicating alarms by making display brighter, adding text, creating a sound}
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An economical surveillance apparatus robust to an environmental change includes an input unit for inputting images in a time series, a background image memory unit for storing a plurality of input images, a difference image memory unit for calculating and storing difference degree between a plurality of background images of the background image memory unit and an image inputted afresh, and a judging unit for judging an existence/absence of an invading object by utilizing the value of the difference degree of the difference image memory unit. This surveillance apparatus can automatically register a plurality of background images from a camera image. Since the background images that are no longer used are automatically erased, the drop of detection speed and detection sensitivity can be prevented.

## Claims

### Claim 1

A surveillance apparatus comprising:
input means for inputting images in a time series;
background image memory means for registering a plurality of background images from said images;
difference image memory means for calculating a minimum value of difference degree of an absolute value of a difference between said background image and an image afresh inputted for each pixel and storing said difference; and
judgment means for judging an existence/absence of an invading object on the basis of said difference degree.

### Claim 2 (depends on 1)

A surveillance apparatus according to claim 1, wherein said background image comprises a single or a plurality of pixel values registered for each pixel.

### Claim 3 (depends on 2)

A surveillance apparatus according to claim 2, wherein:
said background image is registered or erased for each pixel;
erasing is determined on the basis of a period from a registration time of said pixel to a time at which said pixel is last looked up, and a period from a time at which said pixel is last looked up to a present time;
when registration is made, a new pixel value is written to an empty region if said empty region exists in said background image memory means, and if said empty region does not exist, importance of each pixel value of a corresponding pixel is calculated and is overwritten to an image value having the lowest degree of importance.

### Claim 4 (depends on 1)

A surveillance apparatus according to claim 1, which further includes:
memory means for recording said image inputted afresh when said judgment means judges that an invading object exists.

### Claim 5 (depends on 1)

A surveillance apparatus according to claim 1, wherein:
said difference image memory means includes minimum value image memory means for storing a minimum value image comprising an absolute value of a difference for each pixel and block-wise mean image memory means for dividing said minimum value image into blocks, and calculating and storing a mean value of an absolute value of a difference for each block; and
said judgment means judges an existence/absence of an invading object on the basis of a time series change of said mean value.

### Claim 6

A recording medium having recorded thereon a surveillance program executed by a computer including input/output means, a CPU and a memory, said program comprising the steps of:
inputting in a time series images from said input/output means;
registering a plurality of background images from said images into said memory;
calculating a minimum value of difference degree of an absolute value of a difference between said background image and an image inputted afresh for each pixel, and storing said minimum value in said memory; and
judging an existence/absence of an invading object on the basis of said difference degree.

### Claim 7 (depends on 6)

A recording medium according to claim 6, wherein said background image comprises a single or a plurality of pixel values registered for each pixel.

### Claim 8 (depends on 7)

A recording medium according to claim 7, wherein:
said surveillance program includes a step of erasing said background image;
in said erasing step, a pixel to be erased is decided on the basis of a period from a registration time of each of said pixel values to a time at which it is last looked up, and a period from the time at which it is last looked up to a present time; and
in said registration step, a new pixel value is written to an empty region if said empty region exists in said background image memory means, and if said empty region does not exist, a degree of importance for each pixel value of a corresponding pixel is calculated and is overwritten to a pixel value having the lowest degree of importance.

### Claim 9 (depends on 6)

A recording medium according to claim 6, wherein when said surveillance program further includes a step of recording said image inputted afresh when said judgment means judges that an invading object exists.

### Claim 10 (depends on 6)

A recording medium according to claim 6, wherein said surveillance program further includes the steps of:
storing a minimum value image comprising an absolute value of a difference for each pixel; and
dividing said minimum value image into blocks, and calculating and storing a mean value of an absolute value of a difference for each of said blocks; and wherein:
said judgment step judges an existence/absence of an invading object on the basis of a time series change of said mean value.
