Imaging system for a vehicle which compares a reference image which includes a mark which is fixed to said vehicle to subsequent images

A vehicle comprising:

• an image pickup device, mounted within an interior of said vehicle, for obtaining peripheral environmental information as image data of an environment confronted by said vehicle;
• a reference mark fixed to said vehicle and lying within a field of view of said image pickup device;
• a storage unit for storing a reference frame including an image of an initial location of said reference mark;
• and
• a comparator for comparing said reference frame including the image of the initial location of said reference mark with at least one subsequent image of said image pickup device to check for deviation in aiming of said image pickup device.

A method of recognizing an environment confronting a vehicle from image pickup data, by image processing of image pickup data picked up by an image pickup device fixed to said vehicle, said method comprising the steps of:

• fixing a reference mark on said vehicles, and said reference mark lying within a field of view of said image pickup device;
• storing, in a storage unit, a reference frame of an image of an initial location of said reference mark;
• and
• comparing said reference frame including the image of the initial location of said reference mark with at least one subsequent image of said image pickup device to check for deviation in aiming of said image pickup device.

An environment recognition device for a vehicle comprising:

• an image pickup apparatus having an image pickup device installed in said vehicle for picking up an image of an exterior environment confronting said vehicle;
• an image processing apparatus for deciding existence of a predetermined dangerous state representing a danger to said vehicle based on image pickup data of said image pickup device;
• warning means for alerting a driver when the predetermined dangerous state is recognized by said image processing apparatus;
• a reference mark provided at a fixed position on said vehicle within an image pickup area of said image pickup device,
• a memory for storing a reference frame including a reference image of said image pickup device, said reference image containing an initial location of said reference mark;
• and
• a detecting apparatus for detecting a location of the reference mark within at least one subsequent image of said image pickup device, and
• a comparator apparatus for comparing said reference frame including the reference image with said at least one subsequent image and for alerting a driver through said warning means when the reference mark location in said at least one subsequent image has changed with respect to the initial location of said reference mark in the reference image of the reference frame stored in said memory.

An environment recognition device for a vehicle comprising:

• an image pickup apparatus having an image pickup device installed in said vehicle for picking up an image of an exterior environment confronting said vehicle;
• an image processing apparatus for deciding existence of a predetermined dangerous state representing a danger to said vehicle by using image pickup data of said image pickup device;
• warning means for alerting a driver when the predetermined dangerous state is recognized by said image processing apparatus;
• a reference mark provided at a fixed position on said vehicle within an image pickup area of said image pickup device;
• a memory for storing a reference frame including a reference image of said image pickup device, said reference image containing an initial location of said reference mark;
• and
• a detecting apparatus for detecting locations of the reference mark location within subsequent images of said image pickup device, said image pickup device continuing to transmit an image signal to said image processing apparatus until said detecting apparatus detects a deviation of one of said reference mark locations in said subsequent images from the initial location of said reference mark in the reference image of said reference frame.

An environment recognition device for a vehicle comprising:

• an image pickup apparatus having an image pickup device installed in said vehicle for picking up an image of an exterior environment confronting said vehicle;
• an image processing apparatus for deciding existence of a predetermined dangerous state representing a danger to said vehicle by using image pickup data of said image pickup device;
• warning means for alerting a driver when the predetermined dangerous state is recognized by said image processing apparatus;
• a reference mark provided at a fixed position on said vehicle within an image pickup area of said image pickup device;
• a memory for storing a reference frame including a reference image of said image pickup device, said reference image containing an initial location of said reference mark;
• and
• a detecting apparatus for detecting a location of the reference mark within at least one subsequent image of said image pickup device, and for suspending an image signal transmission from said image pickup device to said image processing apparatus when the reference mark location in said at least one subseruent-image has changed with respect to the initial location of said reference mark in the reference image of said reference frame.

An environment recognition device for a vehicle comprising:

• posture change sensors for sensing a posture change of said vehicle;
• an image pickup device installed in said vehicle for picking up an image of an exterior environment confronting said vehicle;
• an image processing apparatus for deciding existence of a predetermined dangerous state resenting a danger to said vehicle using image data of said image pickup device;
• alerting means for alerting a driver when the predetermined dangerous state is recognized by said image processing apparatus;
• a reference mark provided at a fixed position on said vehicle within an image pickup area of aid image pickup device;
• a storage device for storing a reference frame including an initial image including said reference mark;
• a comparator for comparing the reference frame including the initial image with subsequent images of said image pickup device to check for deviation in aiming of said image pickup device;
• and
• a suspending apparatus for suspending an image signal transmission from said image pickup device to said image processing apparatus when a posture change of said vehicle is sensed by said posture change sensors.

An environment recognition device for a vehicle comprising:

• an image pickup apparatus having an image pickup device installed in said vehicle for picking up an image of a fixed portion of said vehicle and an exterior environment confronting said vehicle;
• an image processing apparatus for deciding existence of a predetermined dangerous state representing a danger to said vehicle by using image pickup data of said image pickup device, and
• warning means for alerting a driver when the predetermined dangerous state is recognized by said image processing apparatus;
• a reference mark provided fixed to said fixed portion of said vehicle within an image pickup area of said image pickup device;
• a memory for storing a reference frame including a reference image containing an initial location of said reference mark on said fixed portion of said vehicle;
• and
• a detecting apparatus for detecting a reference mark location and a fixed portion of said vehicle within at least one subsequent image of said image pickup device, or comparing the location of said reference mark and the fixed portion of the vehicle in said at least subsequent image with the initial location of said reference mark in the reference image of said reference frame, and for alerting a driver through said warning means when the location of said reference mark location and the fixed portion of the vehicle in said at least one subsequent image has changed with respect to die initial location of said reference mark in the reference image of said reference frame.

An environment recognition device for a vehicle comprising:

• an image pickup apparatus having an image pickup device installed in said vehicle for picking up an image of an exterior environment confronting said vehicle;
• an image processing apparatus for deciding existence of a predetermined dangerous state representing a danger to said vehicle by using image pickup data of said image pickup device;
• warning means for alerting a driver when said predetermined dangerous state is recognized by said image processing apparatus;
• a reference mark provided fixed to said vehicle within an image pickup area of said image pickup device, said reference mark serving as a basis for checking deviation in aiming of said bray pickup device;
• a memory for storing a reference frame including a reference image of said image pickup device, said reference image containing an initial location of said reference mark;
• and
• an aiming apparatus for detecting a location of the reference mark within at least one subsequent image of said image pickup device, for comparing the location of the reference mark within said at least one subsequent image with the initial location of said reference mark in the reference image of said reference frame, and when said reference mark location in said at least one subsequent image his changed with respect to the initial location of s id reference mark in the reference image of said reference frame, for automatically adjusting an aiming direction of said image pickup device so that said reference mark location in sail at least one subsequent image and images thereafter coincide with the in trial location of said reference mark in the reference image of said reference frame.

An environment recognition device for a vehicle comprising:

• an image pickup apparatus having an image pickup device installed in said vehicle for picking an image of an exterior environment confronting said vehicle;
• an image processing apparatus for deciding existence of a predetermined dangerous state representing a danger to said vehicle by using image pickup data of said image pickup device;
• warning means for alerting a driver, when said predetermined dangerous state is recognized by said image processing means;
• a reference mart provided fixed to said vehicle within an image pickup area of said image pickup device;
• a memory for storing a reference frame including a reference image of said image pickup device, said reference image containing an initial location of said reference mark;
• and
• an aiming apparatus for detecting a location of the reference mark within at least one subsequent page of said image pickup device, for comparing the location of the reference mark within said at least one subsequent image with the initial location of said reference mark in the reference image of said reference frame, and when said reference mark location n in said at least one subsequent image has changed with respect to the initial location of aid reference mark in the reference image of said reference frame, for correcting image data taken into said image processing apparatus in accordance with a quantity and a direction of the change.

An environment recognition device for a vehicle, comprising:

• an image pickup device, mounted within said vehicle, for recognizing an environment confronted by said vehicle by signal processing of image pickup data;
• a storage unit for storing a reference frame including a reference, image indicative of an initial location of a reference mark fixed to said vehicle and lying within field of view of said image pickup device;
• and
• a comparator for comparing said reference frame including the reference image indicative of the initial location of said reference mark with at least one subsequent image from said image pickup device to check for deviation in aiming of said image pickup device.