License plate recognition with an intelligent camera

A method for recognizing license plates;

• employing and intelligent camera with a processor and a memory, the method steps comprising:
• capturing an image including a license plate by the intelligent camera;
• detecting a region in which the license plate is located by performing a coarse localization of the image;
• detecting orientation, position, and illumination conditions of the image and accounting for the orientations, position, and illumination conditions of the image to obtain a baseline image of the license plate;
• performing a find localization of the baseline image to obtain a more accurate depiction of vertical resolution of the baseline image of the license plate;
• segmenting characters depicted in the baseline image by employing a projection along a horizontal axis of the baseline image to identify positions of the characters;
• classifying the characters based on statistical classifier to obtain a confidence score for the probability of properly identifying each character;
• and
• recursively performing the method steps until each confidence score exceeds a threshold value to recognize the characters,
• wherein the step of detecting orientation, position and illumination conditions of the image and accounting for the orientations, positions, and illumination conditions of the image to obtain a baseline image of the license plate includes the step of comparing each character in the image of the license plate with examples of images with different illuminations to account for illumination effects on the image.

A method for recognizing license plates employing and intelligent camera with a processor and a memory, the method steps comprising:

• capturing an image including a license plate by the intelligent camera;
• detecting a region in which the license plate is located by performing a coarse localization of the image;
• detecting orientation, position, and illumination conditions of the image and accounting for the orientations, position, and illumination conditions of the image to obtain a baseline image of the license plate;
• performing a find localization of the baseline image to obtain a more accurate depiction of vertical resolution of the baseline image of the license plate;
• segmenting characters depicted in the baseline image by employing a projection along a horizontal axis of the baseline image to identify positions of the characters;
• classifying the characters based on statistical classifier to obtain a confidence score for the probability of properly identifying each character;
• and
• recursively performing the method steps until each confidence score exceeds a threshold value to recognize the characters,
• wherein the step of detecting a region in which the license plate is located by performing a coarse localization of the image includes the steps of:
• sub-sampling the image to reduce a number of pixels;
• extracting vertical edges in the image;
• generating a saliency map based upon the vertical edges to identify regions in the image with a probability of including the license plate;
• and
• extracting a localization result which includes the image of the license plate.

An intelligent camera system for recognizing license plates comprising:

• a camera adapted to independently capture a license plate image and recognize the license plate image including:
• a processor for managing image data and executing a license plate recognition program device;
• the license plate recognition program device including:
• means for detecting orientation, position, illumination conditions and blurring of the image and accounting for the orientations, position, illumination conditions and blurring of the image to obtain a baseline image of the license plate;
• means for segmenting characters depicted in the baseline image by employing a projection along a horizontal axis of the baseline image to identify positions of the characters;
• a statistical classifier adapted for recognizing a classifying and characters based on a confidence score, the confidence score being based on a probability of properly identifying each character;
• and
• a memory of storing the license plate recognition program and the license plate image taken by an image capture device of the camera;
• wherein the means for segmenting includes:
• means for providing a projection profile of pixel intensities across vertical lines of pixels in the baseline image;
• a filter profile for filtering the projection profile;
• and
• means for identifying locations of characters in the baseline image depicted by area below a threshold value in the filtered projection profile.

An intelligent camera system for recognizing license plates comprising:

• a camera adapted to independently capture a license plate image and recognize the license plate image including:
• a processor for managing image data and executing a license plate recognition program device;
• the license plate recognition program device including:
• means for detecting orientation, position, illumination conditions and blurring of the image and accounting for the orientations, position, illumination conditions and blurring of the image to obtain a baseline image of the license plate;
• means for segmenting characters depicted in the baseline image by employing a projection along a horizontal axis of the baseline image to identify positions of the characters;
• a statistical classifier adapted for recognizing a classifying and characters based on a confidence score, the confidence score being based on a probability of properly identifying each character;
• and
• a memory of storing the license plate recognition program and the license plate image taken by an image capture device of the camera,
• wherein the means for detecting includes examples of images with different illuminations to account for illumination effects on the image for each character within the image.

A program storage device readable by machine, tangible embodying a program of instructions executable by the machine to perform method steps for recognizing license plates employing an intelligent camera with a processor and a memory, the method steps comprising:

• capturing an image including a license plate by the intelligent camera;
• detecting a region in which the license plate is located by performing a coarse localization of the image;
• detecting orientation, position, and illumination conditions of the image and accounting for the orientations, position, and illumination conditions of the image to obtain a baseline image of the license plate;
• performing a fine localization of the baseline image to obtain a more accurate depiction of vertical resolution of the baseline image of the license plate;
• segmenting characters depicted in the baseline image by employing a projection along a horizontal axis of the baseline image to identify positions of the characters;
• classifying the characters based on statistical classifier to obtain a confidence score for the probability of properly identifying each character;
• and
• recursively performing the method steps until each confidence score exceeds a threshold value to recognize the characters,
• wherein the steps of segmenting characters depicted in the baseline image by employing a projection along a horizontal axis of the baseline image to identify positions of the characters includes the steps of:
• providing a projection profile of pixel intensities across vertical lines of pixels in the baseline image;
• filtering the projection profile;
• and
• identifying locations of characters in the baseline image depicted by area below a threshold value in the filtered projection profile.

A program storage device readable by machine, tangible embodying a program of instructions executable by the machine to perform method steps for recognizing license plates employing an intelligent camera with a processor and a memory, the method steps comprising:

• capturing an image including a license plate by the intelligent camera;
• detecting a region in which the license plate is located by performing a coarse localization of the image;
• detecting orientation, position, and illumination conditions of the image and accounting for the orientations, position, and illumination conditions of the image to obtain a baseline image of the license plate;
• performing a fine localization of the baseline image to obtain a more accurate depiction of vertical resolution of the baseline image of the license plate;
• segmenting characters depicted in the baseline image by employing a projection along a horizontal axis of the baseline image to identify positions of the characters;
• classifying the characters based on statistical classifier to obtain a confidence score for the probability of properly identifying each character;
• and
• recursively performing the method steps until each confidence score exceeds a threshold value to recognize the characters,
• wherein the step of detecting a region in which the license plate is located by performing a coarse localization of the image includes the steps of:
• sub-sampling the image to reduce a number of pixels;
• extracting vertical edges in the image;
• generating a saliency map based upon the vertical edges to identify regions in the image with a probability of including the license plate;
• and
• extracting a localization result which includes the images of the license plate.