# US 2011/0211233 A1 · Image processing device, image processing method and computer program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2011/0211233 A1
- Document ID: US20110211233A1
- Status: Published application
- Kind: A1
- Application number: 13/022,933
- Filed: 2011-02-08
- Published: 2011-09-01
- Earliest claimed: 2010-03-01
- Assignees: Sony Corporation
- Inventors: Jun YOKONO
- Web page: https://patentgrep.com/patent/US20110211233A1

## CPC

- G06V 10/446: {using Haar-like filters, e.g. using integral image techniques}
- G06F 18/2148: {characterised by the process organisation or structure, e.g. boosting cascade}
- G06V 10/50: by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
- G06V 10/7747: {Organisation of the process, e.g. bagging or boosting}
- G06V 10/94: Hardware or software architectures specially adapted for image or video understanding
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An image processing device includes a scanning unit configured to scan a search window on an image to be detected, and a discrimination unit configured to apply one or more rectangle filters for detecting a desired object to an image of the search window at each scan position so as to calculate one or more rectangle features and to discriminate whether or not the object is detected based on the obtained one or more rectangle features. The scanning unit generates integral images corresponding to a size of the search window at every scan position and holds the integral images in a predetermined memory buffer, and the discrimination unit calculates the rectangle features with respect to the image of the search window at each scan position using the integral images held in the memory buffer.

## Claims

### Claim 1

An image processing device comprising:
a scanning unit configured to scan a search window on an image to be detected; and
a discrimination unit configured to apply one or more rectangle filters for detecting a desired object to an image of the search window at each scan position so as to calculate one or more rectangle features and to discriminate whether or not the object is detected based on the obtained one or more rectangle features,
wherein the scanning unit generates integral images corresponding to a size of the search window at every scan position and holds the integral images in a predetermined memory buffer, and
wherein the discrimination unit calculates the rectangle features with respect to the image of the search window at each scan position using the integral images held in the memory buffer.

### Claim 2 (depends on 1)

The image processing device according to claim 1, wherein the scanning unit discards integral images of a region, which is not necessary at a subsequent scan position, from the memory buffer when moving the scan position, calculates integral images of a region newly added to the search window, and adds and holds the calculated integral images in the memory buffer.

### Claim 3 (depends on 2)

The image processing device according to claim 2, wherein the scanning unit continuously holds integral images of a region adjacent to the region newly added to the search window at the subsequent scan position in the memory buffer when moving the scan position, and the integral images of the region newly added to the search window are recursively calculated using the integral images of the adjacent region held in the memory buffer.

### Claim 4 (depends on 2)

The image processing device according to claim 2, wherein the scanning unit continuously holds integral images of a pixel line of a pixel width of one pixel or more just before a next scan line in the memory buffer when moving the scan position on a current scan line, and the integral images of the region of the search window are recursively calculated using the held integral images of the pixel line at each scan position on a next scan line.

### Claim 5 (depends on 1)

The image processing device according to claim 1, wherein the scanning unit generates integral images of a region of one column corresponding to a width of the search window at every scan line when performing scanning on the image to be detected in a vertical direction.

### Claim 6 (depends on 1)

The image processing device according to claim 1, wherein the scanning unit generates integral images of a region of one row corresponding to a height of the search window at every scan line when performing scanning on the image to be detected in a horizontal direction.

### Claim 7

An image processing method comprising the steps of:
scanning a search window on an image to be detected, generating integral images corresponding to a size of the search window at every scan position, and holding the integral images in a predetermined memory buffer; and
applying one or more rectangle filters for detecting a desired object to an image of the search window at each scan position, calculating one or more rectangle features using the integral images held in the memory buffer, and discriminating whether or not the object is detected based on the obtained one or more rectangle features.

### Claim 8

A computer program described in a computer-readable format such that a process of detecting a desired object from an image to be detected is executed on a computer, the computer program allowing the computer to function as:
a scanning means configured to scan a search window on the image to be detected, to generate integral images corresponding to a size of the search window at every scan position, and to hold the integral images in a predetermined memory buffer; and
a discrimination means configured to apply one or more rectangle filters for detecting the desired object to an image of the search window at each scan position, to calculate one or more rectangle features using the integral images held in the memory buffer, and to discriminate whether or not the object is detected based on the obtained one or more rectangle features.
