# US 2012/0256947 A1 · Image processing method and image processing system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0256947 A1
- Document ID: US20120256947A1
- Status: Published application
- Kind: A1
- Application number: 13/438,249
- Filed: 2012-04-03
- Published: 2012-10-11
- Earliest claimed: 2011-04-07
- Assignees: Hitachi, Ltd.
- Inventors: Naoto AKIRA; Atsushi HIROIKE
- Web page: https://patentgrep.com/patent/US20120256947A1

## CPC

- G06V 10/421: {by analysing segments intersecting the pattern}
- G06F 16/583: using metadata automatically derived from the content
- G06F 16/93: Document management systems
- G06F 16/5838: {using colour}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An example is an image processing method including a step of acquiring data containing an image, an extraction step of extracting a first image region from the acquired data based on the type of software for generating the acquired data, an extraction step of extracting a second image region the same as or similar to each of images held in a storage unit from the acquired data by comparing the acquired data and each of the images, an extraction step of extracting a third image region the same as or similar to each of the images from the acquired data by comparing the image feature amount of the acquired data and the image feature amount of each of the images, and a step of identifying an image in the acquired data to be stored in the storage unit based on the image regions and reliabilities of the extraction steps.

## Claims

### Claim 1

An image processing method for use by an image processing system including a processor executing a program stored in a memory and a storage unit for holding a plurality of images, the image processing method comprising:
an acquisition step of acquiring, by the processor, data containing an image;
a first extraction step of extracting, by the processor, a first image region from the acquired data in accordance with a type of software used for generating the acquired data;
a second extraction step of extracting, by the processor, a second image region that is the same as or similar to each of the plurality of images held in the storage unit from the acquired data by comparing the acquired data and each of the plurality of images held in the storage unit;
a third extraction step of extracting, by the processor, a third image region that is the same as or similar to each of the plurality of images held in the storage unit from the acquired data by comparing an image feature amount of the acquired data and an image feature amount of each of the plurality of images held in the storage unit; and
a step of identifying, by the processor, an image in the acquired data to be stored in the storage unit based on the first image region, the second image region and the third image region, and reliabilities set to the first extraction step, the second extraction step and the third extraction step.

### Claim 2 (depends on 1)

The image processing method according to claim 1, wherein the step of identifying the image in the acquired data to be stored in the storage unit comprises:
calculating, by the processor, a ratio representing mutual overlaps among the first image region, the second image region and the third image region; and
identifying, by the processor, the image to be stored in the storage unit out of the first image region, the second image region, and the third image region based on the calculated ratio representing the mutual overlaps, and the reliabilities set to the first extraction step, the second extraction step and the third extraction step.

### Claim 3 (depends on 1)

The image processing method according to claim 1, wherein the first extraction step comprises:
determining, by the processor, whether the image contained in the acquired data can be extracted from the acquired data based on the type of software used for generating the acquired data; and
extracting, by the processor, the first image region from the acquired data in a case where it is determined that the image contained in the acquired data can be extracted from the acquired data.

### Claim 4 (depends on 1)

The image processing method according to claim 1, wherein the second extraction step comprises:
acquiring, by the processor, a first image showing a content of the acquired data;
generating, by the processor, a plurality of second images from the first image;
comparing, by the processor, each of the plurality of second images and each of the plurality of images held in the storage unit with each other; and
extracting, by the processor, the second image region by extracting a second image that is the same as or similar to each of the plurality of images held in the storage unit as a result of the comparing.

### Claim 5 (depends on 4)

The image processing method according to claim 4, wherein the third extraction step comprises:
calculating, by the processor, an image feature amount of the first image;
comparing, by the processor, the image feature amount of the first image and the image feature amount of each of the plurality of images held in the storage unit with each other; and
extracting, by the processor, the third image region by extracting the first image in a case where it is determined that the first image and each of the plurality of images held in the storage unit are the same as or similar to each other as a result of the comparing.

### Claim 6 (depends on 1)

The image processing method according to claim 1, wherein:
the image processing system further comprises:
a display unit for displaying the first image region, the second image region, and the third image region to a user; and
an input unit for enabling the user to select any image region out of the first image region, the second image region, and the third image region, which are displayed on the display unit;
the storage unit further holds a reliability allocated to each of the plurality of held images, and a plurality of pieces of data each containing each of the plurality of held images; and
the image processing method comprises:
enabling, by the processor, the user to select an image region out of the first image region, the second image region, and the third image region by means of the display unit and the input unit;
searching, by the processor, the plurality of images held in the storage unit for an image that is the same as or similar to the selected image region;
extracting, by the processor, a piece of data containing an image found in the searching from the plurality of pieces of data; and
increasing, by the processor, a reliability allocated to the image found in the searching.

### Claim 7

An image processing system, comprising:
a processor executing a program stored in a memory; and
a storage unit for holding a plurality of images,
the processor being configured to:
acquire data containing an image;
extract, in a first extraction step, a first image region from the acquired data in accordance with a type of software used for generating the acquired data;
extract, in a second extraction step, a second image region that is the same as or similar to each of the plurality of images held in the storage unit from the acquired data by comparing the acquired data and each of the plurality of images held in the storage unit;
extract, in a third extraction step, a third image region that is the same as or similar to each of the plurality of images held in the storage unit from the acquired data by comparing an image feature amount of the acquired data and an image feature amount of each of the plurality of images held in the storage unit; and
identify an image in the acquired data to be stored in the storage unit based on the first image region, the second image region and the third image region, and reliabilities set to the first extraction step, the second extraction step and the third extraction step.

### Claim 8 (depends on 7)

The image processing system according to claim 7, wherein the processor is further configured to:
calculate a ratio representing mutual overlaps among the first image region, the second image region and the third image region; and
identify the image in the acquired data to be stored in the storage unit out of the first image region, the second image region and the third image region based on the calculated ratio representing the mutual overlaps, and the reliabilities set to the first extraction step, the second extraction step and the third extraction step.

### Claim 9 (depends on 7)

The image processing system according to claim 7, wherein the processor is further configured to:
determine whether the image can be extracted from the acquired data based on the type of software used for generating the acquired data; and
extract the first image region from the acquired data in a case where it is determined that the image can be extracted from the acquired data.

### Claim 10 (depends on 7)

The image processing system according to claim 7, wherein the processor is further configured to:
acquire a first image showing a content of the acquired data;
generate a plurality of second images from the first image;
compare each of the plurality of second images and each of the plurality of images held in the storage unit with each other; and
extract the second image region by extracting a second image that is the same as or similar to each of the plurality of images held in the storage unit as a result of the comparison.

### Claim 11 (depends on 10)

The image processing system according to claim 10, wherein the processor is further configured to:
calculate an image feature amount of the first image;
compare the image feature amount of the first image and the image feature amount of each of the plurality of images held in the storage unit with each other; and
extract the third image region by extracting the first image in a case where it is determined that the first image and each of the plurality of images held in the storage unit are the same as or similar to each other as a result of the comparison.

### Claim 12 (depends on 7)

The image processing system according to claim 7, wherein:
the image processing system further comprises:
a display unit for displaying the first image region, the second image region, and the third image region to a user; and
an input unit for enabling the user to select any image region out of the first image region, the second image region and the third image region displayed on the display unit;
the storage unit further holds a reliability allocated to each of the plurality of held images, and a plurality of pieces of data each containing each of the plurality of held images; and
the processor is further configured to:
enable the user to select an image region out of the first image region, the second image region and the third image region by means of the display unit and the input unit;
search the plurality images held in the storage unit for an image that is the same as or similar to the selected image region;
extract a piece of data containing an image found in the search from the plurality of pieces of data; and
increase a reliability allocated to the image found in the search.
