# US 2015/0146989 A1 · Image processing apparatus, image processing method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0146989 A1
- Document ID: US20150146989A1
- Status: Published application
- Kind: A1
- Application number: 14/552,116
- Filed: 2014-11-24
- Published: 2015-05-28
- Earliest claimed: 2013-11-26
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Hirotaka Shiiyama; Masahiro Matsushita
- Web page: https://patentgrep.com/patent/US20150146989A1

## CPC

- G06V 10/464: {using a plurality of salient features, e.g. bag-of-words [BoW] representations}
- G06V 10/462: {Salient features, e.g. scale invariant feature transforms [SIFT]}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An image processing method includes acquiring the number of feature vectors similar to at least one specific feature vector, including the at least one specific feature vector, among feature vectors of a plurality of keypoints in a comparison source image, and the number of feature vectors similar to the at least one specific feature vector in at least one comparison destination image, and comparing the comparison source image with the at least one comparison destination image by using, as a value for evaluating a similarity between the comparison source image and the at least one comparison destination image, a smaller value instead of a larger value of the numbers of feature vectors acquired with respect to the at least one specific feature vector.

## Claims

### Claim 1

An image processing apparatus comprising:
an acquisition unit configured to acquire the number of feature vectors similar to at least one specific feature vector, including the at least one specific feature vector, among feature vectors of a plurality of keypoints in a comparison source image, and to acquire the number of feature vectors similar to the at least one specific feature vector in at least one comparison destination image; and
a comparison unit configured to compare the comparison source image with the at least one comparison destination image by using, as a value for evaluating a similarity between the comparison source image and the at least one comparison destination image, a smaller value instead of a larger value of the numbers of feature vectors acquired in the comparison source image and in the at least one comparison destination image with respect to the at least one specific feature vector.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein the comparison unit uses, as a value for evaluating the similarity between the comparison source image and the at least one comparison destination image, at least one of the smaller value of the acquired numbers of feature vectors, an average value of the acquired numbers of feature vectors, and a predetermined value.

### Claim 3 (depends on 1)

The image processing apparatus according to claim 1, wherein, when a difference between the number of feature vectors in the comparison source image acquired by the acquisition unit and the number of feature vectors in the at least one comparison destination image acquired by the acquisition unit exceeds a predetermined threshold value, the comparison unit omits comparison processing in which a value obtained from the acquired numbers of feature vectors is used as a similarity evaluation value.

### Claim 4 (depends on 1)

The image processing apparatus according to claim 1, wherein the comparison unit casts at least one vote for the similarity evaluation value for the at least one comparison destination image, and compares the comparison source image with the at least one comparison destination image based on the number of votes.

### Claim 5 (depends on 1)

The image processing apparatus according to claim 1, wherein, for each of a plurality of types of specific feature vectors, the acquisition unit acquires the number of feature vectors similar to a specific feature vector in the comparison source image, and the number of feature vectors similar to the specific feature vector in the at least one comparison destination image, and
wherein the comparison unit accumulates the similarity evaluation value for each of the plurality of types of specific feature vectors, and compares the comparison source image with the at least one comparison destination image.

### Claim 6 (depends on 1)

The image processing apparatus according to claim 1, further comprising
a quantization unit configured to relate quantization values of the feature vectors with segmentalized areas in a feature vector space,
wherein the acquisition unit acquires the number of feature vectors of a quantization value in the comparison source image, associated with a first area associated with the quantization value of a first feature vector in the comparison source image, and acquires a sum total of the number of feature vectors of a quantization value in the at least one comparison destination image, associated with the first area, and the number of feature vectors of quantization values associated with neighboring areas of the first area.

### Claim 7 (depends on 6)

The image processing apparatus according to claim 6, wherein the acquisition unit acquires the sum total of the number of feature vectors of quantization values, associated with the first area and the neighboring areas of the first area, and the number of feature vectors is weighted depending on which area they belong to.

### Claim 8 (depends on 6)

The image processing apparatus according to claim 6, wherein the acquisition unit acquires the number of feature vectors of a quantization value in the comparison source image, associated with a second area that is one or more feature vectors of the quantization value in the comparison source image, and acquires the sum total of the number of feature vectors of a quantization value in the at least one comparison destination image, associated with the second area and the number of feature vectors of quantization values associated with neighboring areas of the second area.

### Claim 9 (depends on 1)

The image processing apparatus according to claim 1, wherein the at least one comparison destination image comprises a plurality of comparison destination images and the comparison unit compares the plurality of the comparison destination images with the comparison source image, and
wherein the image processing apparatus further comprises a determination unit configured to determine an order of the plurality of the comparison destination images based on the similarity evaluation value.

### Claim 10 (depends on 9)

The image processing apparatus according to claim 9, further comprising
a display control unit configured to perform control to display the plurality of comparison destination images according to the order determined by the determination unit.

### Claim 11

An image processing method comprising:
acquiring the number of feature vectors similar to at least one specific feature vector, including the at least one specific feature vector, among feature vectors of a plurality of keypoints in a comparison source image, and the number of feature vectors similar to the specific feature vector in at least one comparison destination image; and
comparing the comparison source image with the at least one comparison destination image by using, as a value for evaluating a similarity between the comparison source image and the at least one comparison destination image, a smaller value instead of a larger value of the numbers of feature vectors acquired with respect to the at least one specific feature vector.

### Claim 12

A non-transitory computer-readable medium storing a computer program comprising code, which when executed by a computer, causes the computer to perform the steps of:
acquiring the number of feature vectors similar to at least one specific feature vector, including the at least one specific feature vector, among feature vectors of a plurality of keypoints in a comparison source image, and the number of feature vectors similar to the at least one specific feature vector in at least one comparison destination image; and
comparing the comparison source image with the at least one comparison destination image by using, as a value for evaluating a similarity between the comparison source image and the at least one comparison destination image, a smaller value instead of a larger value of the numbers of feature vectors acquired with respect to the at least one specific feature vector.
