# US 2006/0067591 A1 · Method and system for classifying image orientation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2006/0067591 A1
- Document ID: US20060067591A1
- Status: Published application
- Kind: A1
- Application number: 11/234,286
- Filed: 2005-09-26
- Published: 2006-03-30
- Earliest claimed: 2004-09-24
- Inventors: John Guzzwell; Edythe LeFeuvre; Rodney Hale; Douglas Pittman
- Web page: https://patentgrep.com/patent/US20060067591A1

## CPC

- G06T 7/73: using feature-based methods
- G06V 10/242: {by image rotation, e.g. by 90 degrees}
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06V 40/161: {Detection; Localisation; Normalisation}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The invention relates to a method, system and computer program product for identifying an orientation of an image having a plurality of features. It comprises (a) defining a plurality of feature kinds, wherein each feature in the plurality of features corresponds to an associated feature kind in the plurality of feature kinds; (b) providing a feature kind classification order for ordering the plurality of feature kinds; (c) searching the image to identify a feature set in the plurality of features in the image based on the feature kind classification order, wherein the feature set comprises at least one feature and each feature in the feature set corresponds to a defining feature kind; and (d) classifying the feature set to determine the orientation of the image.

## Claims

### Claim 1

A method of identifying an orientation of an image having a plurality of features, the method comprising:
a) defining a plurality of feature kinds, wherein each feature in the plurality of features corresponds to an associated feature kind in the plurality of feature kinds;
b) providing a feature kind classification order for ordering the plurality of feature kinds;
c) searching the image to identify a feature set in the plurality of features in the image based on the feature kind classification order, wherein the feature set comprises at least one feature and each feature in the feature set corresponds to a defining feature kind; and
d) classifying the feature set to determine the orientation of the image.

### Claim 2 (depends on 1)

The method as defined in claim 1 wherein step d) comprises classifying the image based on the defining feature kind to determine the orientation of the image.

### Claim 3 (depends on 1)

The method as defined in claim 1 wherein, when the plurality of features comprises, in addition to the feature set, at least one remaining feature corresponding to at least one associated feature kind different from the defining feature kind for each feature in the feature set,
the associated defining feature kind for the feature set precedes each of the at least one associated feature kind in the feature kind classification order.

### Claim 4 (depends on 3)

The method as defined in claim 3 wherein step c) comprises searching the image for each feature kind in the plurality of feature kinds based on the feature kind classification order until the feature set is identified and then ceasing searching.

### Claim 5 (depends on 3)

The method as defined in claim 3 wherein step c) comprises i) searching the image to identify the plurality of features in the image, and then ii) determining the feature set in the plurality of features based on the feature kind classification order.

### Claim 6 (depends on 3)

The method as defined in claim 3 further comprising providing a plurality of feature templates corresponding to the plurality of feature kinds in the image, wherein step d) comprises classifying the image based on a feature template in the plurality of feature templates corresponding to the feature set.

### Claim 7 (depends on 6)

The method as defined in claim 6 wherein, for each feature kind in the plurality of feature kinds, the corresponding feature template comprises a plurality of feature records at a plurality of stored orientations, each feature record corresponding to a stored orientation.

### Claim 8 (depends on 7)

The method as defined in claim 7 wherein step d) comprises
classifying the image to determine the orientation of the image by comparing the image to the plurality of feature records in the corresponding feature template to determine a closest feature record in the plurality of feature records; and,
determining the orientation of the image to be a stored orientation for a closest feature record.

### Claim 9 (depends on 1)

The method as defined in claim 1 wherein step c) comprises resizing the image before searching the image to identify the feature set.

### Claim 10 (depends on 1)

The method as defined in claim 1 wherein the plurality of feature kinds comprises at least two of i) a sky kind, ii) a flash kind, iii) an eye kind, iv) an upper face kind and v) a line kind.

### Claim 11

A system for identifying an orientation of an image having a plurality of features, the system comprising:
a memory for storing (i) the image; and (ii) a plurality of feature kinds, wherein each feature in the plurality of features corresponds to an associated feature kind in the plurality of feature kinds;
means for performing the steps of
a) accessing a feature kind classification order for ordering the plurality of feature kinds;
b) searching the image to identify a feature set in the plurality of features in the image based on the feature kind classification order, wherein the feature set comprises at least one feature and each feature in the feature set corresponds to a defining feature kind; and
c) classifying the feature set to determine the orientation of the image.

### Claim 12 (depends on 11)

The system as defined in claim 11 wherein step c) comprises classifying the image based on the defining feature kind to determine the orientation of the image.

### Claim 13 (depends on 11)

The system as defined in claim 11, wherein, when the plurality of features comprises, in addition to the feature set, at least one remaining feature corresponding to at least one associated feature kind different from the defining feature kind for each feature in the feature set,
the associated defining feature kind for the feature set precedes each of the at least one associated feature kind in the feature kind classification order.

### Claim 14 (depends on 13)

The system as defined in claim 13 wherein step b) comprises searching the image for each feature kind in the plurality of feature kinds based on the feature kind classification order until the feature set is identified and then ceasing searching.

### Claim 15 (depends on 13)

The system as defined in claim 13 wherein step b) comprises i) searching the image to identify the plurality of features in the image, and then ii) determining the feature set in the plurality of features based on the feature kind classification order.

### Claim 16 (depends on 13)

The system as defined in claim 13 further comprising providing a plurality of feature templates corresponding to the plurality of feature kinds in the image stored on the memory, wherein step c) comprises classifying the image based on a feature template in the plurality of feature templates corresponding to the feature set.

### Claim 17 (depends on 16)

The system as defined in claim 16 wherein, for each feature kind in the plurality of feature kinds, the corresponding feature template comprises a plurality of feature records at a plurality of stored orientations, each feature record corresponding to a stored orientation.

### Claim 18 (depends on 17)

The system as defined in claim 17 wherein step c) comprises
classifying the image to determine the orientation of the image by comparing the image to the plurality of feature records in the corresponding feature template to determine a closest feature record in the plurality of feature records; and,
determining the orientation of the image to be a stored orientation for a closest feature record.

### Claim 19 (depends on 11)

The system as defined in claim 11 wherein step b) comprises resizing the image before searching the image to identify the feature set.

### Claim 20 (depends on 11)

The system as defined in claim 11 wherein the plurality of feature kinds comprises at least two of i) a sky kind, ii) a flash kind, iii) an eye kind, iv) an upper face kind and v) a line kind.

### Claim 21 (depends on 11)

The system as defined in claim 11, further comprising
a display for displaying one or more images; and
input means for selecting an image for which an orientation is identified.

### Claim 22

A computer program product for use on a computer system for identifying an orientation of an image having a plurality of features, the computer program product comprising:
a recording medium for recording (i) a plurality of feature kinds, wherein each feature in the plurality of features corresponds to an associated feature kind in the plurality of feature kinds; and (ii) means for instructing the computer system to perform the steps of:
a) accessing a feature kind classification order for ordering the plurality of feature kinds;
b) searching the image to identify a feature set in the plurality of features in the image based on the feature kind classification order, wherein the feature set comprises at least one feature and each feature in the feature set corresponds to a defining feature kind; and
c) classifying the feature set to determine the orientation of the image.

### Claim 23 (depends on 22)

The computer program product as defined in claim 22 wherein step c) comprises classifying the image based on the defining feature kind to determine the orientation of the image.

### Claim 24 (depends on 22)

The computer program product as defined in claim 22, wherein, when the plurality of features comprises, in addition to the feature set, at least one remaining feature corresponding to at least one associated feature kind different from the defining feature kind for each feature in the feature set,
the associated defining feature kind for the feature set precedes each of the at least one associated feature kind in the feature kind classification order.

### Claim 25 (depends on 24)

The computer program product as defined in claim 24 wherein step b) comprises searching the image for each feature kind in the plurality of feature kinds based on the feature kind classification order until the feature set is identified and then ceasing searching.

### Claim 26 (depends on 24)

The computer program product as defined in claim 24 wherein step b) comprises i) searching the image to identify the plurality of features in the image, and then ii) determining the feature set in the plurality of features based on the feature kind classification order.

### Claim 27 (depends on 24)

The computer program product as defined in claim 24 further comprising providing a plurality of feature templates corresponding to the plurality of feature kinds in the image, wherein step c) comprises classifying the image based on a feature template in the plurality of feature templates corresponding to the feature set.

### Claim 28 (depends on 27)

The computer program product as defined in claim 27 wherein, for each feature kind in the plurality of feature kinds, the corresponding feature template comprises a plurality of feature records at a plurality of stored orientations, each feature record corresponding to a stored orientation.

### Claim 29 (depends on 28)

The computer program product as defined in claim 28 wherein step c) comprises
classifying the image to determine the orientation of the image by comparing the image to the plurality of feature records in the corresponding feature template to determine a closest feature record in the plurality of feature records; and,
determining the orientation of the image to be a stored orientation for a closest feature record.

### Claim 30 (depends on 22)

The computer program product as defined in claim 22 wherein step b) comprises resizing the image before searching the image to identify the feature set.

### Claim 31 (depends on 22)

The computer program product as defined in claim 22 wherein the plurality of feature kinds comprises at least two of i) a sky kind, ii) a flash kind, iii) an eye kind, iv) an upper face kind and v) a line kind.
