# US 2014/0207764 A1 · Dynamic feature selection with max-relevancy and minimum redundancy criteria

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0207764 A1
- Document ID: US20140207764A1
- Status: Published application
- Kind: A1
- Application number: 13/745,923
- Filed: 2013-01-21
- Published: 2014-07-24
- Earliest claimed: 2013-01-21
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: David Haws; Dan He; Laxmi P. Parida
- Web page: https://patentgrep.com/patent/US20140207764A1

## CPC

- G06F 16/90335: {Query processing}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Various embodiments select features from a feature space. In one embodiment a set of features and a class value are received. A redundancy score is obtained for a feature that was previously selected from the set of features. A redundancy score is determined, for each of a plurality of unselected features in the set of features, based on the redundancy score that has been obtained, and a redundancy between the unselected feature and the feature that was previously selected. A relevance to the class value is determined for each of the unselected features. A feature from the plurality of unselected features with a highest relevance to the class value and a lowest redundancy score is selected.

## Claims

### Claim 1

A computer implemented method for selecting features from a feature space, the computer implemented method comprising:
receiving, by a processor, a set of features and a class value;
obtaining a redundancy score for a feature that was previously selected from the set of features;
determining, for each of a plurality of unselected features in the set of features, a redundancy score based on the redundancy score that has been obtained, and a redundancy between the unselected feature and the feature that was previously selected;
determining, for each of the unselected features, a relevance to the class value; and
selecting a feature from the plurality of unselected features with a highest relevance to the class value and a lowest redundancy score.

### Claim 2 (depends on 1)

The computer implemented method of claim 1, wherein the redundancy score for the feature that was previously selected from the set of features is obtained based on:
redundancy′=(I(xj:c)−score(xj)m-1)×(m−2),I(xj:c),
where redundancy′ is the redundancy score for the feature that was previously selected, I(xj:c) is a relevance between feature and the class value c based on mutual information I, score(xj)m-1 is a maximum-relevancy and minimum-redundancy (MRMR) score calculated for feature xj at a previous step m−1, and m−2 is a normalizing factor for the previous step m−1.

### Claim 3 (depends on 2)

The computer implemented method of claim 2, wherein score(xj)m-1 is determined based on:
x
j
∈
X
-
S
m
-
2
[
I

(
x
j
;
c
)
-
1
m
-
2

∑
x
i
∈
S
m
-
2


I

(
x
j
;
x
i
)
]
,
where X is the set of features and xi is a feature in the set S of m−2 features.

### Claim 4 (depends on 3)

The computer implemented method of claim 3, wherein the redundancy score, for each of the plurality of unselected features in the set of features, is determined based on:
redundancy″=redundancy′+I(xj;xm-1),
where redundancy″ is the determined redundancy score, and xm-1 is a feature selected in the previous step m−1.

### Claim 5 (depends on 1)

The computer implemented method of claim 1, wherein determining, for each of the unselected features, the relevance to the class value is based on mutual information between the unselected feature and the class value.

### Claim 6 (depends on 1)

The computer implemented method of claim 1, wherein the receiving comprises:
receiving at least one training sample comprising the set of features and the class value; and
receiving at least one test sample comprising the set of features absent the class value.

### Claim 7 (depends on 6)

The computer implemented method of claim 6, wherein the redundancy score, for each of a plurality of unselected features, is determined based on the at least one training sample and the at least one test sample, and
wherein the relevance determined, for each of the unselected features, is determined based on the at least one training sample.

### Claim at position 8

8-20. (canceled)
