# US 2025/0384355 A1 · Method and system for recursive ensemble feature selection using explainable artificial intelligence

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0384355 A1
- Document ID: US20250384355A1
- Status: Published application
- Kind: A1
- Application number: 19/240,308
- Filed: 2025-06-17
- Published: 2025-12-18
- Earliest claimed: 2024-06-18
- Assignees: Tata Consultancy Services Limited
- Applicants: Tata Consultancy Services Limited
- Inventors: Tanmaya SINGHAL; Junaid GUL; Vishal Sudam JADHAV; Venkataramana RUNKANA
- Web page: https://patentgrep.com/patent/US20250384355A1

## CPC

- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06N 20/20: Ensemble learning
- G06N 5/045: Explanation of inference; Explainable artificial intelligence [XAI]; Interpretable artificial intelligence
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

The embodiments of the present disclosure herein address unresolved limitations in handling feature selection, inadequacies in capturing nonlinear relationships, issues related to interpretability in Artificial Intelligence (AI) models, and a lack of adaptability to the dynamic nature of industrial environments. Embodiments herein provide a method and system for a recursive ensemble feature selection using an explainable artificial intelligence (XAI). The method begins with a thorough digital modelling process, where the careful selection of features and identification of optimal time lags take precedence. By utilizing XAI techniques, the system ensures a transparent and interpretable selection of features and time lags. This method forms a robust foundation for subsequent forecasting model development tailored to specific datasets. The infusion of XAI into the feature selection and time lag identification stages enhances the accuracy of forecasting models while providing clear insights into the factors influencing predictions.

## Claims

### Claim 1

A processor-implemented method comprising:
collecting, via an Input/Output (I/O) interface, a real-time data from an array of sensors, lab measurements, an environmental data, and one or more predefined instruments distributed throughout a predefined operational setup, and a historical data from a predefined database, wherein the collected data includes a plurality of features and at least one target variable of the operational setup;
pre-processing, via one or more hardware processors, the collected real-time and historical data to remove one or more outliers, impute one or more missing values and a resampling;
training, via the one or more hardware processors, a plurality of machine learning models on the pre-processed collected data using a hyperparameter tuning technique for predicting the at least one target variable of the operational setup;
identifying, via the one or more hardware processors, at least one trained machine learning model from the plurality of trained machine learning models using a predefined model performance metrics;
calculating, via the one or more hardware processors, a contribution score for each of the plurality of features to assess an impact of each of the plurality of features on the identified at least one trained machine learning model using at least one explainable features contribution technique;
combining, via the one or more hardware processors, the calculated contribution score for each of the plurality of features for the identified at least one trained machine learning model to obtain an ensemble contribution score for each of the plurality of features using a predefined ensemble technique;
ranking, via the one or more hardware processors, the plurality of features based on the obtained ensemble contribution score to determine an order of importance for each of the plurality of features;
grouping, via the one or more hardware processors, the ranked plurality of features into one or more groups based on a temporal and spatial proximity;
eliminating iteratively, via the one or more hardware processors, at least one feature from the plurality of features to get an updated set of features, wherein the eliminating iteratively:
at least one feature of the plurality of features having the obtained ensemble contribution score less than a predefined threshold score; and
at least one group of the one or more groups if number of features in the at least one group having the obtained ensemble contribution score less than a predefined threshold ensemble contribution score is greater than a pre-defined group level threshold;
retraining recursively, via the one or more hardware processors, the at least one identified machine learning model with the updated set of features from each iteration of feature elimination till an optimal feature set is obtained based on one or more pre-defined performance metric for predicting the at least one target variable of the operational setup.

### Claim 2 (depends on 1)

The processor-implemented method of claim 1, wherein a plurality of hyperparameter tuning techniques include a grid search, a randomized search, and a Bayesian grid search.

### Claim 3 (depends on 1)

The processor-implemented method of claim 1, wherein the at least one explainable feature contribution technique includes Shapley (SHAP), Local Interpretable Model-Agnostic Explanations (LIME), and Deep Learning Important Features (DeepLIFT).

### Claim 4 (depends on 1)

The processor-implemented method of claim 1, wherein the one or more predefined ensemble techniques include a weighted average, a log rank average, and a simple means of contribution score.

### Claim 5 (depends on 1)

The processor-implemented method of claim 1, wherein a recursive elimination may stop when the one or more iterations crosses a pre-defined patience value without changes in the one or more pre-defined performance metric above the pre-defined tolerance.

### Claim 6

A system comprising:
an input/output interface to collect a real-time data from an array of sensors, lab measurements, an environmental data, and one or more predefined instruments distributed throughout a predefined operational setup, and a historical data from a predefined database, wherein the collected data includes a plurality of features and at least one target variable of the operational setup;
one or more hardware processors;
a memory in communication with the one or more hardware processors, wherein the one or more hardware processors are configured to execute programmed instructions stored in the memory to:
pre-process the collected real-time and historical data to remove one or more outliers, impute one or more missing values and a resampling;
train a plurality of machine learning models on the pre-processed collected data using a hyperparameter tuning technique for predicting the at least one target variable of the operational setup;
identify at least one trained machine learning model from the plurality of trained machine learning models using a predefined model performance metrics;
calculate a contribution score for each of the plurality of features to assess an impact of each of the plurality of features on the identified at least one trained machine learning model using at least one explainable features contribution technique;
combine the calculated contribution score for each of the plurality of features for the identified at least one trained machine learning model to obtain an ensemble contribution score for each of the plurality of features using a predefined ensemble technique;
rank the plurality of features based on the obtained ensemble contribution score to determine an order of importance for each of the plurality of features;
group the ranked plurality of features into one or more groups based on a temporal and spatial proximity;
eliminate at least one feature from the plurality of features to get an updated set of features, wherein eliminating iteratively:
at least one feature of the plurality of features having the obtained ensemble contribution score less than a predefined threshold score; and
at least one group of the one or more groups if number of features in the at least one group having the obtained ensemble contribution score less than a predefined threshold ensemble contribution score is greater than a pre-defined group level threshold;
recursively retraining the at least one identified machine learning model with the updated set of features from each iteration of feature elimination till an optimal feature set is obtained based on one or more pre-defined performance metric for predicting the at least one target variable of the operational setup.

### Claim 7 (depends on 6)

The system of claim 6, wherein a plurality of hyperparameter tuning techniques include a Grid search, a randomized search, and a Bayesian grid search.

### Claim 8 (depends on 6)

The system of claim 6, wherein the at least one explainable features contribution technique includes Shapley (SHAP), Local Interpretable Model-Agnostic Explanations (LIME), and Deep Learning Important Features (DeepLIFT).

### Claim 9 (depends on 6)

The system of claim 6, wherein one or more predefined ensemble techniques include a weighted average, a log rank average, and a simple means of contribution score.

### Claim 10 (depends on 6)

The system of claim 6, wherein a recursive elimination stops when the one or more iterations crosses a pre-defined patience value without changes in one or more pre-defined performance metric above a pre-defined tolerance.

### Claim 11

One or more non-transitory machine-readable information storage mediums comprising one or more instructions which when executed by one or more hardware processors cause:
collecting, via an Input/Output (I/O) interface, a real-time data from an array of sensors, lab measurements, an environmental data, and one or more predefined instruments distributed throughout a predefined operational setup, and a historical data from a predefined database, wherein the collected data includes a plurality of features and at least one target variable of the operational setup;
pre-processing the collected real-time and historical data to remove one or more outliers, impute one or more missing values and a resampling;
training, a plurality of machine learning models on the pre-processed collected data using a hyperparameter tuning technique for predicting the at least one target variable of the operational setup;
identifying at least one trained machine learning model from the plurality of trained machine learning models using a predefined model performance metrics;
calculating, a contribution score for each of the plurality of features to assess an impact of each of the plurality of features on the identified at least one trained machine learning model using at least one explainable features contribution technique;
combining, the calculated contribution score for each of the plurality of features for the identified at least one trained machine learning model to obtain an ensemble contribution score for each of the plurality of features using a predefined ensemble technique;
ranking, the plurality of features based on the obtained ensemble contribution score to determine an order of importance for each of the plurality of features;
grouping, the ranked plurality of features into one or more groups based on a temporal and spatial proximity;
eliminating iteratively, at least one feature from the plurality of features to get an updated set of features, wherein the eliminating iteratively:
at least one feature of the plurality of features having the obtained ensemble contribution score less than a predefined threshold score; and
at least one group of the one or more groups if number of features in the at least one group having the obtained ensemble contribution score less than a predefined threshold ensemble contribution score is greater than a pre-defined group level threshold;
retraining recursively, the at least one identified machine learning model with the updated set of features from each iteration of feature elimination till an optimal feature set is obtained based on one or more pre-defined performance metric for predicting the at least one target variable of the operational setup.

### Claim 12 (depends on 11)

The one or more non-transitory machine-readable information storage mediums of claim 11, wherein a plurality of hyperparameter tuning techniques include a grid search, a randomized search, and a Bayesian grid search.

### Claim 13 (depends on 11)

The one or more non-transitory machine-readable information storage mediums of claim 11, wherein the at least one explainable feature contribution technique includes Shapley (SHAP), Local Interpretable Model-Agnostic Explanations (LIME), and Deep Learning Important Features (DeepLIFT).

### Claim 14 (depends on 11)

The one or more non-transitory machine-readable information storage mediums of claim 11, wherein the one or more predefined ensemble techniques include a weighted average, a log rank average, and a simple means of contribution score.

### Claim 15 (depends on 11)

The one or more non-transitory machine-readable information storage mediums of claim 11, wherein a recursive elimination may stop when the one or more iterations crosses a pre-defined patience value without changes in the one or more pre-defined performance metric above the pre-defined tolerance.
