Categorical feature enhancement mechanism for gradient boosting decision tree
AssigneeMicrosoft Technology Licensing, LLC
InventorsMohammad Zeeshan Siddiqui, Thomas Finley, Sarthak Shah
Life of this patent
Estimating the term…
Loading patent…
AssigneeMicrosoft Technology Licensing, LLC
InventorsMohammad Zeeshan Siddiqui, Thomas Finley, Sarthak Shah
Estimating the term…
A computer implemented method of generating a gradient boosting decision tree for obtaining predictions includes finding split points by sorting variable values of a feature by their gradient during training of the gradient boosting decision tree, performing a linear search to find a subset of variables with maximum split gain, and modifying a node of the gradient boosting decision tree to have multiple split points on the node for a feature as a function of the linear search. In a further example, a computer implemented method of controlling overfitting in a gradient boosting decision tree includes combining values of low population feature values into a virtual bin, fanning out the virtual bin into feature values having a low population, and including the low population feature values into multiple split points on a node of the gradient boosting decision tree.
A computer implemented method of generating a gradient boosting decision tree for obtaining predictions, the method comprising:
A machine-readable storage device having instructions for execution by a processor of a machine to cause the processor to perform operations to perform a method of improving a gradient boosting decision tree for obtaining predictions, the operations comprising:
A device comprising:
The device of 15 wherein the gradient boosting decision tree is a gradient boosting linear binary tree, and wherein during training of the gradient boosting decision tree, at a time of scoring, a logical OR is performed on multiple feature-values at a node with the input feature-value.
Dependencies are inferred from the claim text.