Scalable, accurate and reliable measure of variable dependence and independence, and utilization of the measure to train a neural network
OwnerShujian Yu, Francesco Alesianiinventors
Life of this patent
Estimating the term…
Abstract
A method for measuring dependence and independence of variables includes collecting data for the variables, computing sample Gram matrices for the variables, and computing element-wise products of the sample Gram matrices. Normalized mutual information of the variables is then computed using Renyi's α-order entropy function based on the element-wise products as an independence measure of the variables.
Claims15
A method for measuring dependence and independence of variables, the method comprising:
- collecting data for the variables;
- computing sample Gram matrices for the variables;
- computing element-wise products of the sample Gram matrices;
- and
- computing normalized mutual information of the variables using Renyi's α-order entropy function based on the element-wise products as an independence measure of the variables.
A system for measuring dependence and independence of variables comprising one or more processors which, alone or in combination, are configured to provide for execution of the following steps:
- collecting data for the variables;
- computing sample Gram matrices for the variables;
- computing element-wise products of the sample Gram matrices;
- and
- computing normalized mutual information of the variables using Renyi's α-order entropy function based on the element-wise products as an independence measure of the variables.
A tangible, non-transitory computer-readable medium having instructions thereon which, upon being executed by one or more processors, alone or in combination, provide for execution of the following steps:
- collecting data for the variables;
- computing sample Gram matrices for the variables;
- computing element-wise products of the sample Gram matrices;
- and
- computing normalized mutual information of the variables using Renyi's α-order entropy function based on the element-wise products as an independence measure of the variables.
Dependencies are inferred from the claim text.