Fast and efficient nonlinear classifier generated from a trained linear classifier
AssigneeXerox Corporation
InventorsFlorent Perronnin, Jorge Sanchez
Life of this patent
Estimating the term…
Abstract
A classifier method comprises: projecting a set of training vectors in a vector space to a comparison space defined by a set of reference vectors using a comparison function to generate a corresponding set of projected training vectors in the comparison space; training a linear classifier on the set of projected training vectors to generate a trained linear classifier operative in the comparison space; and transforming the trained linear classifier operative in the comparison space into a trained nonlinear classifier that is operative in the vector space to classify an input vector.
Claims19
A method comprising:
- projecting a set of training vectors in a vector space to a comparison space defined by a set of reference vectors using a comparison function to generate a corresponding set of projected training vectors in the comparison space wherein the comparison function comprises a vector element comparison for each dimension of the vector space summed over the dimensions of the vector space;
- training a linear classifier on the set of projected training vectors to generate a trained linear classifier operative in the comparison space;
- and
- transforming the trained linear classifier operative in the comparison space into a trained nonlinear classifier operative in the vector space;
- wherein the projecting, the training, and the transforming are performed by a digital processing device.
A method comprising:
- projecting a set of training vectors in a vector space to a comparison space defined by a set of reference vectors using a comparison function to generate a corresponding set of projected training vectors in the comparison space;
- training a linear classifier on the set of projected training vectors to generate a trained linear classifier operative in the comparison space;
- and
- transforming the trained linear classifier operative in the comparison space into a trained nonlinear classifier operative in the vector space;
- wherein the projecting, the training, and the transforming are performed by a digital processing device;
- and
- wherein the set of reference vectors is selected from a group consisting of:
- the set of training vectors,
- the set of training vectors plus additional vectors in the vector space,
- a subset of the set of training vectors plus additional vectors in the vector space, and
- a set of vectors in the vector space that is disjoint from the set of training vectors.
A method comprising:
- projecting a set of training vectors in a vector space to a comparison space defined by a set of reference vectors using a comparison function to generate a corresponding set of projected training vectors in the comparison space;
- training a linear classifier on the set of projected training vectors to generate a trained linear classifier operative in the comparison space;
- transforming the trained linear classifier operative in the comparison space into a trained nonlinear classifier operative in the vector space;
- and
- classifying an input vector in the vector space using the trained nonlinear classifier operative in the vector space;
- wherein the projecting, the training, the transforming, and the classifying are performed by a digital processing device.
A non-transitory computer-readable storage medium encoded with instructions executable by a digital processor to perform a method comprising (i) projecting a set of training vectors in a vector space to a comparison space defined by a set of reference vectors using a comparison function comprising a vector element comparison for each dimension of the vector space summed over the dimensions of the vector space to generate a corresponding set of projected training vectors in the comparison space, (ii) training a linear classifier on the set of projected training vectors to generate a trained linear classifier operative in the comparison space, and (iii) transforming the trained linear classifier operative in the comparison space into a trained nonlinear classifier operative in the vector space, wherein the comparison function is selected from a group consisting of an L1 distance, a squared L2 distance, and a chi-squared distance.
A non-transitory computer-readable storage medium encoded with instructions executable by a digital processor to perform a method comprising (i) projecting a set of training vectors in a vector space to a comparison space defined by a set of reference vectors using a comparison function comprising a vector element comparison for each dimension of the vector space summed over the dimensions of the vector space to generate a corresponding set of projected training vectors in the comparison space, (ii) training a linear classifier on the set of projected training vectors to generate a trained linear classifier operative in the comparison space, and (iii) transforming the trained linear classifier operative in the comparison space into a trained nonlinear classifier operative in the vector space, wherein the transforming comprises determining for each dimension of the vector space a one-dimensional function based on the corresponding vector element comparison of the comparison function and trained parameters of the trained linear classifier.
A system comprising:
- a classifier training sub-system comprising a computer configured to perform a method including:
- projecting a set of training vectors in a vector space to a comparison space defined by a set of reference vectors using a comparison function comprising a vector element comparison for each dimension of the vector space summed over the dimensions of the vector space to generate a corresponding set of projected training vectors in the comparison space,
- training a linear classifier on the set of projected training vectors to generate a trained linear classifier operative in the comparison space, and
- transforming the trained linear classifier operative in the comparison space into a trained nonlinear classifier operative in the vector space by determining for each dimension of the vector space a one-dimensional function based on the corresponding vector element comparison of the comparison function and trained parameters of the trained linear classifier, wherein the transforming further includes approximating each one-dimensional function by a piecewise combination of analytical functions, the outputting applying the trained linear classifier using the approximated one-dimensional functions;
- and
- a classifier sub-system comprising a computer configured to perform a method including:
- outputting a classification based on applying the trained linear classifier to a received input vector defined in the vector space;
- wherein the system comprises one or more digital processors programmed to perform the projecting, training, transforming, and outputting operations.
Dependencies are inferred from the claim text.