Method for improving an autocorrector using auto-differentiation
AssigneeGeorges Harik
InventorGeorges Harik
Life of this patent
Estimating the term…
Abstract
A method and an apparatus allow learning a program that is characterized by a set of parameters. In addition to carrying out operations of the program based on an input vector and the values of the parameters, the method also carries out automatic differentiation steps over the operations of the program to compute derivatives of the output vector with respect to the parameters to any desired order. Based on the computed derivatives, the values of the parameters of the program are updated.
Claims15
A method for learning a program receiving an input vector and providing an output vector, the program being characterized by a set of parameters, comprising:
- receiving the input vector into the learning program and the values of the parameters;
- carrying out operations of the program;
- carrying out automatic differentiation over the operations of the program to compute derivatives of the output vector with respect to the parameters to a desired order;
- and
- based on the computed derivatives, updating the values of the parameters of the program.
An apparatus for learning a program that receives an input vector and provides an output vector, the program being characterized by a set of parameters, the apparatus comprising:
- one or more execution units configured for carrying out:
- operations of the program for computing the output vector, based on the input vector and the values of the a parameters;
- automatic differentiation steps over the operations of the program to compute derivatives of the output vector with respect to the parameters to a desired order;
- and
- parameter update steps, based on the computed derivatives, for updating the values of the parameters of the program.
Dependencies are inferred from the claim text.