# US 2009/0276385 A1 · Artificial-Neural-Networks Training Artificial-Neural-Networks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2009/0276385 A1
- Document ID: US20090276385A1
- Status: Published application
- Kind: A1
- Application number: 12/431,589
- Filed: 2009-04-28
- Published: 2009-11-05
- Earliest claimed: 2008-04-30
- Inventors: Stanley Hill
- Web page: https://patentgrep.com/patent/US20090276385A1

## CPC

- G06N 3/08: Learning methods
- G06N 3/0499: Feedforward networks
- G06N 3/09: Supervised learning
- G06N 3/0985: Hyperparameter optimisation; Meta-learning; Learning-to-learn
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A method of training an artificial-neural-network includes applying a training algorithm to a first artificial-neural-network using a first training set to generate a sequence of weight values associated with a connection in the first artificial-neural-network. The method also includes training a second artificial-neural-network to generate a weight value, where the training utilizes a second training set. The second training set includes the generated sequence of weight values associated with the connection in the first artificial-neural-network. A system includes a first artificial-neural-network including a plurality of connections, where each connection is associated with a weight value. The system also includes a second artificial-neural-network including a plurality of outputs, where each output generates the weight value associated with one connection of the plurality of connections in the first artificial-neural-network during a training of the first artificial-neural-network.

## Claims

### Claim 1

A method comprising:
applying a training algorithm to a first artificial-neural-network using a first training set to generate a sequence of weight values associated with a connection in the first artificial-neural-network; and
training a second artificial-neural-network to generate a weight value, wherein the training utilizes a second training set including the generated sequence of weight values associated with the connection in the first artificial-neural-network.

### Claim 2 (depends on 1)

The method of claim 1, wherein the applying a training algorithm comprises:
applying a backpropagation algorithm.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
generating a plurality of sequences of weight values, wherein each sequence of the plurality of sequences of weight values is associated with a connection in the first artificial-neural-network; and
training the second artificial-neural-network to generate a plurality of output values, wherein each output value corresponds to a weight value associated with a connection in the first artificial-neural-network.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
applying a training algorithm to a third artificial-neural-network using a third training set to produce a sequence of weight values associated with a connection in the third artificial-neural-network, wherein the second training set includes the produced sequence of weight values associated with the connection in the third artificial-neural-network.

### Claim 5

A method comprising:
training a first artificial-neural-network by using outputs generated by a second artificial-neural-network as weight values for connections in the first artificial-neural-network.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
applying a training algorithm to the first artificial-neural-network to generate a plurality of sequences of weight values associated with each of the connection in the first artificial-neural-network; and
inputting the plurality of generated sequences of weight values associated with the connections in the first artificial-neural-network into the second artificial-neural-network to generate the outputs used as weight values for the connections in the first artificial-neural-network.

### Claim 7

A system comprising:
a first artificial-neural-network including a plurality of connections, wherein each connection is associated with a weight value; and
a second artificial-neural-network including a plurality of outputs, wherein each output generates the weight value associated with one connection of the plurality of connections in the first artificial-neural-network during a training of the first artificial-neural-network.

### Claim 8 (depends on 7)

The system according to claim 7, wherein the second artificial-neural-network comprises:
a plurality of inputs, wherein each connection in the plurality of connections in the first artificial-neural-network corresponds to a particular number of the plurality of inputs of the second artificial-neural-network.

### Claim 9 (depends on 8)

The system according to claim 8, wherein each particular number of the plurality of inputs of the second artificial-neural-network corresponding to a connection in the first artificial-neural-network is configured to receive a sequence of weight values associated with the connection in the first artificial-neural-network.
