Multi-modal neural network for universal, online learning

A neural network, comprising:

• a first set of neural nodes, wherein each node comprises multiple neuron populations including multiple neurons;
• a second set of neural nodes, wherein each node of the second set is a union of at least two nodes of the first set;
• and
• an interconnect network comprising multiple directed edges that connect neuron in nodes of the first set with neurons in nodes of the second set, such that a connected node of the second set exchanges signals with at least two nodes of the first set via the interconnect network;
• wherein nodes of the first and second set are arranged in a lattice;
• and
• wherein each neuron generates a firing signal in response to input signals from one or more other neurons via the interconnect network.

A computer program product on a computer-readable medium for cross-associating signaling in a neural network comprising a plurality of neural nodes connected via an interconnect network comprising bottom-up signaling pathways and top-down signaling pathways arranged in a lattice, wherein each node has a sensory-motor modality and generates a signal in response to input signals received from one or more other nodes via the interconnect network, the computer program product comprising instructions which when executed on a computer cause the computer to perform operations including:

• connecting a plurality of first nodes in a first set of nodes with a plurality of second nodes in a second set of nodes, such that a connected node in the second set exchanges signals with at least two nodes in the first set via the interconnect network;
• for a node comprising one or more neuron populations, interconnecting the neuron populations within said node via multiple directed edges arranged in an acyclic digraph, wherein each neuron population comprises one or more neurons, and each edge includes a signaling pathway in the interconnect network;
• interconnecting said plurality of neural nodes via bottom-up signaling pathways arranged in an acyclic bottom-up digraph in the interconnect network, each bottom-up signaling pathway including one or more neuron populations and directed edges;
• interconnecting said plurality of neural nodes via top-down signaling pathways arranged in an acyclic top-down digraph in the interconnect network, each top-down signaling pathway including one or more neuron populations and directed edges, wherein each neuron population in the top-down digraph corresponds to a neuron population in the bottom-up digraph, wherein each top-down signaling pathway in the top-down digraph has a reciprocal bottom-up signaling pathway in the bottom-up digraph, such that information flows along said top-down signaling pathway in a first direction, and information flows along said reciprocal bottom-up signaling pathway in a direction opposite of the first direction;
• designating a neuron population at an input periphery of the neural network as an input neuron population configured to receive sensory input, wherein the input neuron population drives neurons along a number of bottom-up signaling pathways;
• a first set of neurons along bottom-up signaling pathways driving a first set of neurons along top-down signaling pathways;
• designating a neuron population at an output periphery of the neural network as an output neuron population configured to generate motor output, wherein neurons along a number of top-down signaling pathways drive the output neuron population;
• training each neuron along a bottom-up signaling pathway using a learning rule based on the firing events of said neuron and the firing events of the corresponding neuron along a reciprocal top-down signaling pathway;
• training each neuron along a top-down signaling pathway using a learning rule based on the firing events of said neuron and the firing events of the corresponding neuron along a reciprocal bottom-up signaling pathway;
• and
• interconnecting neuron populations in the bottom-up digraph to neuron populations in the top-down digraph using additional directed edges.