A neural network with memory and information abstraction functions, the neural network implemented in a non-transitory computer-readable medium comprising at least one of firmware or hardware, the neural network comprising:
- a perceptual module;
- an instance encoding module;
- an environment encoding module;
- spatial encoding module;
- a time encoding module;
- a motion and orientation encoding module;
- an information synthesis and exchange module;
- and a memory module,
- wherein each module comprises a plurality of neurons,
- wherein the neurons comprise a plurality of perceptual encoding neurons, instance encoding neurons, environment encoding neurons, time encoding neurons, spatial encoding neurons, motion and orientation encoding neurons, information input neurons, information output neurons, and memory neurons,
- wherein the perceptual module comprises a plurality of said perceptual encoding neurons encoding visual representation information of observed objects,
- wherein the instance encoding module comprises a plurality of said instance encoding neurons encoding instance representation information,
- wherein the environment encoding module comprises a plurality of the environment encoding neurons encoding environment representation information,
- wherein the spatial encoding module comprises a plurality of the spatial encoding neurons encoding spatial representation information,
- wherein the time encoding module comprises a plurality of the time encoding neurons encoding temporal information,
- wherein the motion and orientation encoding module comprises a plurality of the motion and orientation encoding neurons encoding instantaneous speed information or relative displacement information of intelligent agents,
- wherein the information synthesis and exchange module comprise an information input channel and an information output channel, the information input channel comprises a plurality of the information input neurons, and the information output channel comprises a plurality of the information output neurons,
- wherein the memory module comprises a plurality of the memory neurons encoding memory information,
- wherein the neural network caches and encodes information through activation of the neurons, and encodes, stores, and transmits information through the connections between the neurons;
- wherein the information synthesis and exchange module controls the information entering and exiting the memory module, adjusts the size and proportion of each information component, is an executive mechanism of attention mechanism, and the information synthesis and exchange module's working process comprises an active attention process and an automatic attention process,
- wherein the information input neurons and the information output neurons respectively have an attention control signal input terminal,
- wherein the active attention process is:
- adjusting activation intensity or activation rate or spiking activation phase of each information input neuron or each information output neuron through adjusting intensity of the attention control signal applied at the attention control signal input terminal of the information input neurons/the information output neurons, so as to control information entering/existing the memory module, and adjust size and proportion of each information component,
- wherein the automatic attention process is:
- through the unidirectional or bidirectional excitatory connections between the information input neurons, when a plurality of the information input neurons are activated, making it easier for other information input neurons connected with said information input neurons to be activated, such that relevant information components are also easy to enter the memory module, through the unidirectional or bidirectional excitatory connections between the information input neurons and the information output neurons, when the information input neurons/the information output neurons are activated, making it easier for the connected information output neurons/the information input neurons to be activated, such that output/input information components related to input/output information are easier to output/input the memory module.