|AI|CONTINUAL LEARNING|DEEP LEARNING LIMITS|
“The sensible adapt themselves to circumstances, as water moulds itself to the pitcher.” — Chinese Proverb
“Adapt or perish, now as ever, is nature’s inexorable imperative.” — H. G. Wells
Artificial intelligence lately has made great progress. All of those systems use artificial neurons in some form. These algorithms are inspired by their biological counterparts. For instance, the neuron aggregates information from previous neurons, and if the signal exceeds a certain threshold it passes the knowledge to other neurons. This concept is represented by the matrix of weights and the activation function. Other examples may be present in convolutional networks (inspired by the visual cortex) or genetic algorithms. Through the training process, the connections between various neurons (represented by the weights) are strengthened or diminished, just like the strength of neuronal synapses. This process is the premise of the…
