{"id":217,"date":"2022-01-18T14:58:43","date_gmt":"2022-01-18T13:58:43","guid":{"rendered":"https:\/\/machinelearning.humanativaspa.it\/en\/?p=217"},"modified":"2023-03-03T14:57:04","modified_gmt":"2023-03-03T13:57:04","slug":"deep-learning-the-technology-of-the-future-what-is-it-and-why-it-represents-the-next-frontier-of-humanativa","status":"publish","type":"post","link":"https:\/\/machinelearning.humanativaspa.it\/en\/deep-learning-the-technology-of-the-future-what-is-it-and-why-it-represents-the-next-frontier-of-humanativa\/","title":{"rendered":"Deep learning the technology of the future, what is it and why it represents the next frontier of Humanativa"},"content":{"rendered":"

In recent years, the research and development activity carried out by Humanativa<\/strong> has been aimed at the theme of Machine Learning through the experimentation of different Deep Learning models. In 2022 our goal is to strengthen this competence, a strategic choice supported by observers and analysts worldwide, who agree that this technology will be strongly used in the coming years, especially with the arrival of European PNRR funds. The series of articles that we will dedicate to this technology aims not only to analyze the technical aspects but also to share the projects that Humanativa is starting in this area.<\/span><\/i>\u00a0<\/span><\/p>\n

Human Neural Networks and Artificial Neural Networks<\/span><\/b>\u00a0<\/span><\/p>\n

The mechanism of operation of human Neural Networks is now used as a model to address multiple applications of Artificial Intelligence, such as image recognition, voice recognition, biometric applications, autonomous driving and simulators of various kinds.<\/span>\u00a0<\/span><\/p>\n

But how do Neural Networks work?<\/span>\u00a0<\/span><\/p>\n

Neurons, the brain\u2019s fundamental cells, are composed of a part of a nucleus surrounded by the body of the neuron, also called soma. The nucleus is connected to other neurons through two types of branches: dendrites<\/span>([1]), <\/span><\/b>which collect inputs, and axons<\/span>([2])<\/span><\/b>, which emit outputs.<\/span>\u00a0<\/span><\/p>\n

Synapses act as connectors between axons and dendrites, allowing information to pass between one neuron and another.<\/span>\u00a0<\/span><\/p>\n

Through electrochemical processes, the synapse sends pulses along its axon, thus activating electrical inputs towards the dendrites of the next neuron.<\/span>\u00a0<\/span><\/p>\n

The effectiveness of these impulses at the synaptic level is linked to the learning processes and memory of the human being and is or is not strengthened through a process of <\/span>reweighting<\/span><\/i>.<\/span>\u00a0<\/span><\/p>\n

The human brain contains about one hundred billion neurons and each of them can be connected on average with a thousand other neurons. If we multiply the two numbers, we get a potential of 10^14 synaptic connections.<\/span>\u00a0<\/span><\/p>\n

\"\"<\/span><\/p>\n

([1]) Recipient portion of the cell body of the neuron. Dendrites are often numerous and branched and extend into the area surrounding the cell body; On their plasma membrane they establish synaptic contacts with the transmitting portions (axons) of presynaptic neurons, and conduct the electrical potential generated by the receptors to the cell body and the emergency cone of the axon of the nerve cell to which they belong.<\/span><\/i>\u00a0<\/span><\/p>\n

([2]) Prolongation of the nerve cell, capable of conducting the nerve impulse from the cell body to the periphery and transmitting it to other cells.<\/span><\/i>\u00a0<\/span><\/p>\n

Neurons are almost all created at birth, except for very few that can be created in post-natal age, but in fact the neuron is the only human cell that can no longer regenerate after birth. The network that connects them \u2013 and above all the formation of new synapses \u2013 is very rapid in newborns and continues into adulthood.<\/span>\u00a0<\/span><\/p>\n

Synaptic connections enhanced through the reweighting processes remain active longer \u2013 effectively forming long-term memory \u2013 while weak, unused connections are removed along with the dendrites to which they are attached.<\/span>\u00a0<\/span><\/p>\n

The first studies of simulating neurons to create Artificial Intelligence were announced in December 1943 by Warren S. McCulloch and Walter Pitts in the publication entitled “<\/span>A logical calculus of the ideas immanent in nervous activity”.<\/span><\/i>\u00a0<\/span><\/p>\n

It is a fundamental combiner with multiple binary numbers input and a single binary output, associated with the idea of being able to create a network of such combiners in order to perform calculations.<\/span>\u00a0<\/span><\/p>\n

\u00a0<\/span><\/p>\n

However, it is in 1958 that Frank Rosenblatt introduces the first real idea of artificial neuron, called <\/span>perceptron<\/span><\/b>. The perceptron is a model with weighted input data, which introduces the first real idea of learning, even if in a very elementary form. It represents, in fact, the first model of artificial neural network.<\/span>\u00a0<\/span><\/p>\n

The perceptron is a <\/span>binary classifier<\/span><\/b> for supervised learning, able to predict whether the input data vector with the appropriately weighted values, belongs to a class or not. The classifier in question uses a linear classification algorithm, like those we have already seen, that is, it receives Xi variables as input and adds them linearly with Wi weights (this part reminds a bit of the dendrites of our neurons)<\/span>\u00a0<\/span><\/p>\n

Y = W1X1 + W2X2 + W3X3 + …<\/span>\u00a0<\/span><\/p>\n

\u00a0<\/span><\/p>\n

\"\"<\/span><\/p>\n

The resulting Y of this linear classifier (<\/span>the axon<\/span><\/b> of our neuron) is then fed to a nonlinear function called <\/span>activation function<\/span><\/b>, which we can try to associate with the synapse of the biological neuron.<\/span>\u00a0<\/span><\/p>\n

The activation function is a mathematical function applied to the inputs of the neuron that determines its output. There are various activation functions that depending on the type of neuron are used to optimize learning.<\/span>\u00a0<\/span><\/p>\n

For example, the step function (used in binary classification), the sign function, the sigmoid function (sig) (used in logistic linear regression), the hyperbolic tangent function (tanh) (used in logistic linear regression), ReLu activation function, and the SoftMax function (used for classification on different classes).<\/span>\u00a0<\/span><\/p>\n

Ultimately, we can consider the perceptron as a basic neural network at a single level. If we then connect multiple perceptrons in cascade, at least one input, one intermediate and one output, with each of them that can use classifiers of various kinds (linear and not) we obtain a neural network, with multiple levels.<\/span>\u00a0<\/span><\/p>\n

Normally the intermediate levels between the input and the output are for simplicity referred to as hidden levels.<\/span>\u00a0<\/span><\/p>\n

\u00a0<\/span><\/p>\n

\u202f<\/span> \"\"<\/span><\/p>\n

A DNN (Deep Neural Network) multilevel neural network is able to predict complex problems and manage multiple parameters: obviously the computational need increases, besides the fact that debugging and interpretation of the results is inevitably much more complex.<\/span>\u00a0<\/span><\/p>\n

Scikit-learn provides some libraries for models based on Neural Networks; there are also frameworks specialised in Deep Learning and Neural Models developed by different Organisations, such as Tensorflow, MXNet, PyTorch and Keras.<\/span>\u00a0<\/span><\/p>\n

\u00a0<\/span><\/p>\n

Why has deep learning become important in recent years?<\/span><\/b>\u00a0<\/span><\/p>\n

In recent years, a new and decisive impulse to the use of Neural Networks has derived from some important technological innovations introduced in the “data value chain” and which have launched a new era in information processing. Especially:<\/span>\u00a0<\/span><\/p>\n

\u00a0<\/span><\/p>\n