Divided by algorithms and united by the objective
The main objective for any Machine Learning or Deep Learning algorithm is to predict outputs closer to the actual ones. This reduces the cost function which is based on the prediction error. An Optimization Algorithm is a procedure that is executed iteratively comparing various solutions till an optimum value, also called global minimum is found.
Neural Networks which are inherently computational need an optimal optimizer that can effectively help them during both forward and backward propagations.
Before I actually dive into Online Learning, I want to speak about data.
D-A-T-A this four-letter word has been driving many industries and in fact the whole world in these recent years. Data generation has seen an exponential increase.