Gradient Descent Gradient Descent is the most popular optimizer to update parameters and it uses the gradient of the error with respect to the parameter. But the parameter update rule is different and thus there are different variants of Gradient Descent. Mini- Batch Gradient Decent It is the simplest algorithm, where we update parameters in […]