1.stochastic gradient descent
1.batch gradient descent & stochastic gradient descent

图片.png
2.stochastic gradient descent

图片.png
2.mini-batch gradient descent
1.

图片.png
3.stochastic gradient descent converge
1.checking for convergence

图片.png
2.wipe out meantering

图片.png
4.online learning setting
1.

图片.png
2.Map reduce and data parallelism

图片.png