Vanilla Gradient Descent Momentum AdaGrad RMSprop Adam AMSGrad AdamW QHAdam YellowFin AggMo QHM Demon 参考链接： https://johnchenresearch.github.io/demon/