Vanilla Gradient Descent Momentum AdaGrad RMSprop Adam AMSGrad AdamW QHAdam YellowFin AggMo QHM Demon 参考链接: https://johnchenresearch.github.io/demon/