Stochastic Weight Averaging support

[Archelunch]

Does Ranger support Stochastic Weight Averaging?

[LifeIsStrange]

I was going to ask about it, I wonder if it can increase accuracy further on Nlp tasks.
https://pytorch.org/blog/pytorch-1.6-now-includes-stochastic-weight-averaging/