Some code that I have open sourced in the past decades. I recommend checking out the miyagi_pytorch_trainer!