lmflow.optim.novograd

Classes

NovoGrad

Module Contents

class lmflow.optim.novograd.NovoGrad(params, lr=0.01, betas=(0.9, 0.999), eps=1e-08, weight_decay=0, grad_averaging=False, amsgrad=False)

Bases: torch.optim.Optimizer

__setstate__(state)

step(closure=None)