[Feature Request] Aida optimizer

[okbalefthanded]

A new optimizer that improves upon AdaBelief is proposed in this paper Aida , the optimizer was tested against SGD, Adam, AdamW, Radam, Fromage, and AdaBelief on ResNet, Transformer, and LSTM.

• Code : Aida Code