Announcement_6

Created in December 21, 2022

2022

Our paper Lazy vs hasty: linearization in deep networks impacts learning schedule based on example difficulty was accepted to TMLR. (code)

---

Enjoy Reading This Article?

Here are some more articles you might like to read next:

Derivatives through a batch norm layer

What is the empirical Fisher ?

How to compute the Fisher of a conditional when applying natural gradient to neural networks?

The algebra of second order methods in neural networks

Demystifying Natural Neural Networks