Announcement_5

Created in September 23, 2022

2022

New pre-print Lazy vs hasty: linearization in deep networks impacts learning schedule based on example difficulty available.

---

Enjoy Reading This Article?

Here are some more articles you might like to read next:

Derivatives through a batch norm layer

What is the empirical Fisher ?

How to compute the Fisher of a conditional when applying natural gradient to neural networks?

The algebra of second order methods in neural networks

Demystifying Natural Neural Networks