There Will Be a Scientific Theory of Deep Learning [R]

Hi, all! I’m the lead author on this ambitious (14-author!) perspective paper on deep learning theory. We’ve all been working seriously, and more or less exclusively, on deep learning for many years now. We believe that a theory is emerging, and we pull together five lines of evidence in recent research into a portrait of the nascent science. Hoping to galvanize better scientific research into how and why these wild, huge learning systems work at all.

Explanatory tweet thread here: https://x.com/learning_mech/status/2047723849874330047