24 points ibobev 1 hour ago 5 comments
vatsachak 16 minutes ago | parent
I wonder what the "waves" in LLMs are; The global firing patterns that can help us interpret what the weights are doing en-masse
pessimizer 10 minutes ago | parent
This is what Walter J. Freeman III* spent his career working on, surprised he wasn't mentioned. I used to be very obsessed with him.
https://en.wikipedia.org/wiki/Walter_Jackson_Freeman_III
Nonlinear brain dynamics as macroscopic manifestation of underlying many-body field dynamics, https://arxiv.org/html/q-bio/0511037
https://web.archive.org/web/20070609235302/http://sulcus.ber...
-----
[*] No, not that guy; the son of that guy.
Edit: I've never seen a wikipedia page with so many typos.