22 points psoulos 3 hours ago 1 comments
Bolwin 32 minutes ago | parent
Very similar to Kimi K3 it seems, but fewer active params (80b vs 104b). I don't think they mentioned what form of attention they use
22 points psoulos 3 hours ago 1 comments
Bolwin 32 minutes ago | parent