21 points deenadz 1 hour ago 8 comments
user_7832 29 minutes ago | parent
I use LLMs for non code purposes (probably not very common on HN) and Sonnet 3.5/3.6 still ranks as probably one of the best models I've used.
Can today's models put out tech demos and call more tools that make it way more impressive? Sure. But it's really hard to see any actual significant gains over the last few months, they're so mild (again, non coding).
incognition 16 minutes ago | parent
SubiculumCode 27 minutes ago | parent
ahsillyme 12 minutes ago | parent
horacemorace 14 minutes ago | parent
jrflo 8 minutes ago | parent
tristanj 5 minutes ago | parent
1. Google has huge amounts of cash and compute. Their goal was to train a model that that has the highest quality & frontier performance, not create a model that's efficient to run and serve. They have other models for that, like Hydrogen.
2. Google created Carbon without caring for inference costs. DeepMind is subsidized by the rest of Google's empire. Selling inference is an insignificant part of Google's revenue. But for Anthropic and OpenAI, selling inference is their entire business model. Anthropic and OpenAI have enormous incentive to optimize model serving and inference costs, far more so than Google does.
lp92 1 minute ago | parent
That's pretty interesting. Seems like it's over analyzing. Not the worst outcome though to have additional hardening.