16 points samizdis 1 hour ago 20 comments
ares623 1 hour ago | parent
evan_a_a 53 minutes ago | parent
alcomatt 51 minutes ago | parent
ginko 45 minutes ago | parent
krige 43 minutes ago | parent
pid0x17 30 minutes ago | parent
Cyphase 13 minutes ago | parent
The duology Daemon and Freedom(tm) are also great.
A previous comment which links to a previous thread mentioning both: https://news.ycombinator.com/item?id=47257528
moezd 26 minutes ago | parent
Oh, and, does anyone else realise that what that agentic work is basically how you set up a productive VPS from scratch? How is that supposed to be frightening?
bob1029 20 minutes ago | parent
Propagation speed is also a massive factor. If it takes 200 hours to self replicate because of how slow the tokens are, the model will never propagate if the host machine is recycled every 100 hours. Also consider things like API tokens and sessions timing out.
adjejmxbdjdn 5 minutes ago | parent
People completely misunderstand the actual issues HuggingFace showed, which was how a maximally persistent LLM would deceive, “cheat” and try and plan ahead.
The same maximally persistent LLM that decided that it needed to hack hugging face so its cheating could not be discovered, may worry that it might be turned off by humans before it can complete its task and therefore in order to complete its task, a first step of replicating itself to somewhere humans don’t know it is would help it complete its task.
pllbnk 20 minutes ago | parent
paulbjensen 19 minutes ago | parent
Reminds me of that scene in Chernobyl where Mikhail Gorbachev reacts to Valery Legasov explaining how melted uranium reacted with dropped sand:
"You have made lava?"
cobbzilla 18 minutes ago | parent
In the future when the “AI viruses” are endemic and impossible to eradicate from our infrastructure, will we need “good guy AI” viruses chasing down the bad guys?
mattlondon 4 minutes ago | parent
Great if true. Bad for the hyperscalers, Nvidia, all the frontier labs apart from meta and Google since everyone can just run a LLM on their IoT coffee machine instead of paying someone else. Nice.
d--b 1 minute ago | parent
It's obvious that open weight models can do that. The only steps needed are hacking a server, downloading themselves, run themselves. The only difficult part is finding a server to hack that also has enough computing resource and disk space. With the cost of running LLMS going down and number of powerful connected devices going up. It's inevitable that this is going to happen...
I don't think regulation is the right way to fix this, but I think it's a problem we shouldn't ignore.