68 points healsdata 2 hours ago 16 comments
Simulacra 2 hours ago | parent
bliteben 1 hour ago | parent
refactor_master 1 hour ago | parent
gambiting 1 hour ago | parent
karussell 2 hours ago | parent
https://news.ycombinator.com/item?id=50241543
MSN access: https://www.msn.com/en-us/news/other/it-took-just-12-hours-f...
uxhacker 1 hour ago | parent
karussell 1 hour ago | parent
Why does it matter if Cathedral follows some bug bounty rules? Black hats don't follow rules.
And IMO the citation about acting irresponsible when a company "relies on conventional business software" is taken out of context and is about AI safety, not a vulnerability in Slack.
Ylpertnodi 44 minutes ago | parent
ArcHound 1 hour ago | parent
My popcorn is ready, seems we're up for an interesting week or several.
trio8453 1 hour ago | parent
r3trohack3r 52 minutes ago | parent
neuronexmachina 1 hour ago | parent
> According to a draft report reviewed by The Washington Post, Cathedral used AI agents to find weaknesses in business software used by Anthropic for administrative and sales tasks. The researchers found ways to access internal data, including meeting transcripts and Slack messages, after running their agents for less than 12 hours.
cassianoleal 52 minutes ago | parent
> AI startup's agent goes rogue, hacks Anthropic, ...
xivzgrev 34 minutes ago | parent
Some people trust AI with a lot - financial, health, relationships - and it would all be out there
I also expect open AI to be hacked at some point, but at least with them you can use a throwaway email
And with Gemini, google has had some incidents over the years but given their size and length of existence it's been surprisingly small / secure.
But anthropic is a typical grow-fast startup, with security likely as a secondary concern. Waiting for the shoe to drop.