32 points agnosticmantis 1 hour ago 10 comments

superchicken099 14 minutes ago | parent

This guy seems to get off on being a martyr if you read anything else on his profile.

Financial ties of this sort are a bad look but the suppositions made based on the findings are speculative until proven otherwise.

api 11 minutes ago | parent

I think a TL;DR on this whole thing is that Anthropic is controlled by a cult.

I heard someone on a group I'm in humorously say it's the first IPO of an apocalyptic doomsday cult.

If they truly believed this stuff had a meaningful chance of being an X-risk to humans, they should stop building it and stop pursuing a giant IPO to finance building it. They don't even have the Manhattan project excuse of WWII and the Cold War as a forcing function. There's plenty of biologists, for instance, who have refused to work on things they legitimately think are too dangerous (gain of function research being one, biological weapons another). It's not like people with the expertise to develop and code AI systems can't find other fulfilling interesting work that pays well. But these guys are simultaneously crowing about P(doom) while building the doomsday machine with tremendous enthusiasm.

Which means they don't really believe it. I think it's a mix of regulatory capture incentives and a weird cult ideology where the loud part is P(doom) and the quiet part -- the real part, the inner ideology of the cult -- is that humanity's future depends on this cult being at the steering wheel. Their goal is not to stop AI but to make sure the cult and only the cult control it.

The seeming indoctrination of the incoming Democrats from the most recent electoral cycle is really troubling. I've wondered if maybe a good way to fight it is to point out that this cult has some problematic views on race/IQ, biological determinism, and has a lot of figures in it with really troubling histories around sex and consent. Search for "Rationalist sex cult" and you'll find endless articles about "Rationalist houses," BDSM orgies that play loose with consent, employees feeling like they're being pressured to participate in certain extracurricular activities, etc.

I feel like these allegations pouring out of other circles would be (rightly) a five alarm fire, but for some reason the Rationalist orbit around Anthropic and OpenAI and the whole San Francisco Rationalist cult scene gets a pass.

Tarq0n 6 minutes ago | parent

It's more of a muddle of incentives than anything. Using doomsday cult as a model is neither helpful to the debate nor insightful.

dario_amodei 6 minutes ago | parent

very well