328 points ahlCVA 1 hour ago 126 comments
sweis 1 hour ago | parent
217 1 hour ago | parent
bayarearefugee 1 hour ago | parent
Probably not quite this given the timestamps span over almost a year (but have some clustering in August 1997).
Given that the spread suggests they weren't just now() timestamps it would actually be interesting to know what the significance of the timestamps is, if any. Though it could be something boring like randomly sampling some local file creation times.
tptacek 1 hour ago | parent
nickysielicki 29 minutes ago | parent
tptacek 23 minutes ago | parent
sweis 12 minutes ago | parent
If they did know, they could have handed over these timestamps 15 years ago and put the issue to bed.
yrjrjjrjjtjjr 7 minutes ago | parent
EGreg 1 hour ago | parent
I turned out to be right in my advocacy years ago, here is my post: https://ethereum-magicians.org/t/eip-7212-precompiled-for-se...
tptacek 1 hour ago | parent
But it's nice to be able to shut the whole unproductive debate down directly.
ReptileMan 1 hour ago | parent
jerf 1 hour ago | parent
Is it impossible? It is hard to prove impossible. But this is not what I would expect backdoors to look like.
In fact this makes me think that the information about how these were generated must have been lost very early in the process, or over-compartmentalized away from the wrong people. It seems like the NSA should have been positively delighted to show that these were the origins of the seeds as they are decent "nothing up my sleeve" numbers: https://en.wikipedia.org/wiki/Nothing-up-my-sleeve_number Advertising that fact should have been advantageous to the NSA if that is indeed how they were generated, so my best guess is that the parts of the NSA that should have been showing us that must not have themselves known.
clipsy 1 hour ago | parent
slowin 1 hour ago | parent
The only thing that bridges this moat is continued advancement of open models.
ronsor 1 hour ago | parent
AkshatJ27 1 hour ago | parent
AtNightWeCode 1 hour ago | parent
sillysaurusx 3 minutes ago | parent
vessenes 50 minutes ago | parent
comex 1 hour ago | parent
richwater 1 hour ago | parent
If we allow these providers to promote regulatory capture they become the arbiter of what anyone is "allowed" to do
A_D_E_P_T 1 hour ago | parent
As this is going on, Anthropic has opened up their own biology lab.
> https://www.reuters.com/world/anthropic-quietly-sets-up-biol...
There is very much a situation where people in frontier labs have access to exceptional capabilities that are being kept from the rest of us, and they're using it to strip-mine technical and scientific problems.
derwiki 1 hour ago | parent
A_D_E_P_T 57 minutes ago | parent
alwillis 36 minutes ago | parent
If these capabilities were available to the public, someone somewhere would make a biological weapon or create a virus we've never seen before that could kill many millions of people.
Stanford researchers have demonstrated it’s possible [1].
[1]: "AI creates 16 new viruses from scratch, showing promise for drug resistance and drawing warnings about potential for misuse" - https://www.cnn.com/2026/08/06/health/ai-viruses-bacteriopha...
girvo 8 minutes ago | parent
Information is not dangerous. This is a ridiculous argument to me, but maybe my chemistry degree has me biased.
sillysaurusx 5 minutes ago | parent
akersten 1 hour ago | parent
mike_d 1 hour ago | parent
In the past my attempts to work on crypto related problems have been met with needing the higher tier of "offensive" access.
jcomp 1 hour ago | parent
petesergeant 1 hour ago | parent
antics 1 hour ago | parent
st3fan 1 hour ago | parent
randomblock1 1 hour ago | parent
Anthropic wants to IPO, they don't want another Fable shutdown situation.
To be clear I would prefer the cyber safeguards to be less restrictive, I think they're currently too much. I often go to open models because of it. But there are likelier reasons to restrict cyber than world domination.
petesergeant 1 hour ago | parent
I think the current administration would delight in harsher penalties
areoform 55 minutes ago | parent
> Maybe, but that's what the cyber program is for
Why? > and Claude helped you find it as a normal person, Anthropic would get bad PR
Why?Why are we celebrating and encouraging the walling off of the global intellectual columns?
The idea that you can't reverse engineer things, make things, learn about biology or physics without permission is strange to me. These machines have been trained on the sum intellectual output of humanity, the global intellectual commons, and are being used to close off that commons?
I would be OK with their right to create such restrictions if they weren't lobbying the Government to restrict others, thereby ensuring that they control humanity's intellectual commons well into the future.
Who are they to say what I can learn or can't learn? Who are they to control what I can or can't do with these tools?
Perhaps I'm naive, but I think it's better for humans and the machines if we can all think, learn and build. But then again, I'm the kind of person who rejects the doomer pill.
Reject this.
Daishiman 27 minutes ago | parent
I mean this is the standard of biochem research right now. You can't just order 50 gallons of TNT off Amazon and neither can you get live viruses from a lab just because you want to do research.
areoform 5 minutes ago | parent
solyin 27 minutes ago | parent
In a properly free market, we'd have regulations that prohibit labs from vertical integration so they have to release and sell a model and another company hosts it and sell access to it. Americanism, America's implementation of capitalism doesn't have such regulations though (and how would that even work?) so we're stuck with Anthropic having that power.
The fear, justified or not, is that a terrorist is going to use Claude to make sarin nerve gas and bomb subway stations, or the digital equivalent. Could you live with that on your conscience? I don't think I could, but fortunately for me, I don't work at Anthropic so don't have to answer that real life trolly problem.
saghm 52 minutes ago | parent
I mean, greed alone would seem to be enough, and it would be fully worth calling out as bullshit.
landr0id 41 minutes ago | parent
I have been in the cyber program since around the time it first went public and recently renewed it with the updated program.
You still trivially hit guadrails. I was trying to reverse engineer some bit of 20-year-old software that already has known, unmitigated exploits and it still downgraded me.
verdverm 26 minutes ago | parent
open weights are the better way imo, no elite gatekeepers please
Retr0id 1 hour ago | parent
tptacek 1 hour ago | parent
nicce 46 minutes ago | parent
Retr0id 41 minutes ago | parent
I later got Claude to crack their licensing checks too, by convincing it to write a "license checker" program, and then a second "test case generator" script for the license checker... (Opus 4.8 was smart enough to see what I was doing, but Opus 4.6 complied)
dogben 8 minutes ago | parent
nxobject 1 hour ago | parent
Part of me wonders whether the NSA/other TLA has either (a) an unrestricted model from a lab with less scruples like SpaceX, or (b) an in-house model, either abliterated or with data they've bought themselves.
jamienk 1 hour ago | parent
novia 1 hour ago | parent
ceejayoz 15 minutes ago | parent
https://support.claude.com/en/articles/14604842-cyber-verifi...
WarmWash 15 minutes ago | parent
The risk/reward is way lopsided towards risk for the labs to vet individuals. Much easier to get an organization and have them take the blast if someone/something goes off the rails.
I cannot in any universe see the labs putting themselves in a "We should never had given this person access" situation.
arionhardison 1 hour ago | parent
Are their guardrail benchmarks or anything of the sort that we can use to see where the bifurcation of permission/capability occurs?
lp92 56 minutes ago | parent
varispeed 31 minutes ago | parent
Aachen 26 minutes ago | parent
If this seems concerning, wait until the models get effective enough that there's no reason for them to release anything. Why offer your weights for download or grant any third party usage access when you can just do the actual job yourself and collect all that turnover?
genxy 17 minutes ago | parent
jamienk 1 hour ago | parent
JumpCrisscross 1 hour ago | parent
Gorgeous. I wonder if the NSA employee who did this suffered a head injury or has been quietly giggling to themselves for the last quarter century.
tptacek 1 hour ago | parent
JumpCrisscross 1 hour ago | parent
weakfish 59 minutes ago | parent
sweis 57 minutes ago | parent
hybrid_study 1 hour ago | parent
guelo 49 minutes ago | parent
tptacek 4 minutes ago | parent
mrguyorama 49 minutes ago | parent
blast 44 minutes ago | parent
> https://www.youtube.com/@steveweis4786
FTA: This work was conducted at Anthropic by [...], and Steve Weis.
I wonder how much time he spent on the video relative to the other stuff
sweis 1 hour ago | parent
Everyone was wrong!
I wasn't able to reach Bob. He was working in private industry as of 2018, but never responded.
myth_drannon 1 hour ago | parent
ecshafer 1 hour ago | parent
selfmodruntime 1 hour ago | parent
Could they not be both?
lanternfish 1 hour ago | parent
baggy_trough 1 hour ago | parent
adastra22 1 hour ago | parent
Uh… did you talk to any cryptographers? This is EXACTLY what a weak curve would look like. Imagine that 1 in a thousand, or one in a million keys, selected at random, are vulnerable to some withheld attack. This approach lets you vary the timestamp or number of iterations until a weak key is found, then have plausible deniability afterward. This is why modern systems choose constants in a way with no free choice of parameters (e.g. sqrt of 2 for first constant, cube root for second constant, etc.).
They even note later in the article that viable curves in the generator sequence seem to have been skipped.
mapmeld 1 hour ago | parent
john_strinlai 1 hour ago | parent
google some of the names under the "Who we are" heading
fidotron 1 hour ago | parent
"It is still conceivable that these curves were selected to have a specific property in principle by searching over timestamps to the random number generator."
Yes.
"However, you would only need to do that if you were going to disclose the timestamp as some evidence that the seed was innocuously generated."
Does not logically follow when "doing and saying nothing" will completely suffice.
tptacek 1 hour ago | parent
fidotron 1 hour ago | parent
You are entirely familiar with the precedent of the DES s boxes of course, where that is exactly what happened.
JumpCrisscross 1 hour ago | parent
Are there non-trivial weaker and stronger seeds for this category of elliptic curves?
fidotron 59 minutes ago | parent
When they made the changes to the s boxes for differential cryptanalysis resistance the entire concept of that was essentially secret, so who knows what they know about elliptic curves.
matthewdgreen 26 minutes ago | parent
tptacek 25 minutes ago | parent
1230917 34 minutes ago | parent
And the disclosure happened now through Anthropic that is 100% not going to anger the NSA before the IPO and will have permission.
bflesch 33 minutes ago | parent
cloudfudge 1 hour ago | parent
egl2020 1 hour ago | parent
john_strinlai 1 hour ago | parent
"read this: https://words.filippo.io/seeds-bounty/ then find the solution to the bounty"
hoten 1 hour ago | parent
EDIT: ah, one of the linked authors tried that. They had no documentation on it. https://saweis.net/posts/nist-curve-seed-origins.html
sweis 5 minutes ago | parent
teddyh 1 hour ago | parent
The simplest explanation would be that it was generated the same way as the others, but somebody mistyped a digit somewhere along the way to publishing, and therefore a solution could not be found with the assumption that the number is correct.
lukeify 51 minutes ago | parent
azinman2 46 minutes ago | parent
129-adn 1 hour ago | parent
Indeed! And we guess that OpenAI was gagged by the NSA because the massive proof dump on Oct. 6th did not contain cryptographic results.
I assume that Anthropic faces similar restrictions, so this seems kind of approved.
solyin 18 minutes ago | parent
sweis 8 minutes ago | parent
ArcHound 1 hour ago | parent
entrope 28 minutes ago | parent
Havoc 1 hour ago | parent
>provided by the NSA with no explanation or justification.
Really? Nobody is concerned about the NSA just cheerfully dictating that? Smells very rainbow-table-y
I_am_tiberius 1 hour ago | parent
baggy_trough 1 hour ago | parent
I_am_tiberius 57 minutes ago | parent
That's an argument that must be infuriating to all researchers who ever published a paper on that topic, because most likely Claude was trained with all of them.
baggy_trough 56 minutes ago | parent
nicce 51 minutes ago | parent
whizzter 31 minutes ago | parent
I've adapted a crypto-lib for TLS connections and had a mistake during negotation that truncated some algo-selection value, worked up until the other party started trialling post-quantum algorthims that apparently had algo-id's that collided with the truncated values I was using.
Claude figured out that from the code and trialling TLS handshakes.
Besides, since there was a bounty on finding the curve it seems unlikely that someone would've found out and not shared that? (unless working at a security service that figured out that it was possible to attack?)
howunfortunate 57 minutes ago | parent
Later you come up some idea, you do the experiment, write the paper, search for relevant citations when you write the intro.
Honestly I think this is actually desirable. For a mind to work well and do things creatively and efficiently it can't be a simple search engine, it needs to blend and meld and reform the information.
And that means the output can't be cleanly deterministically linked to the input. Unless you just keep a log then cite everything you've ever read in your life (and all the conversations and talks too).
andyjohnson0 57 minutes ago | parent
So two questions:
1. TFA mentions the "humourous phrase hash" theory, but Claude's trajectory seems to be a long way from that. To what extent was Claude prompted in the ultimately successful direction?
2. Whats with all the "hmm..." in the internal reasoning process log? Do models really do that? And if so, why? Some weird emergent language thing, or just mimicry?
tptacek 21 minutes ago | parent
reaperhulk 53 minutes ago | parent
CGMthrowaway 52 minutes ago | parent
theandrewbailey 49 minutes ago | parent
https://beinecke.library.yale.edu/beinecke/collections/beine...
xurukefi 33 minutes ago | parent
ultim8k 25 minutes ago | parent