30 points dangelosaurus 58 minutes ago 20 comments
dangelosaurus 53 minutes ago | parent
And we're hiring! https://openai.com/careers/search/?q=cyber
BoppreH 42 minutes ago | parent
I understand this work was based on a dated snapshot. Will there be any continuous effort, scanning new PRs as they land, to prevent new weaknesses from being added?
ky1ebot1337 12 minutes ago | parent
farisght 31 minutes ago | parent
A system that admits THOUSANDS of such vulnerabilities is certainly flawed in several fundamental aspects
jethro_tell 8 minutes ago | parent
konaraddi 26 minutes ago | parent
E.g., 948 results is a high number to review in a timely manner unless your team is very large or spending several months combing through the results
EDIT: nvm i shouldve kept reading, answered
> At this scale, manually investigating every report is impractical for our research team. We therefore focused on validating findings that a) were reachable by a low-privileged user, b) required no special capabilities, and c) produced measurable evidence of memory corruption.
zahlman 32 minutes ago | parent
Imagine if open-source organizations other than the Linux Foundation (and Mozilla I guess) could throw $1.2M of API-rate LLM usage at security.
getcrunk 29 minutes ago | parent
*buries head in sand*
*cries*
rubinlinux 10 minutes ago | parent
Plasmoid 22 minutes ago | parent
Is the kernel simply too complex to reason about? Is it an underlying flaw in the security model or language implementation?
Should we assume that all software is more compromised than the kernel?
antonvs 18 minutes ago | parent
We developed AIs that can find them.
bombcar 8 minutes ago | parent
mikestylz 6 minutes ago | parent
Absolutely, the front door has always been unlocked. We were previously protected by the economics of exploit detection favoring the developers, but now we have entered a new world.
The issues arise almost everywhere we look. It's frustrating because the user experience in edge systems has barely changed in the last fifteen years. We could have rode the advances in semiconductor manufacturing to embed more layers of protection such as CHERI while slightly slowing down the rate of performance improvements. Instead we have only marginally upgraded security and largely added features which the users scarcely notice.
I am hopeful about the long term prospects of formal verification, but having humans reviewing the proof statements and confirming they match our desired properties will take many years. Meanwhile, AI assisted hacking is an urgent issue. So we will have to delegate implementation, proof specification, and proof development to the AIs in the short term. Maybe that goes well, but who knows. Interesting times.
nas 13 minutes ago | parent
tamimio 12 minutes ago | parent
hoppp 11 minutes ago | parent