36 points xqcgrek2 1 hour ago 49 comments
phoghed 48 minutes ago | parent
glitchc 31 minutes ago | parent
sdcfgy 24 minutes ago | parent
I suspect there will be citations galore shortly, faster than anyone can think.
goalieca 23 minutes ago | parent
iLoveOncall 13 minutes ago | parent
This is literal slop.
b3lvedere 9 minutes ago | parent
iLoveOncall 7 minutes ago | parent
It literally is just spam, and nothing else.
It's like the Nobel disease: https://en.wikipedia.org/wiki/Nobel_disease
b3lvedere 3 minutes ago | parent
ToValueFunfetti 1 minute ago | parent
Surely, this is not correct. The monkeys are drastically less likely to produce valid words; the set of monkeys that produce valid words are much less likely to produce valid sentences, etc. etc. Very low bar to clear, but of course this is vastly better than infinite monkeys at producing good research.
oefrha 12 minutes ago | parent
(I did learn much of my QFT from Schwartz’s QFT textbook though, so I hold him in higher regard than <insert random Harvard Physics prof here>.)
parthdesai 10 minutes ago | parent
d--b 10 minutes ago | parent
I didn't read the papers, and I am no specialist in any of the fields that guy meddles in, but it really does sound too good to be true. And if not, well, we're entering a new era of humanity right now.
_the_inflator 8 minutes ago | parent
Wisdom of the crowd has finally proven to be more valuable than some obscure title in academia. Crowds are relentless and ruthless, kind of a red team instead of a cronyism.
PS: The infamous replication crisis deserves a honorable mention here.
well_ackshually 5 minutes ago | parent
May someone grant me an ounce of his hubris and I'll become president of the united states. And I'm not even a citizen.
mcphage 3 minutes ago | parent
How many different fields would you imagine a Harvard professor to be an expert in?
LadyCailin 41 minutes ago | parent
jjice 39 minutes ago | parent
nicce 37 minutes ago | parent
Narishma 27 minutes ago | parent
vlyan 27 minutes ago | parent
on mobile, it's cancer like the rest of the internet, unapologetically growth-hacked with shit like "warning!!1 mature content!!1 log in with official reddit app to keep our community safe" modal you get regardless of which benign subreddit you try to browse.
cma 18 minutes ago | parent
amelius 24 minutes ago | parent
lovelymono 10 minutes ago | parent
program_whiz 41 minutes ago | parent
I suppose if this framework allows physics and other sciences to rapidly progress (e.g. publish more findings), that is good? It destroys a certain model we had, that science should be arduous and require a genius many years of work to uncover something, but if these papers truly add knowledge via this new tool, then this is for the good.
Not sure implications for researchers, but from the public perspective, now we have 36 new papers that increase our knowledge. But maybe an expert can weigh in, the papers might be slop?
softwaredoug 37 minutes ago | parent
program_whiz 21 minutes ago | parent
I guess on a theoretical level, if you had a button which would create breakthroughs in a field, but you yourself couldn't understand it, would you push it? I would because otherwise the field may not discover it, and others will be able to understand the breakthrough.
cma 17 minutes ago | parent
gradstudent 31 minutes ago | parent
program_whiz 23 minutes ago | parent
sourdecor 7 minutes ago | parent
coliveira 17 minutes ago | parent
bananaflag 39 minutes ago | parent
bluGill 7 minutes ago | parent
We do of course need to watch for hallucinations, but I in general expect AI to be very good at theoretical physics. AI can take a lot of known equations and prove/propose (these are different things!) generalizations to that may or may not match reality. AI can suggest experiments to see if the predictions match the real world. Maybe string theory can finely make a non-trivial prediction that we can test in the real world...
However AI is terrible for other parts of physics (at least so far) and those are also important we shouldn't lose track of them despite the excitement that we can get from progress in things AI is good at.
lp4v4n 30 minutes ago | parent
Now in the age of AI this problem will be heavily accentuated. Who's going to review the quality and validity of dozens and dozens of papers being generated by a researcher who used to publish sporadically?
It's not hard to see science going through a "slop crisis" in the next few years, in the same way that now projects are getting inundated with PRs.
f6v 23 minutes ago | parent
That's not entirely true. There's a whole genre of "response" and "response to response" papers that voice concerns when there's a methodological issue. That's somewhat common in my fields (computational biology and biomedical research).
And even if a "response" isn't published, people still try to reproduce published techniques if those seem useful.
geerlingguy 7 minutes ago | parent
You'd be surprised how rarely (overall) reproduction / verification is attempted. Sadly, a lot of research is taken at face value. That's done quite often with AI/tech stuff these days, and even more so for scientific research. It's a hard problem.
coliveira 21 minutes ago | parent
Gigioingiro 20 minutes ago | parent
vanviegen 5 minutes ago | parent
How about this: instead of going through publishers, researchers are required (by their funding organizations) to put a bounty on falsifying the result (for, say, 10 years). The higher the bounty, the higher the 'impact factor'. Put your money where your mouth is. A bounty of at least the cost of the study should be expected for serious research.
I can imagine a 'falsification insure' industry. They'd look at reputation as well as employ people close to the subject matter to asses risk, taking over the role of peer review. But with aligned incentives.
This way researchers and institutions who don't care too much about truth are marginalized; they either have low impact factors or they'll need to pay huge falsification insure fees.
And researchers who are sceptical of certain results will have an incentive (money!) to try to replicate it.
Remaining question: who is the authority on whether a publication has been falsified?
kps 19 minutes ago | parent
guessmyname 4 minutes ago | parent
I was confused too. Whoever wrote the title(s) doesn’t know a second language, otherwise, they would not have written such a confusing headline.
dataengineer56 19 minutes ago | parent
frereubu 14 minutes ago | parent
Edit: the papers do seem to have other names on them, and he says that all papers "were reviewed by humans for accuracy", but I still think there's a very serious risk of people being gulled into okaying something that's plausible rather than rigorously checking everything. There's enough human-generated slop in science already!
seydor 11 minutes ago | parent