22 points stefanpie 2 days ago 4 comments
JasonCEC 12 minutes ago | parent
Peer review has its historical issues, but the landscape of science and science-publishing has changed. New problems of authorship and authorial-understanding are now challenged by LLMs writing (at least) good sounding papers - some of which might be of acceptable quality in subject (I am not against AI in the sciences; some of the math work has been great). On the other hand: I am against authors not understanding their own work. High repute journals may need to add "oral exams" to the paper acceptance process...
N_Lens 11 minutes ago | parent
I think authenticity and trust will command a (larger) premium in this new age of slop.
The article highlights how only one out of ten paper’s authors were able to answer questions thoroughly and at a high level. This indicates an overwhelming percentage of authors are slopping up their work with AI and submitting it without even reading it.
Calazon 10 minutes ago | parent
I wonder how the ratios would change for papers at different parts of the review process. For what fraction of published papers are the authors unable to answer basic questions about them?
jszymborski 2 minutes ago | parent
FYI in case the author is reading, https://www.cs.cmu.edu/~nihars/preprints/greCAPTCHA.pdf is a dead link.
EDIT: I found a live link on arxiv https://arxiv.org/html/2609.20481v1