Can Peer Review Survive AI-Generated Text? [pdf]

torutofu 67 points 79 comments November 18, 2026
www.sas.upenn.edu · View on Hacker News

Discussion Highlights (20 comments)

patrickmay

Abstract, for those not interested in reading TFA: "Large language models now write papers and referee reports in economics. The field must develop best practices for handling AI-generated text in the publication process. Otherwise, peer review is in serious danger of collapsing. We propose that AI detectors should become a standard tool of the profession. Our experiment shows that they flag referee reports written by AI, not reports that AI merely proofread or helped edit. Aided by a simple model, we argue that a paper flagged as AI-generated should trigger a closer reading and can be rejected at the first mistake, and that an AI-generated referee report adds nothing that editors could not get by running the prompt themselves. Such reports are unacceptable: they damage authors and journals and should be treated like plagiarism. Individual restraint has already shown its limits, and the profession needs to develop norms to solve this collective action problem. We close with a practical guide for authors, referees, and editors."

Eddy_Viscosity2

Peer review will just be done by other AI, which is technically appropriate because they are peers to the AI authors.

avaer

> We are happy to acknowledge that we used LLMs to help with this paper. Framed another way: AIs are arguing with AIs about the merits of AIs, while the Board of Governors of the Federal Reserve System is nodding.

sathish316

Another valid question is - “Can AI-Generated text/code survive Peer reviews?” So far we’ve been using volume and time as constraints to justify why reviewing so much AI-generated text and code is humanly impossible. But if we solve time and cognitive constraints for subject matter experts, Can AI-generated text and code survive peer reviews?

astro1234

I’m going to say a class of opinion that has historically been overwhelmingly rejected by this crowd: Peer review will no longer matter in about 2 years and it will feel silly that we were ever asking ourselves these questions. Despite being proven time and time again that performance trends are incredibly stable and if anything accelerating slightly, that pretraining scaling laws and their analogs for post training are reliable enough for this to be mathematically uncontroversial, it is just as reliable that these clearly accurate projections are so incredible that people still don’t seem to accept it. This sentence has been true and could have been said at any point in time over the last 4-5 years (and it has, many times). The AI 2027 scenario while hilarious when posted is alarmingly not that far off from where we are today. As Dwarkesh reports from his conversations with Anthropic researchers and those at other labs, we are on track to solve RSI sometime in 2027 (again a relatively easy thing to project if you know a little bit about performance trends and how model performance is measured). The world will not implode like a dying star, and I expect the experience to be more or less what we’re going through today, though some capabilities will experience a much higher rate of improvement, and since there are unavoidable bottlenecks that AI cannot get around ever and some that will take years to figure out how to break down. But “oh no we don’t have humans to peer review” is incredible to me: peer review is a quality filter, and humans are notoriously bad at it. Models are already better in many ways at peer review and will become so obviously better that having a human in the loop at all will be like hailing a horse and buggy ride from the airport.

marginalia_nu

To be fair the peer review model has been falling apart long before AI generated text was a thing, mostly due to the exploitative nature of academic journals leading to incentive structures that don't align with producing good science. Reviewers don't get paid and have zero incentive to do a good job. You can in many cases just submit a paper over and over to different journals until it encounters a reviewer that can't be bothered reading it, upon which it gets rubber stamped through. The result is that time and time again, incredibly shoddy and too often downright fraudulent science has gotten through peer review.

abroszka33

It almost definitely cannot, because it takes 1 minute to generate a research paper and it takes much more time to review it and make sure it's trash AI slop.

tenzin3371

Sure, if by peer you mean other AI bot

jsw97

It's amazingly offensive to LLM-review a paper that someone has put months or years of their life into writing, for report that will partly determine whether it can be published in a high quality journal. And the career consequences that come for it. For those unaware, tenure decisions in economics can rest on 3-5 top-level publications. The number of pubs is much smaller than in adjacent fields, like OR. There should be strong, public, and embarrassing consequences for reviewers who do this. And the same applies to authors who use AI-generated text. I just can't believe that people feel that they can inflict AI text on other humans as though it were their own. We can't normalize this, it's incredibly offensive. I recently received an AI communication from a doctor. Did the doctor even think about it, or did they just press enter? How much credence do I give their decision on the question I asked? Certainly much less than if they had written it themselves. That said, the marketplace for ideas is going to look a lot different in the future, and that's probably ok. There needs to be a role for agentic or hybrid communication and discovery, and we need to find new ways to ferret out the truth in the midst of all of that. The old gatekeepers will still play some role, but it will be different. But feeding colleagues AI writing as your own needs to be a hard no.

hackermailman

Conferences are now capping authors to a maximum of 8 papers which of course screws up university departments where everyone adds their name. This ETH professor says there should be a deposit paid to avoid AI spam https://www.linkedin.com/posts/omutlu_international-symposiu... Same professor was rejected twice by peer review for what later became landmark papers one of which even got some Intel industry award. He did not change the paper and merely resubmitted that's how broken peer review already is.

drewlanenga

Clearly it's not worth wasting human attention on AI-generated text that doesn't reflect considerable human contribution. Is the same true for AI-generated text that helps a human contributor contribute more than they otherwise would be able to? (like ESL, or someone who's just not great at writing) As in, the thoughts are human but the text is AI. How are we supposed to gauge human contribution?

giladd

I wished that the trend would be opting for clearer, less verbose papers. Text length and complex language are no proxy for quality.

DaveChurchill

Computer Science professor here currently being flooded with review requests. I think that academic conferences and journals should start charging a large deposit or fee for reviewing papers. If your paper is deemed to be of very low quality or AI slop your fee is kept and distributed evenly to all reviewers for that venue. If the paper meets some sort of threshold then the deposit is returned. I hate for this to happen but it's the only way I see to stop the aslopolypse in academic writing.

FabCH

I am an occasional reviewer. Peer review has been dying for a long time. IMHO the solution was simple before AI and it is simple with AI: Double-blind review, but after the submission process both the article and the reviews are made public, with full attribution.

analog8374

Well if we're talking science then we might be forced to slow down and actually examine our evidence. Oh poo

martincsweiss

I was tech chair for ICCV 2021 (6k+ submissions), so I saw the amount of bad behaviour even before LLMs. Peer review will be redesigned from the ground up around LLMs. Patches are fine (AI detectors have a place, some bans can be good), but this won't be enough.

pizzathyme

I'm surprised I don't see the proposed stronger solution: AI-based review. A separate model can provide an assessment of the paper, flag errors, inconsistencies. Then people can review the top scoring candidates.

PowerElectronix

If yes, which I doubt already, can peer reviewers withstand a DoS attack by sheer volume of AI generated articles?

robwwilliams

>AI-generated referee report adds nothing that editors could not get by running the prompt themselves. This is false. Writing a good prompt to review a paper requires substantial background in the field and also requires substantial skill to evaluate the AI’s responses. I routinely use Claude Opus to review my own papers and to point out my errors. If I am lucky I can also point out a few of Opus’ errors. Over the last 6 months Opus has gotten to the point that it is as good a neurogeneticist as I am (Opus 5.5), and I have had the benefit of 45 years of training. I already rank Opus reviews of my grant applications to NIH as much superior to those that i receive from study section members who neither read the application fully nor do they read my recent publications. And sad to say: reviewers rarely know nearly as much quantitative genetics as Opus.

imeanwhatdoikno

Am not in academia, so the following might be naive, but it's not plausible that we go back to days before LLM writing and LLM reviewing papers. The amount of LLM output is also unlikely to ever decrease (and from what I understand the number of papers written even in pre-LLM days was already overwhelming the system). So: 1. Papers could be self-published on the web (Arxiv or Github or wherever else). 2a. Papers could be announced/advertised primarily by informal means (X and other social media, word of mouth, etc) 2b. In addition, there could be formal periodic announcements by academic institutions or industry entities that the authors belong to. E.g. a university might publish a list of top 10 (for your preferred value of 10) papers from each department, as selected by that department. The inclusion of a paper in these "top 10" lists would not necessarily mean that the paper has been peer-reviewed in any way. It would just signal that this paper may be worth checking out. 3. The purpose of journals/editors could shift from reviewing/publishing papers to aggregating all these informal announcements as well as all the "top 10" lists to identify most interesting/promising new papers in respective fields, with their URLs. Then it'd be up to the members of community interested in those topics to check out or not check out the papers in question.

Semantic search powered by Rivestack pgvector
13,334 stories · 126,150 chunks indexed