Tag: peer review journals

Retractions of peer-reviewed scientific papers has risen 13,750% in this century

11:47 pm

Modern peer review in science
Modern peer review in science

The present and growing dark age: According to the watchdogs who run the website Retraction Watch, the number of peer-reviewed scientific papers that have been retracted each year has risen from 40 in 2000 to 5,500 in 2022, an astonishing increase of 13,750%.

According to these watchdogs, there are two reasons for this increase in research failure:

Retractions have risen sharply in recent years for two main reasons: first, sleuthing, largely by volunteers who comb academic literature for anomalies, and, second, major publishers’ (belated) recognition that their business models have made them susceptible to paper mills – scientific chop shops that sell everything from authorships to entire manuscripts to researchers who need to publish lest they perish.

These researchers are required – sometimes in stark terms – to publish papers in order to earn and keep jobs or to be promoted. The governments of some countries have even offered cash bonuses for publishing in certain journals. Any surprise, then, that some scientists cheat?

I think the watchdogs are missing the major and much more basic source for this problem. » Read more

13 comments

Two publishers of scientific journals have withdrawn 120 papers which they have discovered were nothing more than computer-generated gibberish.

10:56 am

Layers and layers of peer-review: Two publishers of scientific journals have withdrawn 120 papers which they have discovered were nothing more than computer-generated gibberish.

Over the past two years, computer scientist Cyril Labbé of Joseph Fourier University in Grenoble, France, has catalogued computer-generated papers that made it into more than 30 published conference proceedings between 2008 and 2013. Sixteen appeared in publications by Springer, which is headquartered in Heidelberg, Germany, and more than 100 were published by the Institute of Electrical and Electronic Engineers (IEEE), based in New York. Both publishers, which were privately informed by Labbé, say that they are now removing the papers. …

Labbé developed a way to automatically detect manuscripts composed by a piece of software called SCIgen, which randomly combines strings of words to produce fake computer-science papers. SCIgen was invented in 2005 by researchers at the Massachusetts Institute of Technology (MIT) in Cambridge to prove that conferences would accept meaningless papers — and, as they put it, “to maximize amusement” (see ‘Computer conference welcomes gobbledegook paper’). A related program generates random physics manuscript titles on the satirical website arXiv vs. snarXiv. SCIgen is free to download and use, and it is unclear how many people have done so, or for what purposes. SCIgen’s output has occasionally popped up at conferences, when researchers have submitted nonsense papers and then revealed the trick.

The real story here is that many of these gibberish papers were peer-reviewed by actual scientists who are supposedly experts in their fields and should have spotted the fakery immediately. That they didn’t suggests another level of corruption. Either they don’t really bother to peer review the papers they are asked to peer review, or they knew what was going on and were part of the game.

That this kind of stuff happens repeatedly in many fields of science should make us all very skeptical of any controversial scientific claim that carries with it any political component. This doesn’t mean that all published material is fake, only that we must not take anything on faith. Controversial results had better be bomb-proof before we accept them willingly.

3 comments