Tag: peer review

Sixty science papers retracted

9:17 am

The uncertainty of peer review: An internal investigation has caused the retraction of sixty peer-reviewed scientific papers that were published by a single journal, the Journal of Vibration and Control (JVC).

The network of JVC papers that emerged was incestuous, with the same small group of authors reviewing each other’s work and appearing together as co-authors. By the end of the year, the investigators had a list of 130 e-mail addresses associated with 60 papers, with one scientist as co-author on all of them: Chen-Yuan Chen of NPUE, who goes by “Peter.” When SAGE sent an e-mail to all 130 e-mail addresses requesting that the authors confirm their identity, none responded. “The authors were contacted again by SAGE in May 2014 to inform them that their papers would be retracted in the July 2014 issue,” says Sherman, but again none responded. According to SAGE’s official statement, Chen resigned from NPUE in February. Neither Chen nor officials at NPUE responded to e-mails from ScienceInsider

How was it possible for a scientist to become the sole reviewer on dozens of his own papers? The answer appears to be that Chen was allowed to nominate his own reviewers, who were not vetted by JVC,

Chen apparently created fake gmail accounts for both real and non-existing scientists and then chose these scientists both as his co-authors as well as his peer-reviewers.

0 comments

“I think peer review is hindering science. In fact, I think it has become a completely corrupt system.”

8:22 am

From a Nobel Prize winner: “I think peer review is hindering science. In fact, I think it has become a completely corrupt system.”

Read the whole interview. The scientist outlines problems not only with peer review journals but with the whole structure of modern academic science, which to his mind would have prevented him from doing his Nobel Prize winning research had this system existed then.

0 comments

One of the publishers who had published fake peer-reviewed papers generated by a computer program has responded aggressively to fix the problem.

12:15 am

One of the publishers who had published numerous fake peer-reviewed papers generated by a computer program has responded aggressively to fix the problem.

And by aggressive I mean positively. They have removed the fake papers and are reviewing everything they’ve published, with the help of the guy who exposed the fakes, to make sure there aren’t any other fakes not yet identified. They also say they are reviewing their procedures to figure out how this happened and to prevent it from happening again.

2 comments

Two publishers of scientific journals have withdrawn 120 papers which they have discovered were nothing more than computer-generated gibberish.

10:56 am

Layers and layers of peer-review: Two publishers of scientific journals have withdrawn 120 papers which they have discovered were nothing more than computer-generated gibberish.

Over the past two years, computer scientist Cyril Labbé of Joseph Fourier University in Grenoble, France, has catalogued computer-generated papers that made it into more than 30 published conference proceedings between 2008 and 2013. Sixteen appeared in publications by Springer, which is headquartered in Heidelberg, Germany, and more than 100 were published by the Institute of Electrical and Electronic Engineers (IEEE), based in New York. Both publishers, which were privately informed by Labbé, say that they are now removing the papers. …

Labbé developed a way to automatically detect manuscripts composed by a piece of software called SCIgen, which randomly combines strings of words to produce fake computer-science papers. SCIgen was invented in 2005 by researchers at the Massachusetts Institute of Technology (MIT) in Cambridge to prove that conferences would accept meaningless papers — and, as they put it, “to maximize amusement” (see ‘Computer conference welcomes gobbledegook paper’). A related program generates random physics manuscript titles on the satirical website arXiv vs. snarXiv. SCIgen is free to download and use, and it is unclear how many people have done so, or for what purposes. SCIgen’s output has occasionally popped up at conferences, when researchers have submitted nonsense papers and then revealed the trick.

The real story here is that many of these gibberish papers were peer-reviewed by actual scientists who are supposedly experts in their fields and should have spotted the fakery immediately. That they didn’t suggests another level of corruption. Either they don’t really bother to peer review the papers they are asked to peer review, or they knew what was going on and were part of the game.

That this kind of stuff happens repeatedly in many fields of science should make us all very skeptical of any controversial scientific claim that carries with it any political component. This doesn’t mean that all published material is fake, only that we must not take anything on faith. Controversial results had better be bomb-proof before we accept them willingly.

3 comments

A bogus scientific paper, with numerous errors, was accepted for publication by more than 150 peer-reviewed scientific journals.

12:36 pm

A bogus scientific paper, with numerous errors, was accepted for publication by more than 150 peer-reviewed scientific journals.

The scientist purposely wrote a paper that should have been unacceptable for publication in order to see if peer-review would spot the problems. What he found was that more than half the journals to which he submitted didn’t notice or care, and accepted the paper as is.

The journals in this case were open-access, meaning that they are free to readers but charge authors money for publication. Thus, rejecting papers is against their financial interest. Nonetheless, the number of journals willing to be unethical is quite disturbing, and reveals a rottenness lurking in the heart of the science field that no one wants to talk about.

5 comments

A new study has found that scientific misconduct and fraud is on the rise.

11:14 am

A new study has found that scientific misconduct and fraud is on the rise.

A review of retractions in medical and biological peer-reviewed journals finds the percentage of studies withdrawn because of fraud or suspected fraud has jumped substantially since the mid-1970s. In 1976, there were fewer than 10 fraud retractions for every 1 million studies published, compared with 96 retractions per million in 2007.

The study’s authors suggest that the high pressure of big science might be a cause, combined with an overall decline in our culture itself. I wonder if the influence of government money, granted not because of good science but in the service of a political agenda, might also be a contributing factor.

0 comments

Another psychologist has resigned amid questions over the validity of his research.

5:38 pm

Another psychologist has resigned amid questions over the validity of his research.

This and other recent cases (here, here, here, here, here, here) are more evidence that the peer review process in some fields is badly broken, that the reviewers are too often not doing the reviewing they are supposed to, and in some cases might very well be participating in scientific fraud themselves.

4 comments

A investigation has found that Japanese anesthesiologist, Yoshitaka Fujii, fabricated a 172 scientific papers over the past 19 years.

12:50 pm

A investigation has found that Japanese anesthesiologist, Yoshitaka Fujii, fabricated a 172 scientific papers over the past 19 years.

The panel focused on 212 of 249 known Fujii papers. It tried to review the raw data, laboratory notebooks, and records on the patients or animal subjects involved. Committee members also interviewed relevant people. Among the 172 papers judged bogus, the report claims that 126 studies of randomized, double-blind, controlled trials “were totally fabricated.” The committee identified only three valid papers. For another 37 papers, the panel could not conclusively determine if there had been fabrication. …

The panel said that the responsibility of those co-authors ranges from “serious” to “none at all.” The only one of Fujii’s co-authors specifically named in the summary is University of Tsukuba anesthesiologist Hidenori Toyooka. The report says Toyooka “was not involved in fabrication but bears significant responsibility” since he was Fujii’s supervising professor both at Tsukuba and when they both worked at Tokyo Medical and Dental University. Toyooka is listed as a co-author of many of the papers cited by the 23 journal editors. … At the same time, the investigation found that some scientists were unaware Fujii had included them as co-authors. In one case, two supposed co-authors told the panel their signatures on a submission cover letter were forged. [emphasis mine]

For a scientist to get that many fabricated papers published for that long in peer-reviewed journals strongly suggests that there is widespread corruption in his field, which in this case is anesthesiology.

0 comments

Researchers have found that they cannot reproduce the results of 89 percent of 53 “landmark” cancer research papers.

12:05 pm

More bad news for peer-reviewed science: Researchers have found that they cannot reproduce the results for almost ninety percent of the fifty-three “landmark” cancer research papers they reviewed.

It is worse than you think. Consider this quote:

Part way through his project to reproduce promising studies, Begley met for breakfast at a cancer conference with the lead scientist of one of the problematic studies. “We went through the paper line by line, figure by figure,” said Begley. “I explained that we re-did their experiment 50 times and never got their result. He said they’d done it six times and got this result once, but put it in the paper because it made the best story. It’s very disillusioning.”

4 comments
1 2