Requiring scientists to document their methods caused positive results in medical trials to plunge
The uncertainty of science: The requirement that medical researchers register in detail the methods they intend to use in their clinical trials, both to record their data as well as document their outcomes, caused a significant drop in trials producing positive results.
A 1997 US law mandated the registry’s creation, requiring researchers from 2000 to record their trial methods and outcome measures before collecting data. The study found that in a sample of 55 large trials testing heart-disease treatments, 57% of those published before 2000 reported positive effects from the treatments. But that figure plunged to just 8% in studies that were conducted after 2000. Study author Veronica Irvin, a health scientist at Oregon State University in Corvallis, says this suggests that registering clinical studies is leading to more rigorous research. Writing on his NeuroLogica Blog, neurologist Steven Novella of Yale University in New Haven, Connecticut, called the study “encouraging” but also “a bit frightening” because it casts doubt on previous positive results.
In other words, before they were required to document their methods, research into new drugs or treatments would prove the success of those drugs or treatment more than half the time. Once they had to document their research methods, however, the drugs or treatments being tested almost never worked.
The article also reveals a failure of the medical research community to confirm their earlier positive results:
Following up on these positive-result studies would be interesting, says Brian Nosek, a psychologist at the University of Virginia in Charlottesville and the executive director of the Center for Open Science, who shared the study results on Twitter in a post that has been retweeted nearly 600 times. He said in an interview: “Have they all held up in subsequent research, or are they showing signs of low reproducibility?”
Well duh! It appears the medical research field has forgotten this basic tenet of science: A result has to be proven by a second independent study before you can take it seriously. Instead, they would do one study, get the results they wanted, and then declare success.
The lack of success once others could see their methods suggests strongly that much of the earlier research was simply junk, not to be taken seriously.
Readers!
Every February I run a fund-raising drive during my birthday month. This year I celebrate my 72nd birthday, and hope and plan to continue writing and posting on Behind the Black for as long as I am able.
I hope my readers will support this effort. As I did in my November fund-raising drive, I am offering autographed copies of my books for large donations. Donate $250 and you can have a choice of the hardback of either Genesis: the Story of Apollo 8 or Conscious Choice: The origins of slavery in America and why it matters today and for our future in outer space. Donate $200 and you can get an autographed paperback copy of either. IMPORTANT! If you donate enough to get a book, please email me separately to tell me which book you want and the address to mail it to.
Please consider supporting my work here at Behind the Black. My analysis of space, politics, and culture, taken from the perspective of an historian, is almost always on the money and ahead of the game. For example, in 2020 I correctly predicted that the COVID panic was unnecessary, that the virus was apparently simply a variation of the flu, that masks were not simply pointless but if worn incorrectly were a health threat, that the lockdowns were a disaster and did nothing to stop the spread of COVID. Every one of those 2020 conclusions has turned out right.
Your help allows me to do this kind of intelligent analysis. I take no advertising or sponsors, so my reporting isn't influenced by donations by established space or drug companies. Instead, I rely entirely on donations and subscriptions from my readers, which gives me the freedom to write what I think, unencumbered by outside influences.
You can support me either by giving a one-time contribution or a regular subscription. There are four ways of doing so:
1. Zelle: This is the only internet method that charges no fees. All you have to do is use the Zelle link at your internet bank and give my name and email address (zimmerman at nasw dot org). What you donate is what I get.
2. Patreon: Go to my website there and pick one of five monthly subscription amounts, or by making a one-time donation.
3. A Paypal Donation or subscription:
4. Donate by check, payable to Robert Zimmerman and mailed to
Behind The Black
c/o Robert Zimmerman
P.O.Box 1262
Cortaro, AZ 85652
You can also support me by buying one of my books, as noted in the boxes interspersed throughout the webpage or shown in the menu above.
The uncertainty of science: The requirement that medical researchers register in detail the methods they intend to use in their clinical trials, both to record their data as well as document their outcomes, caused a significant drop in trials producing positive results.
A 1997 US law mandated the registry’s creation, requiring researchers from 2000 to record their trial methods and outcome measures before collecting data. The study found that in a sample of 55 large trials testing heart-disease treatments, 57% of those published before 2000 reported positive effects from the treatments. But that figure plunged to just 8% in studies that were conducted after 2000. Study author Veronica Irvin, a health scientist at Oregon State University in Corvallis, says this suggests that registering clinical studies is leading to more rigorous research. Writing on his NeuroLogica Blog, neurologist Steven Novella of Yale University in New Haven, Connecticut, called the study “encouraging” but also “a bit frightening” because it casts doubt on previous positive results.
In other words, before they were required to document their methods, research into new drugs or treatments would prove the success of those drugs or treatment more than half the time. Once they had to document their research methods, however, the drugs or treatments being tested almost never worked.
The article also reveals a failure of the medical research community to confirm their earlier positive results:
Following up on these positive-result studies would be interesting, says Brian Nosek, a psychologist at the University of Virginia in Charlottesville and the executive director of the Center for Open Science, who shared the study results on Twitter in a post that has been retweeted nearly 600 times. He said in an interview: “Have they all held up in subsequent research, or are they showing signs of low reproducibility?”
Well duh! It appears the medical research field has forgotten this basic tenet of science: A result has to be proven by a second independent study before you can take it seriously. Instead, they would do one study, get the results they wanted, and then declare success.
The lack of success once others could see their methods suggests strongly that much of the earlier research was simply junk, not to be taken seriously.
Readers!
Every February I run a fund-raising drive during my birthday month. This year I celebrate my 72nd birthday, and hope and plan to continue writing and posting on Behind the Black for as long as I am able.
I hope my readers will support this effort. As I did in my November fund-raising drive, I am offering autographed copies of my books for large donations. Donate $250 and you can have a choice of the hardback of either Genesis: the Story of Apollo 8 or Conscious Choice: The origins of slavery in America and why it matters today and for our future in outer space. Donate $200 and you can get an autographed paperback copy of either. IMPORTANT! If you donate enough to get a book, please email me separately to tell me which book you want and the address to mail it to.
Please consider supporting my work here at Behind the Black. My analysis of space, politics, and culture, taken from the perspective of an historian, is almost always on the money and ahead of the game. For example, in 2020 I correctly predicted that the COVID panic was unnecessary, that the virus was apparently simply a variation of the flu, that masks were not simply pointless but if worn incorrectly were a health threat, that the lockdowns were a disaster and did nothing to stop the spread of COVID. Every one of those 2020 conclusions has turned out right.
Your help allows me to do this kind of intelligent analysis. I take no advertising or sponsors, so my reporting isn't influenced by donations by established space or drug companies. Instead, I rely entirely on donations and subscriptions from my readers, which gives me the freedom to write what I think, unencumbered by outside influences.
You can support me either by giving a one-time contribution or a regular subscription. There are four ways of doing so:
1. Zelle: This is the only internet method that charges no fees. All you have to do is use the Zelle link at your internet bank and give my name and email address (zimmerman at nasw dot org). What you donate is what I get.
2. Patreon: Go to my website there and pick one of five monthly subscription amounts, or by making a one-time donation.
3. A Paypal Donation or subscription:
4. Donate by check, payable to Robert Zimmerman and mailed to
Behind The Black
c/o Robert Zimmerman
P.O.Box 1262
Cortaro, AZ 85652
You can also support me by buying one of my books, as noted in the boxes interspersed throughout the webpage or shown in the menu above.
Readers: the rules for commenting!
No registration is required. I welcome all opinions, even those that strongly criticize my commentary.
However, name-calling and obscenities will not be tolerated. First time offenders who are new to the site will be warned. Second time offenders or first time offenders who have been here awhile will be suspended for a week. After that, I will ban you. Period.
Note also that first time commenters as well as any comment with more than one link will be placed in moderation for my approval. Be patient, I will get to it.