Please consider donating by giving either a one-time contribution or a regular subscription, as outlined in the tip jar below.
Regular readers can support Behind The Black with a contribution via paypal:
If Paypal doesn't work for you, you can support Behind The Black directly by sending your donation by check, payable to Robert Zimmerman, to
Behind The Black
c/o Robert Zimmerman
Cortaro, AZ 85652
You can also support me by buying one of my books, as noted in the boxes interspersed throughout the webpage. And if you buy the books through the ebookit links, I get a larger cut and I get it sooner.
The uncertainty of science: An analysis of scientific surveys suggests that one in five may contain fake data.
With few exceptions, they limited their analysis to studies that asked more than 1000 people at least 75 questions on a range of topics. And to be conservative, they forgave studies for which at least 95% of the data passed the test.
That made the results all the more worrying: Among 1008 surveys, their test flagged 17% as likely to contain a significant portion of fabricated data. For surveys conducted in wealthy westernized nations, that figure drops to 5%, whereas for those done in the developing world it shoots up to 26%.
To me the difference found between first and third world countries makes the results more believable. It suggests that survey companies who do these surveys have a problem that should be addressed. Instead, the research
is being hotly disputed by the Pew Research Center, one of the major funders of such surveys. And the organization has gone so far as to request the researchers desist from publishing their work.
Pew reviewed the questionable surveys and found evidence that the analysis produced some false positives. They used this as reason to reject its results entirely. That the analysis has also been successful in detecting fraud in several surveys apparently does not concern them.