Hey science, what’s going on?

2 October 2012 by Pete Etchells, posted in Uncategorized

To many, retracted science papers are an unfortunate part of the process. With the best intent, we are told, scientists are only human, and will inevitably make mistakes. And it's a good thing that retractions exist - it shows honesty and integrity in the system; that scientists are willing to admit to their mistakes, and correct them for the common good. Or so we've been led to believe. As Carl Zimmer notes in a recent New York Times piece, Nature reported last year that the rise in retraction rate exceeds the rise in the number of papers published in the last ten years - going up from about 30 retractions per year in the early 2000s, to as much as 400 in the last year. While at first this rise was welcomed by a wide range of parties, you can't help but feel that it's all starting to become a bit of an embarrassment. Why are so many papers being retracted?

In the wake of the scandals in social psychology earlier this year, coupled with similarly (although arguably worse) issues in anesthesiology, the answer is deeply worrying. In a recent paper in PNAS, Arturo Casadevall and colleagues reviewed over 2000 retracted biomedical and life science research articles, and suggested that a whopping 67% of these articles were retracted because of misconduct, including confirmed or suspected fraud (43%), duplicate publication (14%) and plagiarism (10%). Sit back, let it sink in, and think about that for a moment. That's nearly 1000 papers that have been retracted, because someone cheated, or was suspected of foul play.

There are a number of reasons why this is happening, some of which are neatly summarised by Diederik Stapel himself:

 

"...I did not withstand the pressure to score, to publish, the pressure to get better in time. I wanted too much, too fast. In a system where there are few checks and balances, where people work alone, I took the wrong turn."

 

This quote highlights two important points. One is the pressure to publish, which has always been present in academia, but has been compounded in recent years. The second is the inadequate regulation system that science currently uses to check for errors. Some of the factors that contribute to these problems include:

 

1)   The economic downturn has resulted in funding bodies having limited resources to distribute.

2)   As Dr Chris Chambers has recently pointed out, successful grant applications are increasingly being treated by Universities as outputs, when they are in fact inputs.  Universities inevitably see large grants as better than small grants, and in some cases, this has led to some institutions considering getting rid of academics who aren’t seen as bringing in the expected income.

3)   Large projects require established names and a substantial body of research backing them. Establishing yourself as a top researcher requires a strong publication record, which many equate to a large publication record.

4)   Academic journals prioritise the publication of novel results, and are resistant to the publication of null results or replication studies, resulting in an environment in which publication bias is actively, if unintentionally, nurtured.

5)   Scientists are pressured to produce novel results in order to publish in high-impact journals, particularly in regards to the upcoming REF.

6)   In some cases, time constraints on getting papers out may result in questionable ‘data-peeking’ techniques being rationalized and employed.

7)   Inadequate checks are in place to catch inappropriate behavior; often the raw data are unavailable, and the peer-review system frequently fails to detect inappropriate analyses.

 

All of these pressures can be particularly salient for early career researchers, for whom a publication in a decent journal may mean the difference between a good job and no job at all. So is it any wonder that such a crappy incentive structure has led to cheating?

There is a problem in science, and it's one that's been around for a while. I think more people know about it than they would care to admit, and while it's great that we're starting to seriously think about ways to tackle these problems (see here and here for good examples that there should be more of), what I really think is needed is a change in mentality by people at all levels in the system. I genuinely don't believe that anyone who has a career in science got into it for fame, money or glory; they got into it because they love the pursuit of knowledge. I fear that many of us have lost sight of that fact, drowned in a sea of impact factors, h-factors and grant lotteries. The problems that science faces are not the result of any one particular person alone. If we genuinely want to make a change, every single one of us has to stand up and make a difference, stop trying to lay blame at someone else's feet, and remember why we're here doing this work in the first place.

 


7 Responses to “Hey science, what’s going on?”

  1. Kinseher Richard Reply | Permalink

    The topic ´Near-Death Experiences´ (NDEs) is an example for very poor scientific research.
    With Google ["Immortality Project" Pfeiffer] you can find my comments with a new and complete explanation model for all NDE-phenomenons - based on Dr. Moody´s book ´Life after Life´ which was published 1975. My assertion is, that it would have been possible to explain the NDE-phenomenons already 1975.
    My explanation model is a severe accusation of bungle against scientists who did ´research´ on this topic - and who were not able to explain NDEs up to now..
    "The AWARE Study" was a study (of several years duration) which will be finished this year. And this year the project "Death, Immortality and the Afterlife" received a grant of $5M from the Templeton Foundation.
    These are only two expamples, running in 2012.

    Hey science, what´s going on? When my explanation model is correct - then NDE-papers of 37 years have to be retracted

  2. Kinseher Richard Reply | Permalink

    Dr. Etchells, I have looked up for your research topics.
    Maybe the ´slow motion perception´ which is reported by tennis-/baseball-players is of interest for you.
    With Google ["ready steady slow" discover magazine] you can find my comment(12) to the blog - with a short explanation of this phenomenon

  3. Fay Reply | Permalink

    During my undergraduate viva at the end of the degree, I found myself arguing passionately and vigorously that what I was calling "pure science" was being lost - that people were running experiments to prove something that they wanted to be true, rather than just find out whether or not it was. My degree was joint physiology and psychology. We had been unable to replicate the results of an experiment that had been submitted to Nature, and this was 1993. My interlocutors - both physiology professors - looked extremely uncomfortable at this assertion and advocation of pure science. I remember wondering if, at that point, I'd just talked myself out of a good degree...

    I guess nothing has really changed, has it...?

Leave a Reply