How to have a credible scientific literature

February 5, 2012

My girlfriend took me to task after I wrote my rant on peer review: “You have to have some assurance that the scientific literature is believable.” I agree. In my rant, I publicly publicly promised that what I produced would be believable, my reputation on it. But she persevered, and I eventually disgorged my core belief on this subject: no intervention, whether it be peer review or something else, at the level of publication, can produce credibility.

Shocking, yes? But consider: all a peer reviewer has to go on is what the author wants him to have. They both know the same background material, and both know that unknown factors can make seemingly identical experiments done by different people contradict. All a reviewer can do is ascertain that, if there was fraud committed, it was skillfully done. Our potential fraudsters are scientists, highly trained and intelligent. I believe them capable of producing a skillful fraud if they wish. Peer review spreads the responsibility editorial decisions for journals around on the theory that, with enough heads, someone will be able to decide well. It does no more.

How can we have credibility, then? Remove the social forces that reward fraud, and then punish the act of fraud with shame and ostracism. If there is no benefit and only risk, only a few pathological minds will bother. What are the social forces? Essentially, temporal rewards: promotion, tenure, prizes, funding, minions, and not being fired.

I want to digress on the firing of academic scientists. At this point in time, all the funding comes from the scientist. Universities provide at best partial salary support and some money to get set up, and thereafter demand rent from the scientist, in exchange for teaching and committee duties in perpetuity. The university has only prestige and facilities to offer in return. Facilities are cheap, so why does the university hold power in this relationship? It has to be the prestige, which is a fine inducement to fraud. The power universities hold beyond what any other landlord renting facilities would needs to end. As for the rest of it, promotion and prizes and minions, get rid of it all. Tenure, in the civilized world, should go. Civilized countries today have freedom of speech built into their legal foundations. The rights tenure originally guaranteed are now guaranteed to all citizens.

What does the resulting scientific establishment look like? It should be relatively easy to get enough funding for a single person to run a frugal lab for four or five years at a stretch, and horribly difficult to get more. There is no official recognition. There are no prizes to compete for, no plum positions or sinecures unless you convince private citizens to endow you luxuriously. There are no armies of graduate students being driven through programs to support the prestige of their professors.

Inevitably someone will protest that without these incentives, why try to do important science? I feel slightly ridiculous even addressing the point, but it must be done: I have trouble imagining the mind that gets up every morning and says to itself, “I think I’ll do something humdrum and unimportant today.” Perhaps they exist, and for those minds we can install basic checks. At the end of your funding period your work has to be reviewed for renewal. If you haven’t produced anything at all, not even interesting, intermediate results, then you’re on probation. If you don’t produce anything twice around, you’re not funded. The standards need not be that high. We’re not talking about a large amount of money, no more than

Did you enjoy that? Try one of my books:
Nonfiction Fiction
Into the Sciences Monologue: A Comedy of Telepathy