Download Lectures on Biostatistics (1971). Corrected and searchable version of Google books edition
Download review of Lectures on Biostatistics (THES, 1973).
management bollocks
| A report has appeared on Regulation of Practitioners of Acupuncture, Herbal Medicine, Traditional Chinese Medicine. The report is written by people all of whom have vested interests in spreading quackery. It shows an execrable ability to assess evidence, and it advocates degrees in antiscience It would fail any examination. Sorry, Prof Pittilo, but it’s gamma minus.[Download the report] |  |
Alice Miles put it well in The Times, today.
“This week came the publication of the “Report to Ministers from the Department of Health Steering Group on the Statutory Regulation of Practitioners of Acupuncture, Herbal Medicine, Traditional Chinese Medicine and Other Traditional Medicine Systems Practised in the UK”. Otherwise known as twaddle.” . . .
“Regulate the practitioners – for safety, note, not for efficacy, as that is impossible to prove – and you give them official recognition. From recognition it is but a short hop to demand and then prescription: packet of Prozac, bit of yoga and a bag of dodgy herbs for you, sir.” . . .
“The Government responded on Monday – with a three-month consultation. So join in. Write to the Health Minister Ben Bradshaw at Richmond House, 79 Whitehall, SW1A 2NS. Write, on behalf of the NHS: “What I want for my 60th birthday is… the chance to provide medical, dental, and nursing care to all. And absolutely nothing else.”
Judging by Ben Bradshaw’s speech to the Prince’s Foundation, there may be a problem in conveying to him the evidence, but one can and must try.
Why is it that a health joutnalist can do so much better than a university head? Yes, the chair of the steering group is Professor R. Michael Pittilo BSc PhD CBiol FIBiol FIBMS FRSH FLS FRSA, Principal and Vice-Chancellor of The Robert Gordon University, Aberdeen. Despite all those impressive-lookin initials after his name, I believe that this is a very bad report.
Here is something about Prof Pittilo from his university’s web site (the emphasis is mine).
Professor Michael Pittilo joined The Robert Gordon University, Aberdeen, as Principal and Vice-Chancellor on 5th September, 2005.
After postdoctoral research on arterial disease at the University of London, he was appointed to Kingston University where he became Head of Life Sciences. In 1995 he became Foundation Dean of the Faculty of Health and Social Care Sciences at Kingston University and St George’s Medical School (University of London). He was appointed Pro Vice Chancellor at the University of Hertfordshire in 2001.
Professor Pittilo has held a number of additional roles, including chairing Department of Health working groups, and as a trustee for the Prince of Wales’s Foundation for Integrated Health. “
Notice that Prof Pittilo is a Trustee of the Prince’s Foundation for Integrated Health, source of some of the least reliable information about alternative medicine to be found anywhere.
This steering group is, as so often, a nest of vested interests. It does not seem to have on it any regular medical or clinical scientist whatsoever. Why not? They just might produce some embarrassing facts perhaps? Like most government committees its members seem to have been chosen to produce the desired outcome.
For a start, the university run by Prof Pittilo, Robert Gordon’s University, is itself involved in a few antiscientific courses. Since his report recommends that degrees in quackery should become mandatory, I expect he’d welcome the chance to run more. Amazingly, Robert Gordon’s University runs an Introduction to Homeopathy, just about the daftest of all the common sorts of magic medicine.
Most of the the members of the steering group represent vested interests, though strangely this is not made clear in the list of members. An earlier report, in 2006, from the steering group was more open about this. Twelve of the members of the group represent Herbal Medicine, Chinese Medicine and Acupuncture (four from each). Most of the rest are lay members or bureaucrats. With membership like that it is, I suppose, not surprising that the assessment of evidence is, to put it kindly, grossly distorted and woefully inadequate.
The report starts badly by failing to mention that the House of Lords report (2000), and the government’s response to it, set the following priorities. Both state clearly
“… we recommend that three important questions should be addressed in the following order . .
- (1) does the treatment offer therapeutic benefits greater than placebo?
- (2) is the treatment safe?
- (3) how does it compare, in medical outcome and cost-effectiveness, with other forms of treatment?
The word ‘placebo’ does not occur a single time in the main report (and only twice in the text of the seven appendices). But they do say (page 11):
“We recommend that public funding from the NHS should be used to fund CAM therapies where there is evidence of efficacy, safety and quality assurance.”
The evidence
The problem is that the assessment of the evidence for efficacy in the report is pathetically poor. The report, sad to say, consists essentially of 161 pages of special pleading by the alternative medicine industry, served up with the usual large dose of HR gobbledygook.
There is really no excuse for this utterly incompetent assessment. There have been plenty of books this year alone that make excellent summaries of the evidence, mostly written for the lay public. They should, therefore, be understandable by any university vice-chancellor (president). The one benefit of the upsurge in public interest in magic medicine is that there are now quite a lot of good clinical trials, and when the trials are done properly, they mostly confirm what we thought before: in most cases the effects are no more than placebo.
Here is one example. Annexe1 concerns “Developing Research and Providing an Evidence Base for Acupuncture and Herbal/Traditional Medicine Treatment”. The wording of the title itself suggests, rightly, that this evidence base does not exist, in which case why on earth are we talking about them as “professions”? The discussion of the evidence in Annexe 1 is nothing if not partial. But what do you expect if you ask herbalists to assess herbal medicine? An honest assessment would put them out of business. The eternal mantra of the alternative industry appears as usual, “Absence of evidence is, of course, not evidence of absence”. True of course, but utterly irrelevant. Annexe 1 says
“Acupuncture is a complex intervention and lack of a suitable placebo control has hindered efforts to evaluate efficacy”
This is simply untrue, In recent years enormous efforts have been put into devising controls for assessment of acupuncture, but they are entirely ignored here. One thing that has been established quite clearly is that it makes no difference where you put the needles, so all the talk of Qi and meridians is obvious mumbo-jumbo.
Have the authors of Annexe 1, and Professor Pittilo, not read the relevant studies? Two books this year have dealt with the question of evidence with great care. They are both by people who have been involved personally with acupuncture research, Prof Edzard Ernst and Dr Barker Bausell. Edzard Ernst is the UK’s first Professor of Complementary Medicine. Barker Bausell was research director of an NIH-funded Complementary and Alternative Medicine Specialized Research Center at the University of Maryland.
 |
 |
Singh and Ernst discuss thoroughly the question of controls and assess all the evidence carefully. Their conclusions include the following.
- The traditional principles of acupuncture are deeply flawed, as there is no evidence at all to demonstrate the existence of Ch’i [Qi] or meridians.
- By focussing on the increasing number of high-quality research papers, reliable conclusions from systematic reviews make it clear that acupuncture does not work for a whole range of conditions, except as a placebo.
- In short, the evidence is neither consistent nor convincing. It is borderline.
Barker Bausell was himself involved in designing and analysing trialsof acupuncture. His conclusions are even less positive.
“There is no compelling, credible scientific evidence to suggest that any CAM therapy benefits any medical condition or reduces any medical symptom (pain or otherwise) better than a placebo”.
These are serious authors with direct experience in CAM research, which is more than can be said of anyone on the steering group. Why are their conclusions ignored entirely? That is sheer incompetence.
Degrees in anti-science
One conclusion of the report is that
“The threshold entry route to the register will normally be through a Bachelor degree with Honours”
This is utter nonsense. It is quite obvious surely that you can’t award honours degrees until after you have the evidence. You can read on page 55 of the report
“3a: Registrant acupuncturists must:
understand the following aspects and concepts for traditional East-Asian acupuncture:
– yin/yang, /5 elements/phases, eight principles, cyclical rhythms, qi ,blood and body fluids, different levels of qi, pathogenic factors, 12 zang fu and 6 extraordinary fu, jing luo/ meridians, the major acupuncture points, East-Asian medicine disease categorisation, the three burners, the 4 stages/levels and 6 divisions
– causes of disharmony/disease causation
– the four traditional diagnostic methods: questioning, palpation, listening and observing”
This is utter baloney. Anyone who advocates giving honours degrees in such nonsense deserves to be fired for bringing his university into disrepute (and, in the process, bringing all universities and science itself into disrepute).
That includes also degrees that teach that “amethysts emit high yin energy“.
So what should be done?
If making peole do degrees in mumbo-jumbo is not the answer, what is? Clearly it would be far too draconian to try to ban quackery (and it would only increase its popularity anyway).
The answer seems to me to be quite simple. All that needs to done is to enforce existing laws. It is already illegal to sell contaminated and poisonous goods to the public. It is already illegal to make fraudulent advertisemants and to sell goods that are not as described on the label.
The only problem is that the agencies that enforce these rules are toothless and that there are a lot of loopholes and exceptions that work in favour of quackery. I have tried myself to complain about mislabelling of homeopathic pills to the Office of Fair Trading on the grounds that are labelled Arnica 30C but contain no Arnica. They solemnly bought a bottle and sent it to an analyst and of course they found no arnica, But nothing happened, because an exception to the usual law applies to homeopathic pills.
The Advertising Standards Authority is good as far as it goes. They quickly told Boots Pharmacies to withdraw advertisements that claimed CoQ10 “increased vitality”. But they can exact no penalties and they can’t deal with lies that are told to you orally, or with anything at all on the web.
The Health Professions Council (HPC) says that one of the criteria for registering new professions is aspirant groups must “Practise based on evidence of efficacy”. If that were actually applied, none of this process would occur anyway. No doubt the HPC will fail to apply its own criteria. On past form, it can be expected to adopt a “fluid concept of evidence“.,
One more thing, New European legislation was described recently in the BMJ
“Consumers in the United Kingdom are to receive stronger legal safeguards against products that claim, without any identifiable scientific evidence, to provide physical and mental health benefits such as tackling obesity or depression.”
“The scope of the legislation is deliberately wide and is the biggest shake up in consumer law for decades. It targets any unfair selling to consumers by any business.”
Politicians seem to be immune to rational argument when it comes to quackery. But a few legal actions under these laws could bring the house of cards tumbling so fast that this gamma-minus report would become rapidly irrelevant. There will be no shortage of people to bring the actions. I can’t wait.
Follow up
Dominic Lawson, 24 June 2008. An excellent column appeared today in the Independent. Dominic Lawson writes about the Pittilo report: “So now we will have degrees in quackery. What, really, is the difference between acupuncture and psychic surgery?“. The reference to that well known conjuring trick, “psychic surgery” as a “profession”, revealed here, causes Lawson to say
“It makes it clear that the lunatics have taken over the asylum. For a start, how could Philip Hunt, previously director of the National Association of Health Authorities and Trusts, possibly have thought that “psychic healing” constituted a “profession” – let alone one which would “develop its own system of voluntary self-regulation?”
“One can see how this might fit in with the Government’s “never mind the quality, feel the width” approach to university education. One can also see how established practitioners of such therapies might see this as a future source of income – how pleasant it might be to become Visiting Professor of Vibrational Medicine at the University of Westminster.
Thus garlanded with the laurels of academic pseudo-science, the newly professionalised practitioners of “alternative medicine” can look down on such riff-raff as the “psychic surgeons”
Once again I have to ask, how is it that we have to rely on journalists to prevent vice-chancellors eroding academic standards; indeed eroding simple common sense? I guess it is just another sign of the delusional thinking engendered by the culture of managerialism that grips universities.
The extent to which irrationality has become established in US Medicine is truly alarming I wrote about Quackademics in the USA and Canada on my last trip to the USA, and on my May trip I visited Yale, where I decided to try a full frontal attack. [download the poster]
Several US blogs have written about this phenomenon. For example the incomparable Orac at the The Academic Woo Aggregator , and Dr RW (R.W. Donnell) , see particularly his articles on How did pseudoscience get admitted to medical school? and What is happening to our medical schools? Abraham Flexner is turning over in his grave. Excellent US stuff too at Science-based Medicine (try this and this). There is also a good analysis of what’s happening at Yale by Sandy Szwarc at Junkfood Science.
Remember that the terms ‘integrative’ and ‘complementary’ are euphemisms coined by quacks to make their wares sound more respectable, There is no point integrating treatments that don’t work with treatments that do work.
‘Integrative Medicine’ at Yale says, like all the others on the roll of shame, says “we aim to improve awareness and access to the best in evidence-based, comprehensive medical care available worldwide”. They all pay lip service to being “evidence based”, but there is just one snag. It is untrue. In almost all cases, the evidence is either negative or absent. But this does not put them off for a moment. The whole process is simply dishonest.
The evidence
The evidence has been summarised in several books recently, The following books are particularly interesting because they are all ‘views from the inside. Edzard Ernst is the UK’s first Professor of Complementary Medicine. Barker Bausell was research director of an NIH funded Complementary and Alternative Medicine Specialized Research Center at the University of Maryland.
The first two books go through the evidence fairly and carefully. They show no bias against alternative treatments (if anything, I’d say they are rather generous in cases of doubt).
 |
|
For a first class US account try Barker Bausell’s Snake Oil Science
Bausell’s book gives an excellent account of how to test treatments properly, and of all the ways you can be fooled into thinking something works when it doesn’t. Bausell concludes
|
|
| For an excellent account of how to find the truth, try Testing Treatments (Evans. Thornton and Chalmers). One of the authors, Iain Chalmers, is a founder of the Cochrane library and a world authotity on how to separate medical fact from medical myth. |  |
It can now be said with some certainty that the number of alternative treatments that have been shown to work better than placebo is very small, and quite possibly zero,
With that settled, what’s going on at Yale (and many others on the roll of shame)?
David L. Katz, MD, MPH, FACPM, FACP, is founder and director of the Integrative Medicine Center (IMC) at Griffin Hospital in Derby, Connecticut. He is also an associate professor, adjunct, of Public Health and director of the Prevention Research Center (PRC) at the Yale University School of Medicine in New Haven, Connecticut.
That sounds pretty respectable. But he is into not just good nutrition, exercise, relaxation and massage, but also utterly barmy and disproved things like homeopathy and ‘therapeutic touch’.
| Watch the movie
It so happens that Yale recently held an “Integrative Medicine Scientific Symposium”. Can we find the much vaunted evidence base there? That is easy to answer because three hours of this symposium have appeared on YouTube. So this is the public face of Yale medical school. There’s some interesting history and a great deal of bunkum and double-speak. To save you time, I’ve cut out about 6 minutes from the movies. |
 |
View or download the movie here > [18.5 Mb, flv file].
Dean of education Richard Belitsky and Dr David Katz
Pretty remarble uh? Dr Katz goes through several different trials, all of which come out negative. And what is his conclusion? You guessed.
His conclusion is not that the treatments don’t work but that we need a “more fluid concept of evidence” .
It’s equally bizarre to hear Richard Belitsky, Dean of Medical Education at Yale saying he is “very proud” of this betrayal of enlightenment values. If this is what Yale now considers to be education, it might be better to go somewhere else.
This is not science. It isn’t even common sense. It is a retreat to the dark ages of medicine when a physician felt free to guess the answer. In fact it’s worse. In the old days there was no evidence to assess. Now there is a fair amount of evidence, but Dr Katz feels free to ignore it and guess anyway. He refers to teaching about evidence as ‘indoctrination’, a pretty graphic illustration of his deeply anti-scientific approach to knowledge. And he makes a joke about having diverted a $1m grant from CDC, for much needed systematic reviews, into something that fits his aims better.
Katz asks, as one must, what should we do if there is no treatment that is known to help a patient. That is only too frequent a problem. The reasonable thing to say is “there is no treatment that is known to help”. But Dr Katz thinks it’s better to guess an answer. There is nothing wrong with placebo effects but there is everything wrong with trying to pretend that you are doing more than give placebos. Perhaps he should consider the dilemmas of alternative medicine.
You can read about more about Yale’s activities here and in interviews here. Dr Katz says “The founding approach—and I think Andrew Weil, MD, gets the lion’s share of credit for establishing the concept —is training conventional practitioners in complementary disciplines”. Let’s take a look at this hero. Try, for example, Arnold Relman’s “A trip to Stonesville“.
“According to Weil, many of his basic insights about the causes of disease and the nature of healing come from what he calls “stoned thinking,” that is, thoughts experienced while under the influence of psychedelic agents or during other states of “altered consciousness” induced by trances, ritual, magic, hypnosis, meditation, and the like.”
“To the best of my knowledge, Weil himself has published nothing in the peer-reviewed medical literature to document objectively his personal experiences with allegedly cured patients or to verify his claims for the effectiveness of any of the unorthodox remedies he uses.”
Here is the advertisment for Andrew Weil’s nutrition symposium.
Not only does this yet again propagate the great antioxidant myth, but a few moments with Google show that it is riddled with vested interests, as already pointed out on Quackademics in USA and Canada.
What has brought medical schools down to this level?
That isn’t hard to see, The main thing is simply money. Very few university administrators have the intellectual integrity to turn down money, whatever the level of dishonesty that is required by its acceptance. You can buy a lot of silence for $100m
The US Taxpayer has given almost a billion dollars, via NIH.
Wallace Sampson, MD says of NCCAM
“. . it has not proved effectiveness for any ‘alternative’ method. It has added evidence of ineffectiveness of some methods that we knew did not work before NCCAM was formed”
“Its major accomplishment has been to ensure the positions of medical school faculty who might become otherwise employed in more productive pursuits.”
“Special commercial interests and irrational, wishful thinking created NCCAM. It is the only entity in the NIH devoted to an ideological approach to health.”
NCCAM has given money from some very dubious trials too, Both Orac on Respectful Insolence and Dr RW (R.W. Donnell) have written recently about the NCCAM-funded trial of “chelation therapy”, as first exposed in a devastating article by Kimball C. Atwood IV, MD; Elizabeth Woeckner, AB, MA; Robert S. Baratz, MD, DDS, PhD; Wallace I. Sampson, MD on Medscape Today. This is a $30 million, 5-year, phase 3 Trial to Assess Chelation Therapy (TACT) for coronary artery disease.
“But how did such a crappy study ever come to be, much less be funded by the NIH to the tune of $30 million? The answer, not surprisingly, involves one of the foremost promoters of quackery in the federal government, Representative Dan Burton (R-IN).”
“We conclude that the TACT is unethical, dangerous, pointless, and wasteful. It should be abandoned.”
Orac comments
“TACT is not the only example of an unethical and scientifically worthless trial being funded not because the science is compelling but because powerful lobbies and legislators who are true believers in woo applied pressure to the NIH to do them”
The Bravewell Collaboration is the other major source of money. Forbes Business says “Bravewell is not some flaky New Age group”. Well dead wrong there, That is precisely what it is.
This group of ultra-rich people, according to its boss, Christy Mack, has a
So Bravewell is corrupting the search for real knowledge and real cures with big bucks. You can buy a lot of hokum for $100m. |
 |
The money comes from Morgan Stanley,
|
 |
Bravewell is run by his wife, Christy Mack (Mack-the-wife?) Vice-President, The C.J. Mack Foundation, Member, Board of Directors, The Bravewell Collaborative.
The Flexner report.
The story of Bravewell stands in chilling contrast to another case of philanthropy. Andrew Carnegie’s foundation financed the report by Abraham Flexner, “Medical Education in the United States and Canada” (1910) [download, 15 Mb] . That report was responsible for dragging medical education out of the dark ages
almost a century ago. It resulted in creation of some of the best medical schools anywhere (including Yale).
“By educational patriotism I mean this: a university has a mission greater than the formation of a large student body or the attainment of institutional completeness, namely, the duty of loyalty to the standards of common honesty, of intellectual sincerity, of scientific accuracy.”
“The tendency to build a system out of a few partially apprehended facts, deductive inference filling in the rest, has not indeed been limited to medicine, but it has nowhere else had more calamitous consequences.”
Flexner (1910).
Now another philanthropist is using big bucks to reverse the process and push medicine back into the 19th century.
Flexner would have thought it quite inconceivable that in 2007 medical schools would be offering Continuing Medical Education in homeopathy.
Why are Yale’s academics so quiet about this?
Perhaps they don’t even know it’s happening. If they say firmly that they don’t want it, it will go,
It’s been done before
Florida State University, allegedly under political pressure, proposed to set up a school of Chiropractic. That would have made it Florida State school of snake-oil salesmanship. What a sad fate. [ Science magazine comment] [comment form Paul Lee] [Comment in St Petersburg Times]
But the academics stopped it. An FSU professor, Albert Stiegman, predicted the future campus map.
According to FSUnews
“The Florida Board of Governors voted 10-3 Thursday to deny Florida State University’s request to build a chiropractic school.”
“However, the passage of the bill for the chiropractic school by the Legislature seemingly bypassed the Board of Governors.”
In the end, reason won. Let’s hope that Yale follows their example.
Follow up
The problem of Yale has been taken up with great eloquence by some US commentators
Dr RW (R.W, Donnell): “Quackademic Medicine at Yale”
“By the way, where’s the AAMC in all this? Aren’t they supposed to be guardians of integrity and professionalism in medical education? Are they asleep at the switch or is money silencing them too?”
Orac (Respectful Insolence): “Integrative” medicine at Yale: A more “fluid” concept of evidence?”
“after the Dean of the Yale School Medicine embarrassed himself in the introduction by saying he’s proud of how far this nonsense has come, Dr. Katz takes the stage and demonstrates the sort of hostile attitude towards science that, if allowed to take root will be the death of scientific medicine in any meaningful form at U.S. medical schools”
Junkfood Science. Sandy Szwarc on “Quote of the day: ;We need a more fluid concept of evidence’”
“Will healthcare professionals and consumers . . . . speak out against these wellness programs being enacted by government agencies, insurers and employers? Or is the money too good?”
Science-based Medicine. Steven Novella writes on “Changing the rules of evidence“. When alternative medicine people do not like the evidence, they change the rules to get the outcome that they want, as seen so graphically in this post. They have always done this, but it is only recently that this sort of behaviour has been endorsed by places like Yale.
The Macho Response, another US blog, comments bluntly, in “Yale wants a more fluid concept of evidence”
This is beyond embarrassing – it’s a fucking crime – and it’s happening at Yale University and many others.
If you’re in the medical profession (and I know many of my readers are) you need to go here – now.
Kiosque Médias writes as follows
Pour ceux qui s’intéressent à la médecine et à la santé, le blog de David Colquhoun vaut probablement le détour. Ce professeur-chercheur au département de neurosciences, de physiologie et de pharmacologie de l’University College London y décrypte les résultats d’études médicales, en mettant l’accent sur les médecines alternatives. Et il est rarement tendre!
James Randi Newsletter. The hit rate soars after a recommendation this piece by the amazing Randi.
Hokum-Balderdash Assay. Edwardson writes
“Yale University is going to the ducks. It now has an Integrative Medicine program and in April held its first annual Integrative Medicine Scientific Symposium. I think there must’ve been a typo there. They must’ve meant “Ist Annual I.M. Pseudoscientific Symposium.” There! Now we’ve done away with the oxymoron.”
Why is Yale so secretive about its quackery department?,
Most universities are only to keen to boast about their grant income. Not in this case though. When I asked how they funded their quackery, all I got was a letter that had very obviously been drafted by a lawyer.
“As a private institution, Yale University is not generally subject to the U.S. Freedom of Information Act. We therefore respectfully decline to compile and provide the information you have requested.”
So pretty clear signs of guiltiness there.
Dr David Katz, yes, he of the “fluid concept of evidence”, has posted an article, Health Hazards of rhe Blogoshere. If it quacks like a duck . . .
It seems that he has been a bit alarmed by the reaction of the bloggers. It starts, rather pompously, thus.
“Being well educated does not guarantee you’ll always be right, and it certainly doesn’t guarantee everyone will agree with you. But it still matters. Or at least it used to “
But the rest if it reads less like a defence than as an admission of guilt, thus prompting the next item.
Paul Hutchinson’s blog
| A quack who admits it picks out a quotation from Dr Katz’s response and turned into a cartoon, released to the public domain, So here it is. |  |
Respectful Insolence.
Orac comments too, in “Fluid evidence” strikes back: Dr. Katz versus the skeptical blogsophere”. He does a terrific job in taking apart the response from the hapless Dr Katz.
“No, Dr. Katz does not like his first encounter with the medical blogosphere at all. Indeed, he is so unhappy that apparently a few weeks ago he tried t answer the bloggers who had raked him over the coals for blatantly advocating “integrating” unscientific woo like homeopathy with scientific medicine. Unfortunately for him, he did not do a particularly good job of it. Indeed, what most stood out as I read his rejoinder was that he does not answer a single substantive criticism leveled at his comments. Not one. Instead, he does what pretty much all woo-meisters do when criticized for shifting goalposts and appealing to other ways of knowing besides science as a means of “proving” that their preferred fairy dust works; he wraps himself in the mantle of the brave iconoclast willing to challenge accepted dogma and whines about the peons who criticized him, heaping contempt on the bloggers who had the temerity to criticize his advocacy for pseudoscience because to him they have not earned the right to criticize his (at least in his opinion, apparently) greatness in comparison to him.”
This is a fuller version, with links, of the comment piece published in Times Higher Education on 10 April 2008. Download newspaper version here.
If you still have any doubt about the problems of directed research, look at the trenchant editorial in Nature (3 April, 2008. Look also at the editorial in Science by Bruce Alberts. The UK’s establishment is busy pushing an agenda that is already fading in the USA.
Since this went to press, more sense about “Brain Gym” has appeared. First Jeremy Paxman had a good go on Newsnight. Skeptobot has posted links to the videos of the broadcast, which have now appeared on YouTube.
Then, in the Education Guardian, Charlie Brooker started his article about “Brain Gym” thus
Dr Aust’s cogent comments are at “Brain Gym” loses its trousers. |
 |
The Times Higher’s subeditor removed my snappy title and substituted this.
So here it is.
“HR is like many parts of modern businesses: a simple expense, and a burden on the backs of the productive workers”, “They don’t sell or produce: they consume. They are the amorphous support services” .
So wrote Luke Johnson recently in the Financial Times. He went on, “Training advisers are employed to distract everyone from doing their job with pointless courses”. Luke Johnson is no woolly-minded professor. He is in the Times’ Power 100 list, he organised the acquisition of PizzaExpress before he turned 30 and he now runs Channel 4 TV.
Why is it that Human Resources (you know, the folks we used to call Personnel) have acquired such a bad public image? It is not only in universities that this has happened. It seems to be universal, and worldwide. Well here are a few reasons.
Like most groups of people, HR is intent on expanding its power and status. That is precisely why they changed their name from Personnel to HR. As Personnel Managers they were seen as a service, and even, heaven forbid, on the side of the employees. As Human Resources they become part of the senior management team, and see themselves not as providing a service, but as managing people. My concern is the effect that change is having on science, but it seems that the effects on pizza sales are not greatly different.
The problem with having HR people (or lawyers, or any other non-scientists) managing science is simple. They have no idea how it works. They seem to think that every activity
can be run as though it was Wal-Mart That idea is old-fashioned even in management circles. Good employers have hit on the bright idea that people work best when they are not constantly harassed and when they feel that they are assessed fairly. If the best people don’t feel that, they just leave at the first opportunity. That is why the culture of managerialism and audit. though rampant, will do harm in the end to any university that embraces it.
As it happens, there was a good example this week of the damage that can be inflicted on intellectual standards by the HR mentality. As a research assistant, I was sent the Human Resources Division Staff Development and Training booklet. Some of the courses they run are quite reasonable. Others amount to little more than the promotion of quackery. Here are three examples. We are offered a courses in “Self-hypnosis”, in “Innovations for Researchers” and in “Communication and Learning: Recent Theories and Methodologies”. What’s wrong with them?
“Self-hypnosis” seems to be nothing more than a pretentious word for relaxation. The person who is teaching researchers to innovate left science straight after his PhD and then did courses in “neurolinguistic programming” and life-coaching (the Carole Caplin of academia perhaps?). How that qualifies him to teach scientists to be innovative in research may not be obvious.
The third course teaches, among other things, the “core principles” of neurolinguistic programming, the Sedona method (“Your key to lasting happiness, success, peace and well-being”), and, wait for it, Brain Gym. This booklet arrived within a day or two of Ben
Goldacre’s spectacular demolition of Brain Gym “Nonsense dressed up as neuroscience”
“Brain Gym is a set of perfectly good fun exercise break ideas for kids, which costs a packet and comes attached to a bizarre and entirely bogus pseudoscientific explanatory framework”
“This ridiculousness comes at very great cost, paid for by you, the taxpayer, in thousands of state schools. It is peddled directly to your children by their credulous and apparently moronic teachers”
And now, it seems, peddled to your researchers by your credulous and
moronic HR department.
Neurolinguistic programming is an equally discredited form of psycho-babble, the dubious status of which was highlighted in a Beyerstein’s 1995 review, from Simon Fraser University.
“ Pop-psychology. The human potential movement and the fringe areas of psychotherapy also harbor a number of other scientifically questionable panaceas. Among these are Scientology, Neurolinguistic Programming, Re-birthing and Primal Scream Therapy which have never provided a scientifically acceptable rationale or evidence to support their therapeutic claims.”
The intellectual standards for many of the training courses that are inflicted on young researchers seem to be roughly on a par with the self-help pages of a downmarket women’s magazine. It is the Norman Vincent Peale approach to education. Uhuh, sorry, not education, but training. Michael O’Donnell defined Education as “Elitist activity. Cost ineffective. Unpopular with Grey Suits . Now largely replaced by Training .”
In the UK most good universities have stayed fairly free of quackery (the exceptions being the sixteen post-1992 universities that give BSc degrees in things like homeopathy). But now it is creeping in though the back door of credulous HR departments. Admittedly UCL Hospitals Trust recently advertised for spiritual healers, but that is the NHS not a university. The job specification form for spiritual healers was, it’s true, a pretty good example of the HR box-ticking mentality. You are in as long as you could tick the box to say that you have a “Full National Federation of Spiritual Healer certificate. or a full Reiki Master qualification, and two years post certificate experience”. To the HR mentality, it doesn’t matter a damn if you have a certificate in balderdash, as long as you have the piece of paper. How would they know the difference?
A lot of the pressure for this sort of nonsense comes, sadly, from a government that is obsessed with measuring the unmeasurable. Again, real management people have already worked this out. The management editor of the Guardian, said
“What happens when bad measures drive out good is strikingly described in an article in the current Economic Journal. Investigating the effects of competition in the NHS, Carol Propper and her colleagues made an extraordinary discovery. Under competition, hospitals improved their patient waiting times. At the same time, the death-rate e emergency heart-attack admissions substantially increased.”
Two new government initiatives provide beautiful examples of the HR mentality in action, They are Skills for Health, and the recently-created Complementary and Natural Healthcare Council.(already dubbed OfQuack).
The purpose of the Natural Healthcare Council .seems to be to implement a box-ticking exercise that will have the effect of giving a government stamp of approval to treatments that don’t work. Polly Toynbee summed it up when she wrote about “ Quackery
and superstition – available soon on the NHS “ . The advertisement for its CEO has already appeared, It says that main function of the new body will be to enhance public protection and confidence in the use of complementary therapists. Shouldn’t it be decreasing confidence in quacks, not increasing it? But, disgracefully, they will pay no attention at all to whether the treatments work. And the advertisement refers you to
the Prince of Wales’ Foundation for Integrated Health for more information (hang on, aren’t we supposed to have a constitutional monarchy?).
Skills for Health, or rather that unofficial branch of government, the Prince of Wales’ Foundation, had been busy making ‘competences’ for distant healing, with a helpful bulletted list.
“This workforce competence is applicable to:
- healing in the presence of the client
- distant healing in contact with the client
- distant healing not in contact with the client”
And they have done the same for homeopathy and its kindred delusions. The one thing they never consider is whether they are writing ‘competences’ in talking gobbledygook. When I phoned them to try to find out who was writing this stuff (they wouldn’t say), I made a passing joke about writing competences in talking to trees. The answer came back, in all seriousness,
“You’d have to talk to LANTRA, the land-based organisation for that”,
“LANTRA which is the sector council for the land-based industries uh, sector, not with us sorry . . . areas such as horticulture etc.”.
Anyone for competences in sense of humour studies?
The “unrepentant capitalist” Luke Johnson, in the FT, said
“I have radically downsized HR in several companies I have run, and business has gone all the better for it.”
Now there’s a thought.
The follow-up
The provost’s newletter for 24th June 2008 could just be a delayed reaction to this piece? For no obvious reason, it starts thus.
“(1) what’s management about?
Human resources often gets a bad name in universities, because as academics we seem to sense instinctively that management isn’t for us. We are autonomous lone scholars who work hours well beyond those expected, inspired more by intellectual curiosity than by objectives and targets. Yet a world-class institution like UCL obviously requires high quality management, a theme that I reflect on whenever I chair the Human Resources Policy Committee, or speak at one of the regular meetings to welcome new staff to UCL. The competition is tough, and resources are scarce, so they need to be efficiently used. The drive for better management isn’t simply a preoccupation of some distant UCL bureaucracy, but an important responsibility for all of us. UCL is a single institution, not a series of fiefdoms; each of us contributes to the academic mission and good management permeates everything we do. I despair at times when quite unnecessary functional breakdowns are brought to my attention, sometimes even leading to proceedings in the Employment Tribunal, when it is clear that early and professional management could have stopped the rot from setting in years before. UCL has long been a leader in providing all newly appointed heads of department with special training in management, and the results have been impressive. There is, to say the least, a close correlation between high performing departments and the quality of their academic leadership. At its best, the ethos of UCL lies in working hard but also in working smart; in understanding that UCL is a world-class institution and not the place for a comfortable existence free from stretch and challenge; yet also a good place for highly-motivated people who are also smart about getting the work-life balance right.”
I don’t know quite what to make of this. Is it really a defence of the Brain Gym mentality?
Of course everyone wants good management. That’s obvious, and we really don’t need a condescending lecture about it. The interesting question is whether we are getting it.
There is nothing one can really object to in this lecture, apart from the stunning post hoc ergo propter hoc fallacy implicit in “UCL has long been a leader in providing all newly appointed heads of department with special training in management, and the results have been impressive.”. That’s worthy of a nutritional therapist.
Before I started writing this response at 08.25 I had already got an email from a talented and hard-working senior postdoc. “Let’s start our beautiful working day with this charging thought of the week:”.
He was obviously rather insulted at the suggestion that it was necessary to lecture academics with words like ” not the place for a comfortable existence free from stretch and challenge; yet also a good place for highly-motivated people who are also smart about getting the work-life balance right.”. I suppose nobody had thought of that until HR wrote it down in a “competence”?
To provoke this sort of reaction in our most talented young scientists could, arguably, be regarded as unfortunate.
I don’t blame the postdoc for feeling a bit insulted by this little homily.
So do I.
Now back to science.
This is an old joke which can be found in many places on the web, with minor variations. I came across it in an article by Gustav Born in 2002 (BIF Futura, 17, 78 – 86) and reproduce what he said. It has never been more relevant, so it’s well worth repeating. The title of the article was British medical education and research in the new century.
“The other deleterious development in UK research is increased bureaucratic control. Bureaucracy is notoriously bad for all creative activities. The story is told of a company chairman who was given a ticket to a concert in which Schubert’s Unfinished Symphony was to be played. Unable to go himself, he passed the ticket on to his colleague, the director in charge of administration and personnel. The next day the chairman asked, ‘Did you enjoy the concert?’ His colleague replied, ‘My report will be on your desk this afternoon’. This puzzled the chairman, who later received the following:
Report on attendance at a musical concert dated 14 November 1989. Item 3.
Schubert’s Unfinished Symphony.
- The attendance of the orchestra conductor is unnecessary for public performance. The orchestra has obviously practiced and has the prior authorization from the conductor to play the symphony at a predetermined level of quality. Considerable money could be saved by merely having the conductor critique the performance during a retrospective peer-review meeting.
- For considerable periods, the four oboe players had nothing to do. Their numbers should be reduced, and their work spread over the whole orchestra, thus eliminating the peaks and valleys of activity.
- All twelve violins were playing identical notes with identical motions. This was unnecessary duplication. If a larger volume is required, this could be obtained through electronic amplification which has reached very high levels of reproductive quality.
- Much effort was expended in playing sixteenth notes, or semi-quavers. This seems to me an excessive refinement, as listeners are unable to distinguish such rapid playing. It is recommended that all notes be rounded up to the nearest semi-quaver. If this were done, it would be possible to use trainees and lower-grade operatives more extensively.
- No useful purpose would appear to be served by repeating with horns the same passage that has already been handled by the strings. If all such redundant passages were eliminated, as determined by a utilization committee, the concert could have been reduced from two hours to twenty minutes with great savings in salaries and overhead.
- In fact, if Schubert had attended to these matters on a cost containment basis, he probably would have been able to finish his symphony.
In research, as in music, blind bureaucracy has the effect of destroying imaginative creativity. If that is truly valued, it must remain free from bureaucratic excesses. And indeed, the great strength of British science has always been the ability of curiosity-driven individuals to follow up original ideas, and the support that these individuals receive from organizations such as the MRC and the Wellcome Trust. This has given research workers the possibility to twist and turn in following up intuitions and ideas in other fields as well as their own. This freedom has been significantly eroded by job insecurity in universities and in commercial enterprises.”
Later in the article, Born talks about innovation in the pharmaceutical industry
“This ‘urge to merge’, which is affecting the pharmaceutical industry worldwide, is almost always claimed to be justified by the need for a larger research budget to sustain innovation. The actual evidence indicates that such mergers hide -for a while failure of innovation. An almost universal response to this problem has been to ‘streamline’ and ‘commercialize’ the process of research, with ultimate control vested in accountants rather than in pharmaceutically informed scientists. This has meant that the industry’s research and development programmes are being driven by technical novelties, notably computer- aided drug design, combinatorial chemistry, high-throughput screening and genomics. All these techniques are very cost-intensive and, what is worse, are superseding individual scientists with profound appreciation of disease mechanisms and knowledge of biochemical and pharmacological mechanisms. It is they whose ability to ask the crucial, often seemingly simple questions, that have led to blockbuster drugs. Outstanding British examples are James Black’s discovery of the gastric acid secretion inhibitors, and Hans Kosterlitz’s question whether the brain might perhaps contain some analgesic chemical like that in -of all things the poppy plant.”
“The fact is that drug discovery, like all discoveries, is more an individual than a team achievement, at least at the beginning. With a few notable exceptions, the trouble with the industry is summarized by a group research director at one of the leading pharmaceutical companies:
“Creative individuals are being driven out of the industry and being replaced by functionaries wbo parrot strategic maxims. Research is being driven by lawyers, financial experts, salesmen and market strategists who are completely unable to develop new ideas. It is doubtful whether there are any senior executives who understand the problem” (Drews, J., 1999 In quest of tomorrow’s medicine, Springer-Verlag, New York).
And further:
“Partly as a result of mismanagement and partly as a result of a search for solutions which takes no account of disease mechanisms and biomedical complexity, substantial parts of the pharmaceutical industry are failing to innovate at a rate which is needed for their health and for the health of the general public. Research management needs to be rethought with a much greater emphasis on creative individuals with a broad knowledge of biology and medicine, a lower emphasis on market research, and a greater openness to the information to be gained from clinical studies (Horrobin, D.F., 2000, Innovation in the pharmaceutical industry. J. R. Soc. Med. 93, 341 – 345. ).”
For more on keeping univeristies honest, see the excellent new blog, The storm breaking upon the university.
This is the third post based on a recent trip to North America (here are the first and second)
One aspect of the endarkenment, the Wal-Mart model of a university, is very much the same in the US as in the UK. At one US university, an excellent scientist offered the theory that an alien spacecraft had scattered spores across the land which developed into HR staff who appeared at first sight to be human, and who colonised academia.
The penetration of quackademics into US universities is a bit different from in the UK.
In the UK, the plague is restricted to sixteen or so ex-polytechnic universities which, to their great shame, actually offer Bachelor of Science degress in subjects like homeopathy. There are bits of quackery in good teaching hospitals (such as laying-on-of-hands at UCLH), but not very much.
In the USA and Canada, this sort of “vocational” training does not occur much in universities, but in separate colleges. The situation is worse there though, insofar as these colleges have been allowed to award titles like ‘doctor of naturopathic medicine (ND)’, for work that in no respect compares with what the rest of the world has to do to earn a doctorate. This prostitution of academic titles has not happened to anything like the same extent in the UK. How our own quacks would love it if they were allowed to call themselves ‘doctor’ and sport the initials ND (so easily mistaken for MD at first sight).
It is on the clinical side where the situation is far worse than in the UK. Almost every university hospital, including Harvard, Yale and Stanford, has departments devoted to fairy-tale medicine.
Quacks use a number of euphemisms to make themselves sound more respectable. First they became ‘alternative medicine’, then ‘complementary medicine’. Now the most-used euphemism is ‘integrative medicine’, which is favoured by most US universities (as well as by the Prince of Wales). Raymond Tallis pointed out that this seems to mean integration of treatments that don’t work with treatments that do work.
An official roll of shame for North American universities can be seen here (35 in USA and 4 in Canada). 
A bigger collection of 44 universities has been posted by the incomparable Orac at the The Academic Woo Aggregator. He’s had good support in the USA from DrRW (R.W. Donnell), see particularly his articles on How did pseudoscience get admitted to medical school? and What is happening to our medical schools? Abraham Flexner is turning over in his grave.
All these outfits have two things in common. They all claim to be scientific and evidence-based, and none has produced any real evidence that any of their treatments work.
Here are a few examples of what’s going on.
Yale University School of Medicine
The usual theme is expressed thus.
“Through open-minded exploration and rigorous scientific inquiry, we aim to improve awareness and access to the best in evidence-based, comprehensive medical care available worldwide, with the goal of optimizing health and healing for patients”
The driving force behind the woo seems to be a fourth year medical student, Rachel Friedman, so I wrote to her to ask what useful alternative treatments had been established by research at Yale. But she could not identify any. All I got was this.
“My best advice would be to do some medline searching of metaanalyses” there’s been enough research into some of these modalities to provide for a metaanalysis.”
So she was unable to produce nothing (and anyway. metanalyses, useful though they may be, are not research).. A glance at the Yale publications page shows why.
The Scripps Institute
Scripps Center for Integrative Medicine says
“In use at Scripps since 1993, Healing Touch is an energy-based, non-invasive treatment that restores and balances energy to help decrease pain and relieve associated anxiety.
Healing Touch is performed by registered nurses who recognize, manipulate and balance the electromagnetic fields surrounding the human body, thereby promoting healing and the well-being of body, mind and spirit.”
“Balances energy”?
“manipulate and balance the electromagnetic fields surrounding the human body”?
This is just meaningless baloney. And it come from the Scripps Institute.
The Oregon Health & Science University
OHSU is an excellent and well-respected research university where I have many friends. It was a pleasure to meet them recently.
But it also has a big department of “Complementary and alternative medicine” and an “Integrated medicine service”. There are some good bits of advice mixed up with a whole range of crazy stuff. Take their page on homeopathy.
“This therapy treats ailments with very small amounts of the same substance that causes the patient’s symptoms.”
WRONG. In most cases it is zero amount. To brush this fact under the carpet is simply dishonest (and perhaps a sign of guilt). Then comes this (my emphasis)..
Explanations for why homeopathy works range from the idea that homeopathic medicine stimulates the body’s own natural defenses to the idea that homeopathic medicine retains a “memory” of the original substance.
However, there is no factual explanation for why homeopathy works and more research is needed.”
WRONG. This statement carries (twice) the expicit message that homeopathy does work, quite contrary to a mountain of good evidence that it is merely a placebo. The statement is deceptive and dishonest. And it comes with the OHSU logo.
The University of Arizona
” Heal medicine”, “Transform the world?” Modest uh?
The University of Arizona Program in Integrative Medicine is certainly not modest in its claims, but its publications page shows that it doesn’t even attempt to find out if its “therapies” actually work.
Here is an example. They are advertising their Nutrition and Health conference
heavily.
There’s nothing wrong with good nutrition of course, but the ‘alternative’ approach is instantly revealed by the heavy reliance on the great antioxidant myth.
And look at the sponsors. The logo at the top is for Pistachio Health, a company that promotes pistachio nuts: “Delicious and good-for-you, pistachios are nature’s super heart-healthy snack. Nutrient dense, full of fiber and antioxidants, pistachios give you more bang per calories than any other nut.”.
The other advertisement is ‘POM Wonderful’, a company that sells and promotes pomegranate juice, “POM is the only pomegranate juice you can trust for real pomegranate health benefits”
No doubt pistachio nuts and pomegranate juice are perfectly good foods. But the health claims made for them are just marketing and have very little basis in fact.
Now let’s look at the speakers. Take, for example, Dr David Heber, MD., PhD. He is director of the UCLA Center for Human Nutrition at the University of California, Los Angeles, a professor of Medicine and Public Health, and the founding Chief of the Division of Clinical Nutrition in the Department of Medicine. He is the author of several books including “What Color is Your Diet” and the “L.A. Shape Diet.” With the possible exception of the books, you can’t sound like a more respectable and impartial source of advice than that.
But hang on. Dr Heber is to be seen in a video on the Pistachio Health web site doing what amounts to a commercial for pistachio nuts.
OK let’s take a look at one of Dr Heber’s papers. Here’s one about, guess what, pomegranate juice. “Pomegranate Juice Ellagitannin Metabolites Are Present in Human Plasma and Some Persist in Urine for Up to 48 Hours”. The work was “Supported by the Stewart and Lynda Resnick Revocable Trust and from the NIH/NCI grant P50AT00151”. So no problems there. Well not until you check POM Wonderful in Wikipedia, where you find out that Stewart and Lynda Resnick just happen to be founders of POM.
Of course none of these interesting facts proves that there is anything wrong with the work. But they certainly do show that the alternative nutrition business is at least as much hand-in-glove with big business as any other form of medicine. And we know the problems that that has caused.
So, if you want impartial advice on nutrition, sign up for the 6th Annual Nutrition and Health meeting. For “MD, DO, ND & other doctors”, it will cost you only $845 to register .
The meeting is being run by The University of Arizona College of Medicine and Columbia University’s College of Physicians and Surgeons.
The University of Arizona is, incidentally, also the home of the famous (or perhaps infamous) Gary Schwartz (see also, here). He “photographs” non-existent “energy fields” and claims to be able to communicate with the dead, and he is director of its Human Energy Systems Laboratory at the University of Arizona. He is also head of the inappropriately-named Veritas Research Program and “Centre for Frontier Medicine in Biofield Science”. All of these activities make homeopathy look sane, but he is nevertheless part of an otherwise respectable university. In fact he is He is Gary E. Schwartz, Ph.D. is professor of psychology, medicine, neurology, psychiatry and surgery at the University of Arizona. Even more incredibly, this gets NIH funding.
Columbia University, along with Cornell, also has its own “Complementary, alternative, and integrative medicine“, defined as “the use of treatments, such as homeopathic medicine, ayurveda, botanical dietary supplements”. And their “Integrative Therapies Program for Children” is intimately tied up with a company called Origins, which is more a cosmetics company, Origins” (with all the mendacity that implies). They say
“Origins understands the importance of addressing wellness through an integrative approach,” says Daria Myers, President of Origins Natural Resources. “With our recent Dr. Andrew Weil collaboration, Origins demonstrated its support for the integrative wellness concept. Now, with the introduction of the new Nourishing oil for body and massage, we hope to bring not only a moment of comfort but also a healthy future to children enduring the fight of their life.”
Andrew Weil is, of course, the promoter of the Arizona meeting.
The corruption of Universities by this sort of activity is truly amazing.
The Corporate Corruption of Higher Education: part 2.
| Scientists are no longer perceived exclusively as guardians of objective truth, but also as smart promoters of their own interests in a media-driven marketplace. Haerlin & Parr, Nature, 1999, 400, 499. |
University of Sheffield and Proctor & Gamble
Dr Aubrey Blumsohn MBBCh, PhD, MSc, BSc(hons), FRCPath was, until 2006, a senior lecturer and honorary consultant in metabolic bone diseases at Sheffield University. He, and his boss, Richard Eastell, were doing a clinical study of a Procter & Gamble Pharmaceuticals (P&G) drug, Actonel (risedronate), The work was funded by Procter & Gamble.
Richard Eastell is Professor of Bone Metabolism, and was Research Dean.
Proctor & Gamble refused, from 2002 onwards, to release the randomisation codes for the trial to the authors whose names appear on the paper. After trying to see the data for years, and getting little support from his employer, Blumsohn subsequently got hold of it in 2005, and then discovered flaws in the analysis provided by P&G’s statistician. P&G wrote papers on which the names of university academics as authors. Blumsohn did the only thing that any honest scientist could do: he went public with his complaint.
The result? Blumsohn has had to leave Sheffield Richard Eastell remains.
Attempts to find out what has been done by the University of Sheffield meet with silence.
Compare and contrast these two extracts (the emphasis is mine).
The first one is from Eastell, Barton, Hannon, Chines, Garnero and Delmas, 2003. (Barton and Chines were employees of Proctor & Gamble, who paid for the study). Read the full paper here
| ACKNOWLEDGMENTS We would like to acknowledge the help of Dr Simon Pack and Lisa Bosch of Procter & Gamble Pharmaceuticals, as well as the help of Oldham Hospital Clinical Chemistry Department for measuring urinary CTX and creatinine. This study was supported by grants from Procter & Gamble Pharmaceuticals, Inc. (Cincinnati, OH) and Aventis Pharma, Bridgewater, NJ. Employees of Procter & Gamble Pharmaceuticals and Aventis Pharma participated in the design and execution of the study, the analysis of the data, and the preparation of the manuscript. All authors had full access to the data and analyses. |
| In the original paper,(1) one of the authors, a statistician working for P&G (IB), had full access to all data. P&G (like most pharmaceutical companies we contacted over this issue) used the PhRMA guidelines in relation to publication of clinical trial data, and these restrict the release of original data to investigators (http://www.phrma.org/).At the time of writing (2002/03), not all the original authors were given access to the raw data. In 2006, the American Association of Medical Colleges published recommendations regarding access to raw data. These proposed that the sponsor may conduct all the analyses but that the investigators should be able to conduct their own analysis if they deem it to be necessary, and we endorse these recommendations. |
“The only thing that we have to watch all the time is our relationship with P&G. Because we are… we have the big Sheffield Centre Grant which is a good source of income, we have got to really watch it. So, the reason why I worry is the network within P&G is like lightning. So if Ian [Barton] is unhappy it goes to Arkadi [Chines, global medical director of P&G Pharmaceuticals] and before we know it, there is an issue, there is a problem.”
Just listen to the audio recording, and weep for academic integrity
More detailed accounts of this story
This is a particularly interesting case because so much information about it is now available. A particularly good edition of the BBC Radio 4 programme, You and Yours, gave a lot of the evidence. Martin Bland. Professor of Medical Statistics at York University, explains that there is actually no evidence for the plateau effect claimed by P&G and by Eastell, an effect which, if real, would allow P&G to claim that Actonel was as good as its Merk rival, Fosomax. Your can read Martin Bland’s report here.
The presenter, Vivienne Parry, concludes
“But, what it very much looks like here is that we have a company buying independent scientific expertise to give its research that veneer of credibility, only for it to withold the data generated from independent scrutiny when the results don’t suit its marketing objectives”.
Blumsohn commented thus.
“Following a protracted period of trying to contact a number of university officials to discuss this problem, I realised that raising of the problem within the university was going to prove impossible. I then engaged a lawyer and very shortly after the university suspended me from my position on the principal grounds of disobeying a supposedly reasonable mangemant instruction by communicating with the media.”
Here are some links..
- BBC Radio 4: You and Yours (2 February, 2006). ” [download realplayer file]
- Investigative Journalist, by Jennifer Washburn gave an excellent account of this whole sorry affair ” Rent-a-Researcher. Did a British university sell out to Procter & Gamble?”. It has links to many of the emails that were sent.
- Observer (4 December 2005) How the drugs giant and a lone academic went to war.
- The Alliance for Human Reserach Protection. An account from this New York-based organisation, “Scientific fraud and corruption” , and an earlier (Nov 2005) report.
- Aubrey Blumsohn’s own account, with original data and links to many sources, Proctor Research Shenanigans
- Freedom to care, “Drug Company’s Pretence“
- The Times Higher Education Supplement published a series of reports on the case. They are available only with a subscription, but click here for the latest,”Expert admits he did not have full access to data“
- A collection of media reports can be seen here.
Many of the emails make you shudder. For example, the following are extracts from an invitation to have a paper ghost-written by the Company that was sent to Eastell and Blumsohn by the company’s statistician (see the whole mail here). The emphasis is mine.
| To: r.eastell@sheffield.ac.uk, ablumsohn@sheffield.ac.uk CC: mroyer@twcny.rr.com, chines.aa@pg.com, pack.s@pg.com, david.cahall@aventis.com From: barton.ip@pg.com Date: Thu, 24 Apr 2003 14:36:41 +0100 Dear Richard and Aubrey I wanted to introduce you to one of The Alliance’s external medical writers, Mary Royer.Mary is based in New York and is very familiar with both the risedronate data and our key messages, in addition to being well clued up on competitor and general osteoporosis publications.. . .. . are you thinking of drafting the publications first and then let Mary take over or would you like Mary to write from the beginning? I’m very flexible. Mary and I have just finished writing a publication with Steven Boonen (Richard you will be contacted as you’re a co-author!) and Mary was involved at the very beginning and wrote from scratch. If you could let both Mary and I [sic] know how you envisage us all working together that would be extremely helpful. |
Why has the University of Sheffield done nothing about it?
It is one thing to find that some individuals are less than honest about reporting research. It is far more serious when the University does nothing about it. On the contrary, Sheffield effectively fired the wrong person, the person who was too honest to go along with the lies. Blumsohn eventually managed to get complete evidence, and indeed Eastell himslef, in the 2007 paper, admits that he’d lied about having complete access to the data. Yet nothing happened when Blumsohn wrote to Eastell, his Dean, his vice-chancellor or his personnel manager (the links show you the letters he sent). Because the university seemed intent on covering-up the wrongdoing, Blumsohn, very properly, did the only think that was left to him, and went to the media (e.g. THES).
This was then used by the university as an excuse to fire him.
Sheffield University has behaved abominably in this matter. And they refuse to say anything about it. After I wrote to the (new) vice-chancellor. Keith Burnett, this is what I got.
| I would like to reassure you that the University of Sheffield takes very seriously its responsibilities in the area of research integrity and always strives to act in a manner that upholds this, in accordance with its reputation. |
What can be done about corruption in universities?
Nature this week (1 Nov 2007) published an editorial, “Who is accountable“. Here are some quotations.
We suggest that journals should require that every manuscript has at least one author per collaborating research group who will go on record in a way that collectively vouches for the paper’s standards. Each would sign a statement with reference to Nature ‘s publication policies
as follows:“I have ensured that every author in my research group has seen and approved this manuscript. The data that are presented in the figures and tables were reviewed in raw form, the analysis and statistics applied are appropriate and the figures are accurate representations of the data. Any manipulations of images conform to Nature ‘s guidelines. All journal policies on materials and data sharing, ethical treatment of research subjects, conflicts of interest, biosecurity etc. have been adhered to. I have confidence that all of the conclusions presented are based on accurate
extrapolations from the data collected for this study and that my colleagues listed as co-authors have contributed and deserve the designation ‘author’.”Misconduct investigators go out of their way to spare anyone apart from the direct perpetrators, but they have indicated concerns over the degree of oversight within collaborations. If the damage to reputations were more widespread in the event of fraud, researchers would be even more fastidious about the data emanating from their labs and the due diligence they would impose. The chances of major frauds, with their disproportionate impact on the reputation of science as a whole, would be diminished.”
Wakefield, MMR and the Royal Free Hospital
This has been written about endlessly. Wakefield’s bad science has resulted in deaths from measles, and the safety of MMR has been investigated very thoroughly.
Again, the odd bad scientist is inevitable. What I would like to have seen investigated more openly is the complicity of the medical school (all this happened, thank heavens, shortly before the Royal Free Hospital Medical School became part of UCL). According to the very thorough investigation by Brian Deer:
“This “finding”, and massive publicity that the Royal Free hospital and medical school encouraged for it [through a press release , video news release and a televised press conference] launched a worldwide scare over the vaccine’s safety, triggering falls in immunisation rates, outbreaks of potentially fatal or disabling diseases, and an epidemic of unwarranted self-recrimination among parents of autistic children. ”
“Although Wakefield had performed no research upon which to credibly base such a recommendation, this attack on MMR had been orchestrated through a 20-minute video news release , prepared weeks in advance and issued to journalists by the Royal Free hospital’s press office. In this video, which doctors knew was likely to cause public alarm, and damage to immunisation rates, Wakefield four times claimed that single shots were likely to be safer than MMR, which he said should be withdrawn by the government. ”
“Unknown to the public prior to the Dispatches investigation, nearly nine months before the press conference, Wakefield and the Royal Free medical school had filed the first in a string of patent applications for extraordinary products which could only have stood any chance of success if MMR’s reputation was damaged. These included, firstly, a single vaccine against measles – a potential competitor to MMR – and, secondly, purported remedies, perhaps even what they bizarrely called a ” complete cure “, for both inflammatory bowel disease and autism. “
Follow-up
May 2005. Eastell was suspended from his NHS post after allegations that he had wrongly charged the health service for lab tests carried out for his university work outside the NHS. He resigned before a verdict could be delivered and thus escaped judgement.
November 2009 Eastell faced a General Medical Council “fitness to practice” hearing. The GMC evidently does not consider that lying in a scientific paper is misconduct (no, really). The hearing said that Eastell’s actions had not been “deliberately misleading or dishonest”, although he may have been negligent in making “untrue” and “misleading” declarations; the council did not make a finding of misconduct.. There is no "may have been", It is in print, in black and white. The GMC were utterly pusillanimous in this case. Another example of a useless regulator.
18 February 2010. A young radiologist in Sheffield, Guirong Jiang, found results which suggested that the field of osteoporosis might be distorted by the over-diagnosis of vertebral fractures (a finding that might reduce the sales of osteoporosis drugs). She was told by Eastell not to publish it. She had to go through disciplinary proceedings. Like Blumsohn, she got no support from the university: quite on the contrary. The university said her actions breached the terms of a 2007 contract with Sanofi-Aventis, an agreement that she had neither seen nor signed.
When universities behave like this it becomes hard to believe anything published by the University of Sheffield.
The Corporate Corruption of Higher Education: part 1
The next post is about examples from the UK.
 |
|
The problem in the USA came to the fore with the passage of the Bayh-Dole Act (1980). This act allowed universities to patent ‘inventions’ that came from research funded by the taxpayer, and, far worse, allowed them to grant exclusive licences to a single commercial company. Although as originally formulated the act contained safeguards, these were mostly stripped out by the time it was passed. The nominal reason for the Act was “to bring ideas out of the ivory tower and into the market place more quickly”.
Nothing wrong with that of course. But Washburn chronicles how, not only did it fail to fulfil that aim, but corrupted universities as well. In fact with only a handful of exceptions, it did not even generate any large income for the universities. Nevertheless, the Act is still in place.Here are some examples from the USA. Examples from the UK are in a separate post.
Stanford University, Garry Nolan and Rigel Pharmaceuticals
David Zapol went from MIT to be a graduate student in Stanford, in June 1996. At the time he arrived his supervisor, Garry Nolan, set up a company, Rigel Pharmaceuticals Inc. to exploit genomic screening Stanford licensed to technology exclusively to Nolan’s company.
Although the lab was meant to be separate from the Company, that was obviously impossible. Zapol, and fellow student Michael Rothenberg,. were asked by Nolan to work on “proof of concept” for Rigel’s technology. The students found that “I can;t get time with my adviser and he’s completely preoccupied” [with the company]. A year later, Rothenberg came to the lab distraught, and told Zapol he’d been at Rigel’s offices hand had seen their “proof of concept” work shown in a company presentation for investors, with no acknowldegment of their authorship. Only they and Nolan knew about the work.
Washburn comments
When I asked Nolan to to respond to Zapol’s allegations concerning Rigel’s misuse of his students’ data, he replied in writing
“I do not have a memory of this event”
The research on which the spin-off company was based was (as so often) still unproven, and the two graduate students found themselves competing with scientists in the (better-finded) company owned by their supervisor. If the latter won, the university graduate students would end up with nothing to publish.
When, in 1997, Rothenberg emailed his supervisor, Nolan, the reply he got was openly threatening
“Please, do not be referring to this situation as ‘Rigel’s inappropriate use of my data without referencing me’ “. “Be careful what you say”
In April 1997, Rothenberg (who worked in the university remember) was warned by an executive of the company, Donald Payan, not to communicate with a colleague in another university who was working in the same area.
“You should know that he is one of the founders of Selectide, a major competitor of ours . . . ” “. The guys here will be less than pleased if the ideas they give you re structures etc . . . end up in the hands of Selectide. Get my drift?”.
Stanford seems to have made few attempts to investigate the matter properly. Both graduate students left (with no peer-reviewed publications). Nolan is still there. Why is this? Stanford University (as well as Nolan) had substantial equity in Rigel (sold in 2000-01 for over $0.9m) and Stanford owned six of Nolan’s patents. What do the careers of two graduate studenst matter when there are big bucks at stake? Not much it seems.
Rigel, incidentally, has yet to produce a useful drug, eleven years after
its founding
Washburn’s book has many such examples. What is particularly upsetting about them is, in many cases, not so much the behaviour of greedy or dishonest scientists, but the behaviour of their employers. In any case where much money is at stake, the university fails to defend the honest scientists, but is more interested in its income than in truth. One has come to expect companies to behave in this way. It is a shock to see universities do the same.
GSK, Seroxat and Brown University: academics for hire, a shocking story
BBC TV’s Panorama programme showed the latest investigation of GlaxoSmithKline’s suppression of evidence of side effects of Paroxetine (Seroxat, Paxil). It seems that television journalists and lawyers have been a great deal more effective in unearthing the evidence than the regulatory authorities or the police. The MHRA has been working on the case for three years and has still not produced its report. Read the transcript here .
Lawyers in the USA managed to extract many secret emails from GSK, and they tell a sad story. Since the deregulation of industry that started around 1979 with Ronald Reagan and Margaret Thatcher, one has become accustomed to dishonesty by big business. But academics are involved too GSK organised three large scale clinical trials of Seroxat on children with depression, in the hope of getting Seroxat licensed for this use. The biggest of these is known as ‘Study 329’. It is these trials that have given rise to the charge that GSK tried to suppress evidence that Seroxat caused an increase risk of suicide in young people.
Martin Keller is chair of psychiatry at Brown University. The evidence found by Panorama also shows that his reputation seems to be for hire. His university home page shows that he holds many influential politicians. It does not mention that in one year he got half a million dollars from drug companies including GSK.In one email Keller thanks a ghost writer who worked for a PR company hired by GSK.
|
 |
In another mail from the ghost writer to Dr Keller says that all the necessary materials are enclosed so that he can submit study 329 for publication, even down to the covering letter which says: “please re-type on your letterhead. Revise if you wish.”. Perhaps Keller at least checked the results carefully? But it seems not. Keller said
“I’ve reviewed data analytic tables, I don’t recall how raw it was. The huge printouts that list items by item number.. you know, item umbers, invariable numbers and don’t even have words on ’em. I tend not to look at those. I do better with words than I do with symbols.”
The BBC reporter , Shelley Jofre, comments “Inside GSK, though, the discussion was all about what a failure study 329 had been. This is what another of its PR people wrote when asked if the journal article would be publicised.” “Originally we had planned to do extensive media relations surrounding this study until we actually viewed the results. Essentially the study did not really show it was effective in treating adolescent depression which is not something we want to publicise.” [Email dated: 5th March 2001]
This is bad as any quackery, and the collusion of academics is very sad.
Brown University does not appear to have learned the lesson. The news section on their web site boasts of this ghost written work
“The largest clinical trial studying the use of antidepressants for treating major depression in adolescents suggests that paroxetine, sold under the brand name Paxil, may be successful.
“This is the first substantial evidence of a safe and effective treatment with an antidepressant for adolescents,” said Martin B. Keller, M.D., who led the study, which appears in the July issue of the Journal of the Academy of Child and Adolescent Psychiatry .”
Fiona Godlee , editor of the British Medical Journal, spoke on the programme. She had spotted the problems with the paper and declined to publish it. She comments “Another journal had peer reviewers who also spotted a number of the problems but the paper was published nonetheless relatively unchanged, and I think the journal must take some responsibility for that.”The editor of the ‘other journal’ ( Journal of the Academy of Child and Adolescent Psychiatry ) expressed no regrets.
See also “Ghost Authorship in Industry-Initiated Randomised Trials” by Gotzsche et al. ( PLOS Medicine 2007 ), and the commentary by Wagner , “Authors, Ghosts, Damned Lies, and Statisticians”. The latter concludes
“perhaps we should now admit that there are four types of lie: lies, damned lies, statistics, and the authorship lists of scientific papers, and that statisticians may be able to help prevent both the third and fourth types.”.
“More efficient administration” seems always to generate a lot of highly paid jobs that are for people who do neither research or teaching. Everywhere you look. there are advertisements for Faculty Administrators and Division Heads
I was about to say that ‘only time will tell whether the benefits of all these administrators exceeds their considerable costs’. But it is unlikely that time will tell, because nobody will look. I wonder how one could assess whether an adminstrator is worth the cost of 2 or 3 postdocs doing research? I’d be willing to bet that nobody in authority has even given a moment’s thought to that question.
The next wheeze is Research Facilitators
Here is an advertisement, somewhat shortened (the emphasis is mine).
| School Research Facilitator (3 posts) £44,075 – £49,607 p.a., plus London Allowance £2,572 We have 3 vacancies for the new role of School Research Facilitator. They will each take responsibility for research within one of the following groupings of Faculties (to be known in the future as “Schools”): -Biomedical and Life Sciences -Arts and Humanities, Social and Historical Sciences, Laws – Engineering, Architecture and Mathematical and Physical Sciences The role of each Facilitator will be to provide an interface comprising two main facets – an inward-facing relationship with the academic communities that they service, providing support for the application process, and an outward-looking role, interacting with, and providing intelligence about funding available from, the principal agencies relevant to their “School”, Governmental and private (charitable), UK and international. This is a new exciting high profile role requiring someone with a good knowledge of funding priorities, policies, schemes and processes with the ability to take a lead on determining research priorities within the designated area. The successful candidate may have an academic background or experience of making grant applications and knowledge of appropriate funding agencies or experience of working within a funding agency. |
So it seems that are research priorities are to be determined by administrators who are not scientists, and that these people will be paid more than most of the people who do the real research and teaching.
I find this genuinely baffling. In the Life Sciences most people who are any good get their funding from the MRC or the Wellcome Trust. There are endless web sites that list smaller charities. Why do we need a highly paid person to do what any competent researcher has always done, quickly and simply, for themselves?
This advertisement elicited the following comment from a correspondent (just remember, I never reveal my sources).
Xco Recruitment. Stuck in a rut? Overworked and underappreciated? Capable of reading and operating a world class search engine such as Google? Can you fill in a form? Then our clients – a Global but supposedly impecunious University have the job(s) for YOU!
SCHOOL RESEARCH FACILITATOR REQUIRED.
The post has two main facets so the applicant must be thin, one facet looks in and the other out, so the applicant probably shouldn’t dabble in Zen or other esoteric schools, as meltdown may occur positing which in is in or which out is out or is in in fact out. (,,,,,, I’m sorry I’m on job experience, please distribute these commas as you see fit in the previous phrase).
You will be responsible for advising Departments and Individuals (possibly “Schools” but these appellations are getting beyond me) what they should research into/on though you have to have no specialist knowledge in any field. (look I’m paraphrasing, I didn’t write the description – but if I were you I’d go for the Arts and Humanities one – it’ll be piss easy).
You will be paid a “relatively” large amount of money for trawling through a couple of internet sites and reading a specialist magazine called “Charities Today” or some such, you will then ‘phone up a few people and inform them that, “the Xco Cardifasterization Trust has a spare £5000 to give to anyone willing to mention them in a paper, £3000 for a typo” sadly after the university takes its overheads this will leave them owing the £450. Oh, yes, in the light of the larger Research Funders you may have to enterprise multitasking amongst a host of recalcitrant divas, therefore some diplomatic/railroading skills may be essential.
From a correspondent
A few days after posting this, I got the following comment from a correspondent,
| At our place creation of these jobs has been popular with HoDs and Grand Professors, as well as senior administrators. The reason is that the incumbents take work off the Grandeees, although their impact on the lives of lesser mortals is marginal. Apart from trawling websites and compiling “Bulletins” (usefulness borderline), sitting in meeting about “research strategy” (usefulness negligible), helping compile Departmental advertising (usefulness hard to quantify) and being able to nag other tardy bits of the admin about things on your behalf (occasionally useful), the other thing these folk do is spend time as amanuenses / PAs to the Leading Grand Professor(s). This is most notable when a Major Bid is in the offing – leading and fronting Major Funding Bids being, of course, just the kind of thing the research-intensive Univs think their leading Profs and HoDs should be spending their time doing. For instance, imagine DC is set to lead a multi-million ” Major Initiative to establish an Interdisciplinary Centre for Trans-species Proteomic and Genomic Analysis of the Ion Channel-ome”. Apart from a science case, this will require collection of loads of statistics and lots of generic highly-spun writing about the College’s “unmatched array of leading talents in ion channel research”, “21st century leading-edge facilities” and “peerless intellectual environment” etc etc. This is where the Research Support Person comes into their own, as they take on all work associated with the bid except drafting the main scientific case ¬ including writing the flannel. Keep an eye open for ex-postdocs of Deans, HoDs and senior Professors “transitioning” into such positions, is my tip. |
“This free market has generated a whole new breed of employee, especially in further education, the Bid Writer. In education nowadays the pen can be mightier than the chalk. Bid Writers are a special breed who can weave together and launch back at policy wonks all their own buzzwords, with the deadly accuracy of a guided missile, sending them into the sort of sustained ecstasy that loosens both critical judgment and purse strings.
“This synoptic overview summarises the operational strategy for delivering the procedural and content objectives to a world-class standard, within the parameters delineated in Annex A of Initiative 374B, glob glob, oodle oodle, turge turge.” Wonderful. Give that school a few hundred grand. “
Worthwhile policies graft seamlessly on to schools and eventually become their own. An ephemeral policy is merely a headline grabber, a wheeze, demeaning to both begetter and recipient. Who needs a physics teacher, when among today’s most highly esteemed pedagogues are wordsmiths who can deliver world-class meaningless bollocks to order?”
This is the title of a paper by Andrew D Oxman, David L Sackett, Iain Chalmers, Trine E Prescott (J R Soc Med 2005;98:563-568). Yes, the third author is Sir Iain Chalmers, the distinguished health services researcher, one of the founders of the Cochrane Collaboration, and Editor of the James Lind Library.
Summary
Background We are sick and tired of being redisorganized.
Objective To systematically review the empirical evidence for organizational theories and repeated reorganizations.
Methods We did not find anything worth reading, other than Dilbert, so we fantasized. Unfortunately, our fantasies may well resemble many people’s realities. We are sorry about this, but it is not our fault.
Results We discovered many reasons for repeated reorganizations, the most common being “no good reason”. We estimated that trillions of dollars are being spent on strategic and organizational planning activities each year, thus providing lots of good reasons for hundreds of thousands of people, including us, to get into the business. New leaders who are intoxicated with the prospect of change further fuel perpetual cycles of redisorganization. We identified eight indicators of successful redisorganizations, including large consultancy fees paid to friends and relatives.
Conclusions We propose the establishment of ethics committees to review all future redisorganization proposals in order to put a stop to uncontrolled, unplanned experimentation inflicted on providers and users of the health services.
And here is another bit.
Glossary of redisorganizational strategies
| Centralization (syn: merging, coordination): When you have lots of money and want credit for dispensing itDecentralization (syn: devolution, regionalization): When you have run out of money and want to pass the buck (i.e. the blame, not the money) down and out
Accordianization: When you need to keep everyone confused by instituting continuous cycles of centralization and decentralization. Best example: the NHS Equalization: When you have not (yet) sorted out which side is going to win Interpositionization: When you need to insert shock-absorbing lackeys between patients and managers to protect the latter from being held accountable (this strategy is often misrepresented as an attempt to help patients) Indecisionization trees: When you are massively uncertain and incompetent, picking numbers out of the air and placing them in diagrams. Also used as a party game at management retreats Matrixization structure: When your indecision tree has been exposed as meaningless twaddle, the introduction of a second indecision tree at right angles to it Obfuscasization: When you need to hide the fact that you have not a clue what is really going on, or what you should do about it. Makes heavy use of phrases such as “at this moment in time” instead of “now”, and transforms things that are simple and obvious into complicated and impenetrable muddles R&Dization: When you have been exposed as a power-mad fraud and are offered a compensation package just to get you out of town. Employs the ‘Rake it in and Disappear’ ploy Black hole effect: When a reorganization absorbs large amounts of money and human resources without producing any measurable output Honesty: When your corporate conscience urges you to admit that when you say, “It’s not the money it’s the principle”, it is the money. A dangerous and abandoned strategy, included here for historic purposes only. |
This post is nerdy university politics stuff, but it matters a lot to some of us.
I have always been impressed by the lack of interest that management theorists, and education theorists, show in subjecting their ideas to empirical tests. Edinburgh University was one of the first to go down the path down which other places (including UCL) are now heading like so many lemmings.
Edinburgh abolished their departments in 2002, and, in 2005 they conducted a review of what had ensued, The responses make interesting reading (not least because much of what they say is remarkably similar to points that I have made again and again, to no effect).
Sadly, I have only just come across these documents. I wonder if our own managers have read them?
Let’s start with quotations from the university’s 2005 review document
“In 2002 the University made some radical changes to its structures. It abolished its previous structure of Faculties and Departments for academic purposes and Faculty Groups and Planning Units for planning and resourcing, and replaced these with a single integrated structure consisting of three Colleges and 21 Schools. Previous arrangements for electing Heads of Department and Deans were replaced by competitive appointment to the new management positions, after external advertisement for Heads of College.”
. . .
3.1
The Review Group found, from the evidence provided and gathered, that the implementation of a new organisational structure in 2002 had been strategically astute, leading to clear benefits to the institution as a whole.. . .
This is not to say that feedback provided by colleagues to the Review was wholly positive
That last quotation must rank as as the understatement of the decade. You can read the responses at http://www.aaps.ed.ac.uk/restreview/responses/. Here are some quotations from them,
Professor R G M Morris, FRS, School of Biomedical & Clinical Laboratory Sciences
Like the Principal, I also think there are merits in the new arrangements that have already and will continue to yield benefits.
However, I think we should also have the courage and self-confidence to recognise a major downside. As I write, Harvard University is in uproar about some reported comments of their President, Larry Summers, about the paucity of women in science.
It would never happen at Edinburgh because – bluntly – we have become comatose. Perhaps I am not in the right place, but no one seems to discuss openly about anything that really matters to the University. We simply keep our heads down and try to get on with our teaching and research. Perhaps that is a good thing, and the debate at Harvard is but “hot air” when everyone would be better spending time in the lab or the library. But ‘m not sure. For there is a confidence and elan about the Harvard academic staff that, presently, seems to have been lost in Edinburgh – a loss that has coincided with the introduction of the Schools.
This loss is particularly reflected in the very few responses you have received to date to this circular. It is as if no one cares. And that, frankly, is deeply worrying. In the old rough and tumble of the ostensibly “inefficient” Departmental system, we would have regular staff meetings and actually debate things – and we did this because the voice of everyone in a Department mattered. We had postdoctoral staff and postgraduate students at our staff meetings – their voice mattered too and we listened to what they had to say. It feels to me that this overt recognition of the value of the academic community in Edinburgh is no longer the case. The School of which I am now a member has had two meetings in three years, and with so many people present in a large lecture theatre, the atmosphere was not conducive to discussion and debate.
In conclusion, Edinburgh University is at risk of becoming a place where bland, respectable comment replaces genuine debate. I am wary of this absence, because I am deeply distrustful of the credibility of anyone unprepared to debate openly and honestly. The senior management may, of course, be so busy juggling their managerial role with continuing academic life that they are unaware of this developing problem. Surely the business model can work hand-in-hand with a managerial framework that supports genuine intellectual debate?
Richard Morris, D.Phil., F.R.S.
Professor of Neuroscience
Division of Neuroscience
School of Biomedical & Clinical Laboratory Sciences
Dr Ian Astley, School of Literatures, Languages and Cultures, 18/02/05
I hardly know where to start with all this. It is abundantly clear, both from my own meditations and from discussions with colleagues — academic colleagues — that the recent changes to the university’s structure have been a radical contravention of everything which a university should stand for. Real opportunities for debate and democratic determination have been stifled, all in the service of a dogma of efficiency which it is impossible to describe or account for.
Professor Alan Murray, School of Engineering and Electronics, 4/02/05
One aspect of the old system that has, sadly, been largely lost, particularly in areas where modestly-sized departments have been merged in to larger schools, is the feeling of community and common purpose across research and teaching activities. The replacement of Departments by Research Institutes (and I am head of one) has not created new communities of the same nature and size. One particularly unfortunate result of this change has been the effective marginalisation of colleagues whose primary focus is on teaching and support of teaching activities.
Alan Murray
Professor Alan F. Murray,
Head of the Institute for Integrated Micro and Nano Systems,
School of Engineering and Electronics,
Dr Don Glass, School of Engineering & Electronics, 14/02/05
The restructuring has transformed the University into a rather top-down structure with a much smaller number of much larger administrative units.
The Research Institutes do not yet provide the sense of identity, cohesion and support that the old departments (whatever their failings) did. The Heads of Institute have done their best but are hampered by the physical dispersion of their staff and by restricted budgets.
Academic staff in particular, and technical and clerical staff to a lesser degree, feel that they are much less in control of their lives than was previously the case. This leads to stress and poor morale.
The Teaching Organisation has worked well at the strategic level (compliance with the requirements of the Curriculum Project, for example) and at the most basic level of timetabling, classroom allocation, collection of completed coursework, recording of marks etc. However, the diversity of the engineering disciplines and the curriculum requirements of the professional institutions have meant that accreditation, curriculum development and the allocation of teaching duties have fallen to the Heads of Discipline. These individuals have no budget at their disposal, no formal authority, no clerical or other support, no formal reward and little recognition. It is surprising that anyone can be found to take on the job.
Heads of School are expected to act as Line Managers for units containing in most cases over 100 academic and support staff. In industry or the civil service, this would be regarded as ludicrously burdensome, and I am at a loss to understand why the university feels that it can expect this level of output from its senior staff.
Improvement of the dissemination of information to ordinary members of staff would improve morale. In the old days, heads of department would ensure that their staff were kept abreast of developments: this does not happen to the same extent now. Equally, inclusion of more staff at an earlier stage in decision-making would not merely improve acceptance of change but would also possibly deliver better thought-out policy My suggestion would be to recognise the Disciplines as bodies responsible for professional representation, curriculum development and accreditation. They would provide a ‘home’ for staff excluded from the Research Institutes.
Professor Andrew Barker, School of Literatures, Languages and Cultures, 14/02/05
You write:
‘The process has been generally been well received and, as Principal and Vice-Chancellor Professor Timothy O’Shea points out, “has aroused interest (and even emulation) in other institutions”.’
And in so doing you simply add to the disenchantment which, as you must surely know, has followed upheavals of the last couple of years. Could you not have initiated the debate without such self-congratulatory spin?
At the same time as there have been gains, there have also been losses. Above all, and one hears the complaint time and again, it is felt that restructuring has led to a diminished sense of belonging to an academic community. The abolition of the democratic faculty structure has fuelled a feeling of disempowerment and atomisation which does not help morale at a time when colleagues are assailed by new developments on all sides
What is needed, I feel, is a movement to re-engage colleagues with the
university: to let them feel that it is indeed ‘their’ university, that they are not merely a workforce which is expected to respond to a series of diktats from above. At a quite mundane level, provision of common room facilities (so spectacularly absent for those working in the George Square area) would enable us to re-establish contact with colleagues from other disciplines.
Professor Charles Warlow, Professor of Medical Neurology, Molecular and Clinical Medicine, 14/02/05
I start from the position that the structure of a University should enable academics to do research and teach, and have time to think and write which are so important in both.
Clinical academics like myself are -for better or worse – often rather disconnected from the rest of their Universities, partly because we often work way from the centre of the University, partly because we don’t think in terms (or now semesters), and partly because we have patient care concerns. Nonetheless it is good to feel part of and supported by an institution which facilitates and nurtures our research and teaching. I did feel this, when I was in a group then called a Department of Clinical Neurosciences which was part of a faculty then called Medicine, all of which I could naturally relate to and which mapped on to my clinical work and teaching. But now we have Divisions (in my case more or less the same as the old Department), Centres and Schools -two extra layers of management between us in the trenches and the College (was faculty) and Head of College (was Dean). And we do not seem to have any ‘faculty’ meetings any more, one of the very few opportunities to meet up with colleagues from not just my own hospital but with others across town (the Royal Infirmary, Royal Edinburgh Hospital etc). It as an irony that as we have moved to Colleges we have become less ‘collegiate’.
For me there has not only been a loss of collegiality, and so opportunity for cross fertilisation between medical disciplines, but there has been no advantage in terms of teaching or research. As far as teaching goes, the Divisional, Centre and School structure seems to be all about research with an eye on the RAE – not teaching. And it is particularly inappropriate to exclude researchers from Centres, these people may well be struggling and so in need of support. The notion that the new administrative structure encourages inter-disciplinarity – in medical research at least – is just not true.
I cannot see any efficiency gains from where I sit. Personally, I feel more disconnected from the Heads of this and that than ever I did before (but I certainly do not envy them their task, far more complicated, bureaucratic and time consuming than ever it was when I was Head of Clinical Neurosciences)
Sadly however, although I once felt a sense of belonging and so loyalty to the University as a collegiate bunch of academics, in it for teaching and research, this is not so much how I feel now that it seems more of an impersonal business hierarchy.
Professor Jean Duffy, Professor John Renwick, Mr Philip Bennett, Dr Véronique Desnain, Dr Marion Schmid, School of Literatures, Languages and Cultures, 17/02/05
The new structures were originally presented to us, at the open meeting held by Stewart Sutherland, as a means of streamlining and reducing bureaucracy. Yet, the restructuring has involved the interposition of an extra administrative layer, the creation of a substantial number of administrative posts, including new senior management posts and a labyrinthine bureaucracy.
In an earlier exchange with Senior Vice-Principal Anderson regarding space matters, he commented that it is ‘virtually impossible to work out in any realistic way what the net cost [of the restructuring] (and the medium-term benefit) has been’. We find this extraordinary: any organisation employing a large workforce (in this case, 6,800 and Edinburgh’s third biggest employer, according to the web site) and with responsibility for the education of over 20,000 students and large amounts of taxpayers’ money ought to be able work out such sums.
Faculty meetings have been replaced by “plenaries” in which very little, if any, real business is done, no major decisions are ever taken (even in a School which voted to retain decision-making powers), and in which academics are informed about decisions that have been taken elsewhere. The former Faculty of Arts did have the capacity to influence the decisions of Central Management, even if it exercised that power rather too rarely. In the new structures, any power to influence has been effectively diluted, largely because we do not have an equivalent formal assembly designed to encourage or even permit full participatory debate and because the burden of representation falls upon a few individuals. Thus divided, we are much easier to rule, even if that was not the intention.
To be fair to the new Management Team, it did not create the original template for restructuring; as we understand it, it was presented with a fait accompli and a huge task of implementation. No doubt the new structures can be made to work in more user-friendly ways, but the University needs to relearn -and fast – how to listen to its academic staff. This institution has a great many staff who are committed to teaching and to research, who have willingly shouldered heavy administrative burdens often over long periods, and they have to feel that they have a voice.
The good will of academic staff is one of the University’s most precious resources; it is certainly its cheapest: after all, it is that good will which makes so very many individuals start work early, finish late, work every weekend and not take their full annual leave. If the University has common sense, it will invest in it, not exhaust it.
Professor Colin Nicholson, School of Literatures, Languages and Cultures, 18/02/05
In its 2001 Resolution concerning proposed changes to academic management the University Court made its intentions clear. In order to enable the university to respond effectively to the altered economic circumstances in which we must now operate, Court deemed it desirable:
to reorganise the system of academic management in the University “in a way which sustains the teaching and research of the University to the highest standards and which maintains and enhances the quality of the university as an academic community of international standing”.
These sensible priorities were echoed in a Court paper of March 2002 . . .
These intentions have been radically betrayed. In a range of senior voices all across the University, from Kings Buildings to George Square to High School Yards we are hearing the same thing -that an academic community now feels reduced to an atomised and disempowered workforce which is expected to respond to a series of diktats from above.
The expression and experience within and across the academic community, of disaffection, demoralisation, disenfranchisement and alienation that we have been reporting on for several months requires urgent redress.
Dr Sarah Carpenter, School of Literatures, Languages and Cultures, 18/02/05
But for equally practical reasons it actually it seems to have reduced the opportunities for academic co-operation with subject areas beyond the School. As a member of the former Faculty of Arts I encountered regularly colleagues from a range of disciplines across the Faculty, not only in Faculty meetings, but in administrative and other activities from which academic co-operation might flow. There is no longer any forum or space in which I encounter these colleagues.
There is certainly a strong perception among academic staff that the new system is in a phrase many have used “top-heavy”, and in some areas more rather than less cumbersome. In terms of streamlining and simplifying administrative procedure the system is experienced as adding a new layer.
The new structures have not allowed for any forums beyond the School in which staff can express and debate views, and pass them on to those who will make decisions (this is allied to the loss of meeting opportunities).
Probably allied to this is a perception that not only are decisions for implementation handed down from the centre, often by rather tenuous chains of information distribution, but that the university does not recognise or acknowledge the level of effort required to implement them.
Professor Brian Charlesworth, School of Biological Sciences, 04/02/05
I do not regard developments associated with the restructuring at all favourably. This has introduced a far more ‘top-down’ style of management, with over large units whose heads know little of what is going on at the grassroots level. The academic staff are being issued with orders instead of being consulted, and constantly being forced to implement ever more bureaucracy. In the long term, this will lead to creative people leaving the university, and only the mediocrities who are prepared to cringe to the men in suits will remain. I sense that this is already starting to happen.
It seems that little notice was taken of any of these comments. Well well, There’s a surprise.
How irrational thinking in government and universities has led to the rise of new-age nonsense in the name of science.
This article appeared on 15th August 2007, on the Guardian Science web site.
The Guardian made very few cuts to the original version, but removed a lot of the links. If you want to have references to some of the claims that are made, try the original, which I reproduce here. [Download this as pdf]
The Guardian Science site also has a piece on this topic by Alok Jha: Reigniting the enlightenment How do we win back our civilisation from the jaws of darkness?
Comments can be left there too.
A German translation of this piece has been posted at the Mental health blog.
A Russian translation (draft version) has appeared here . There is also a Russian translation of How to Get Good Science which can be found here.
Etymological note. The word endarkenment has been used by several people as an antonym for the enlightenment, but the first time it caught my eye was in an article in 2005 by Gerald Weissman, The facts of evolution: fighting the Endarkenment. The article opens thus.
“Those of us who practice experimental science are living in the best of times and the worst of times, and I’m not talking about A Tale of Two Cities, but a tale of two cultures.”
Science in an Age of Endarkenment
“Education: Elitist activity. Cost ineffective. Unpopular with Grey Suits. Now largely replaced by Training.” Michael O’Donnell, in A Sceptic’s Medical Dictionary (BMJ publishing, 1997).
The enlightenment was a beautiful thing. People cast aside dogma and authority. They started to think for themselves. Natural science flourished. Understanding of the real world increased. The hegemony of religion slowly declined. Real universities were created and eventually democracy took hold. The modern world was born. Until recently we were making good progress. So what went wrong?
The past 30 years or so have been an age of endarkenment. It has been a period in which truth ceased to matter very much, and dogma and irrationality became once more respectable.
This matters when people delude themselves into believing that we could be endangered at 45 minute’s notice by non-existent weapons of mass destruction.It matters when reputable accountants delude themselves into thinking that Enron-style accounting is acceptable.
It matters when people are deluded into thinking that they will be rewarded in paradise for killing themselves and others.
It matters when bishops attribute floods to a deity whose evident vengefulness and malevolence leave one reeling. And it matters when science teachers start to believe that the earth was created 6000 years ago.
These are serious examples of the endarkenment mentality, but I’ll stick with my day job and consider what this mentality is doing to science.
One minor aspect of the endarkenment has been a resurgence in magical and superstitious ideas about medicine. The existence of homeopaths on the High Street won’t usually do too much harm. Their sugar pills contain nothing. They won’t poison your body; the greater danger is that they poison your mind.
It is true that consulting a homeopath could endanger your health if it delays proper diagnosis, or if they recommend sugar pills to prevent malaria, but the real objection is cultural. Homeopaths are a manifestation of a society in which wishful thinking matters more than truth; a society where what I say three times is true and never mind the facts.
If this attitude were restricted to half-educated herbalists and crackpot crystal gazers, perhaps one could shrug it off. But it isn’t restricted to them. The endarkenment extends to the highest reaches of the media, government and universities. And it corrupts science itself.
Even respectable newspapers still run nonsensical astrology columns. Respected members of parliament seem quite unaware of what constitutes evidence. Peter Hain (Lab., Neath) set back medicine in Northern Ireland. David Tredinnick (Cons., Bosworth) advocated homeopathic treatment of foot and mouth disease. Caroline Flint condoned homeopathy, and Lord Hunt referred to ‘psychic surgery’ as a “profession” in a letter written in response to question by a clinical scientist
Under the influence of the Department of Health, normally sane pharmacologists on the Medicines and Health Regulatory Authority, which is meant to “ensure the medicines work”, changed the rules to allow homeopathic and herbal products to be labelled, misleadingly, with “traditional” uses, while requiring no evidence to be produced that they work.
Tony Blair himself created religiously-divided schools at a time when that has never been more obviously foolish, and he defended in the House of Commons, schools run by ‘young-earth creationists‘, the lunatic fringe of religious zealots. The ex-Head Science teacher at Emmanuel College said
“Note every occasion when an evolutionary/old-earth paradigm . . . is explicitly mentioned . . . we must give the alternative (always better) Biblical explanation of the same dataâ€:
That is not from the fundamentalists of the southern USA, but from Gateshead, UK.
The Blairs’ fascination with pendulum wavers, crystals and other new age nonsense is well known. When their elders set examples like that, is it any surprise that over 30% of students in the UK now say they believe in creationism and “intelligent design”? As Steve Jones has pointed out so trenchantly, this makes it hard to teach them science at all. Welcome back, Cardinal Bellarmine.
Homeopaths and herbalists may be anti-science but they are not nearly as worrying as the university vice-chancellors who try to justify the giving of bachelor of science degrees in subjects that are anti-science to their core. How, one may well ask, have universities got into the embarrassing position of having to answer questions like that?
Here are a couple of examples of how. The University of Bedfordshire (in its previous incarnation as the University of Luton) accredited a Foundation Degree course in ‘nutritional therapy’, at`the Institute of Optimum Nutrition (IoN). The give-away is the term Nutritional Therapy . They are the folks who claim, with next to no evidence, that changing your diet, and buying from them a lot of expensive ‘supplements’, will cure almost any disease (even AIDS and cancer).
The IoN is run by Patrick Holford, whose only qualification in nutrition is a diploma awarded to himself by his own Institute. His advocacy of vitamin C as better than conventional drugs to treat AIDS is truly scary. His pretensions have been analysed effectively by Ben Goldacre, and by Holfordwatch.. See the toe-curling details on badscience.net .
The documents that relate to this accreditation are mind-boggling. One of the recommended books for the course, on “Energy Medicine” (a subject that is pure fantasy) has been reviewed thus.
“This book masquerades as science, but it amounts to little more than speculation and polemic in support of a preconceived belief.”.
The report of Luton’s Teaching Quality and Enhancement Committee (May 24th 2004) looks terribly official, with at least three “quality assurance” people in attendance. But the minutes show that they discussed almost everything about the course apart from the one thing that really matters, the truth of what was being taught. The accreditation was granted. It’s true that the QAA criticised Luton for this, but only because they failed to tick a box, not because of the content of the course.
The University of Central Lancashire ‘s justification for its BSc in Homeopathic Medicine consists of 49 pages of what the late, great Ted Wragg might have called “world-class meaningless bollocks”. All the buzzwords are there “multi-disciplinary deliveryâ€, “formative and summative assessmentâ€, log books and schedules. But not a single word about the fact that the course is devoted to a totally discredited early 19th century view of medicine. Not a single word about truth and falsehood. Has it become politically incorrect to ask questions like that? The box-ticking mentality is just another manifestation of the endarkenment thought. If you tick a box to say that you are fully-qualifed at laying-on-of-hands, that is good enough. You have done the course, and it is irrelevant whether the course teaches rubbish.
These examples, and many like them, result, I believe from the bureaucratisation and corporatisation of science and education. Power has gradually ebbed away from the people who do the research and teaching, and become centralised in the hands of people who do neither.
The sad thing is that the intentions are good. Taxpayers have every right to expect that their money is well spent, and students have every right to expect that a university will teach them well. How, then, have we ended up with attempts to deliver these things that do more harm than good?
One reason is that the bureaucrats who impose these schemes have no interest in data. They don’t do randomised tests, or even run pilot schemes, on their educational or management theories because, like and old-fashioned clinician, they just know they are right. Enormous harm has been done to science by valuing quantity over quality, short-termism over originality and, at the extremes, fraud over honesty. Spoofs about the pretentiousness and dishonesty of some science, like that published in The New York Times last year, are too close to the truth to be very funny now.
Science, left to itself, and run by scientists, has created much of the world we live in. It has self-correcting mechanisms built in, so that mistakes, and the occasional bit of fraud, are soon eliminated. Corporatisation has meant that, increasingly, you are not responsible to your conscience, just to your line manager. The result of this, I fear, is a decrease in honesty, and in the long run inevitably a decrease in quality and originality too.
If all we had to worry about was a few potty homeopaths and astrologers, it might be better to shrug, and get on with trying to find some truths about the world. But now the endarkenment extends to parliament, universities and schools, it is far too dangerous to ignore.
Peter A. Lawrence of the Department of Zoology, University of Cambridge, and the MRC Laboratory of Molecular Biology, Cambridge has written a beautifully argued article, The Mismeasurement of Science. It appeared in Current Biology, August 7, 2007: 17 (15), r583. [Download pdf]
It should be read by every scientist. Even more importantly, it should be read by every vice chancellor and university president, by every HR person and by every one of the legion of inactive scientists who, increasingly, tell active scientists what to do.
Here are some quotations.
“The use of both the H-index and impact factors to evaluate scientists has increased unethical behaviour: it rewards those who gatecrash their names on to author lists. This is very common, even standard, with many people authoring papers whose contents they are largely a stranger to.”
“. . . trying to meet the measures involves changing research strategy: risks should not be taken . . .”
“. . . hype your work, slice the findings up as much as possible (four papers good, two papers bad), compress the results (most top journals have little space, a typical Nature letter now has the density of a black hole), simplify your conclusions but complexify the material (more difficult for reviewers to fault it!), . . . .it has become profitable to ignore or hide results that do not fit with the story being sold — a mix of evidence tends to make a paper look messy and lower its appeal.”
“These measures are pushing people into having larger groups. It is a simple matter of arithmetic. Since the group leader authors all the papers, the more people, the more papers. If a larger proportion of young scientists in a larger group fail, as I suspect, this is not recorded. And because no account is taken of wasted lives and broken dreams, these failures do not make a group leader look less productive.”
“It is time to help the pendulum of power swing back to favour the person who actually works at the bench and tries to discover things.”
The position of women
Lawrence argues eloquently a point that I too have been advocating for years. It is well known that, in spite of an increased proportion of women entering biomedical research as students, there has been little, if any, increase in the representation of women at the top. This causes much hand-wringing among university bureaucrats, who fail to notice that one reason for it is the very policies that they themselves advocate. Women, I suspect, are less willing to embrace the semi-dishonest means that are needed to advance in science. As Lawrence puts it
“Gentle people of both sexes vote with their feet and leave a profession that they, correctly, perceive to discriminate against them [17]. Not only do we lose many original researchers, I think science would flourish more in an understanding and empathetic workplace.”
The success of the LMB
It is interesting that Peter Lawrence is associated with the Laboratory for Molecular Biology, one of the most successful labs of all time. In an account of the life of Max Perutz, Danielle Rhodes said this.
“As evidenced by the success of the LMB, Max had the knack of picking extraordinary talent. But he also had the vision of creating a working environment where talented people were left alone to pursue their ideas. This philosophy lives on in the LMB and has been adopted by other research institutes as well. Max insisted that young scientists should be given full responsibility and credit for their work. There was to be no hierarchy, and everybody from the kitchen ladies to the director were on first-name terms. The groups were and still are small, and senior scientists work at the bench. Although I never worked with Max directly, I had the great privilege of sharing a laboratory with him for many years. The slight irritation of forever being taken to be his secretary when answering the telephone—the fate of females—was amply repaid by being able to watch him work and to talk with him. He would come into the laboratory in the morning, put on his lab-coat and proceed to do his experiments. He did everything himself, from making up solutions, to using the spectrophotometer and growing crystals. Max led by example and carried out his own experiments well into his 80s.”
Max Perutz himself, in a history of the LMB said
“Experience had taught me that laboratories often fail because their scientists never talk to each other. To stimulate the exchange of ideas, we built a canteen where people can chat at morning coffee, lunch and tea. It was managed for over twenty years by my wife, Gisela, who saw to it that the food was good and that it was a place where people would make friends. Scientific instruments were to be shared, rather than being jealously guarded as people’s private property; this saved money and also forced people to talk to each other. When funds ran short during the building of the lab, I suggested that money could be saved by leaving all doors without locks to symbolise the absence of secrets.”
That is how to get good science.
Now download a copy of Lawrence’s paper and send it to every bureaucrat in your university.
Follow up
- The Times Higher Education Supplement, 10 Aug 2007. had a feature on this paper. Read it here if you have a subscription, or download a copy.
- In the same issue, Denis Noble and Sir Philip Cohen emphasise the importance of basic research. Cohen says
“In 1994, after 25 years in the relative research wilderness, the whole thing changed.
“Suddenly I was the best thing since sliced bread,” Sir Philip said. “We set up the Division of Signal Transduction Therapy, which is the largest-ever collaboration between the pharmaceutical industry and academia in the UK.”
But the present research funding culture could prevent similar discoveries. “In today’s climate that research would not have been funded,” Sir Philip said. “The space programme hasn’t allowed us to colonise the universe, but it has given us the internet – a big payoff that industry could never have envisaged.” (Download a copy.)
- Comments from Pennsylvania at http://other95.blogspot.com
- How to slow down science. Another reference to Lawrence’s paper from a US (but otherwise anonymous) blog, BayBlab.
How to select candidates
I have, at various times, been asked how I would select candidates for a job, if not by counting papers and impact factors. This is a slightly modified version of a comment that I left on a blog, which describes roughly what I’d advocate
After a pilot study the entire Research Excellence Framework (which attempts to assess the quality of research in every UK university) made the following statement.
“No sub-panel will make any use of journal impact factors, rankings, lists or the perceived standing of publishers in assessing the quality of research outputs”
It seems that the REF is paying attention to the science not to bibliometricians.
It has been the practice at UCL to ask people to nominate their best papers (2 -4 papers depending on age). We then read the papers and asked candidates hard questions about them (not least about the methods section). It’s a method that I learned a long time ago from Stephen Heinemann, a senior scientist at the Salk Institute. It’s often been surprising to learn how little some candidates know about the contents of papers which they themselves select as their best. One aim of this is to find out how much the candidate understands the principles of what they are doing, as opposed to following a recipe.
Of course we also seek the opinions of people who know the work, and preferably know the person. Written references have suffered so much from ‘grade inflation’ that they are often worthless, but a talk on the telephone to someone that knows both the work, and the candidate, can be useful, That, however, is now banned by HR who seem to feel that any knowledge of the candidate’s ability would lead to bias.
It is not true that use of metrics is universal and thank heavens for that. There are alternatives and we use them.
Incidentally, the reason that I have described the Queen Mary procedures as insane, brainless and dimwitted is because their aim to increase their ratings is likely to be frustrated. No person in their right mind would want to work for a place that treats its employees like that, if they had any other option. And it is very odd that their attempt to improve their REF rating uses criteria that have been explicitly ruled out by the REF. You can’t get more brainless than that.
This discussion has been interesting to me, if only because it shows how little bibliometricians understand how to get good science.
That is the title of a paper in the BMJ (11 August 2007, 335, 304) by Anisur Rahman (reader in rheumatology, University College London). He points out the strong disincentives to collaborative work that now exist. One disincentive is the enormous amounts of documentation that is now needed for any sort of clinical research. Another disincentive lies in the daft assessment methods that are becoming fashionable, because they give you very little credit for being one among many authors.
“it could be argued that clinical academics who wish to thrive should avoid taking part in such collaborations—unless they are a lead author”.
Contradictions and stress
This paper highlights one of the things that makes academic life so stressful. We are constantly getting contradictory instructions, often from the same department (usually HR). Here are a few to start with.
- You must produce at least three world-shattering results per year, and everyone must all publish them in the same half-dozen journals. And you must do lots of teaching. And you must fill in all the forms sent to you by HR to say how long you spend on research (but not the hours please, just the percentage). Then the next letter says you must take your full holidays and work a 38 hour week for your work-life balance.
- We must have no bias against the appointment of women. But remember that the rules of the game make it almost impossible for a woman to get to the top in science if she wants to have children too.
- You must do lots of collaborative and interdisciplinary work (because that is the buzzword of the moment for the failed postdocs who staff the research councils and journals. Oh, and remember that you must not submit for RAE purposes
any paper that bears the name of a colleague with whom you collaborate. - You must employ only the most brilliant postdocs, but don’t be too assiduous about assessing their ability because that might cause bias. And, by the way, remember that it is essentially impossible to get rid of anyone, however incompetent.
- In order to ensure a big grant income (to be used in assessing promotion), you must employ lots of postdocs. That ensures you won’t have time to check too carefully what they do, much less do anything original yourself.
- You must have lots of collegiate spirit, and be able to recite by heart that excruciatingly embarrassing mission statement (oh, and by the way, your department has just been abolished).
The UK government, and UK vice chancellors, are exerting a lot of pressure to increase industrial funding in Universities. So far they haven’t listened at all to suggestions that research and commerce don’t mix well. It is asking too much of human nature to think that judgment about an experiment will not be influenced if you have a financial interest in one outcome rather than another. That is why the best researchers (at least in the biomedical field) avoid industry funding whenever possible: they want their results to be seen as independent.
It is well documented now that clinical trials tend to be distorted when they are funded by the pharmaceutical industry. See, for example, Lexchin, Bero et al,. in the British Medical Journal (2003), and Brennan et al. (2006) in the Journal of the American Medical Association, and the excellent book. The Truth About the Drug Companies, by Marcia Angell.
Brennan’s proposals for reducing this influence were well received on the whole, though they were opposed by a Dr K.J. Meador of Florida. But them Dr Meador’s letter ended with “Financial Disclosures: Dr Meador reported receiving grants from GlaxoSmithKline, Neuropace, SAM Technology, UCB, and the NIH; acting as a consultant to Abbott, Cyberonics, Eisai, GlaxoSmithKline, Neuropace, Novartis, Ortho McNeil, and UCB; obtaining honoraria from GlaxoSmithKline, Ortho McNeil, and UCB; and receiving salary from clinical electrophysiology, patient care, and an endowed chair at the University of Florida.”. Well, there’s a surprise.
It seems that this has dawned on the University of California. Their central administration, according to a report in Nature magazine (July 2007), has attempted to restrict the way the pharmaceutical industry buy favour in academia. The Nature editorial ends thus,
“. . . the latest policy tries to put the brakes on a trend towards heavier reliance on private funding that this fiscal squeeze has unleashed. The university’s campuses are understandably concerned about their ability to attract funding from all sources so that they can continue to operate at world-class levels. The best course available to them, nonetheless, is to follow the high standards that have recently been set at other academic medical centres, such as those at Stanford University, and to embrace the proposed policy. â€
Quite. It seems that the UK government and UK vice chancellors are going flat out for a policy that is already out of favour at Stanford. They are one step behind again. But then neither are Stanford, Yale and Harvard heading quite so enthusiastically down a path that takes power out of the hands of those who teach and do research.
Of course, Yale still has a Department of Pharmacology. Which is more than UCL has.
Postscript. There is nothing that the quackery industry likes to talk about more than the evils of Big Pharma. What they should remember is that the quackery industry is not only rich, but it is almost 100% fraud. Big Pharma may behave badly at times, but, with on the basis of pure research done largely in universities, they are also the folks who brought you general anaesthetics, antibiotics and all manner of things that have improved and lengthened lives.
Follow up
- There are some sensible comments about industry funding here. There are always problems, but in some areas they are perhaps not as big as in the biomedical business.
Jump to Times Higher Education coverage
This is a longer version of comments published in the Times Higher Education Supplement, June 1, 2007. This longer version has now been printed in full in Physiology News, 69, 12 – 14, 2007 [download the pdf version].
It has now been translated into Russian.
Download pdf version of this paper.
I should make it clear that the term ‘bean counter’ is not aimed at accountants (we need good honest accountants). Rather it is aimed at a small number of senior academics and HR people who do not understand how to assess people.
How to get good science
David Colquhoun, Department of Pharmacology, University College London (May 2007).
email me
The aim of this article is to consider how a university can achieve the best research and teaching, and the most efficient administration.
My aims, in other words, are exactly the same as every university vice-chancellor (president/rector/provost) in the country. Continue reading