LOB-vs
Download Lectures on Biostatistics (1971).
Corrected and searchable version of Google books edition

Download review of Lectures on Biostatistics (THES, 1973).

Latest Tweets
Categories
Archives

Universities

Jump to follow-up

This classic was published in issue 1692 of New Scientist magazine, 25 November 1989.  Frank Watt was head of the Scanning Proton Microprobe Unit in the Department of Physics at Oxford University. He wrote for the New Scientist an article on Microscopes with proton power.

In the light of yesterday’s fuss about research funding, Modest revolt to save research from red tape , this seemed like a good time to revive Watt’s article. It was written near to the end of the reign of Margaret Thatcher, about a year before she was deposed by her own party. It shows how little has changed.

It is now the fashion for grant awarding agencies to ask what percentage of your time will be spent on the project.  I recently reviewed a grant in which the applicants had specified this to four significant figures, They’d
pretended they knew, a year before starting the work that they could say how much time they’d spend with an accuracy better than three hours.  Stupid questions evoke stupid answers.

The article gave rise to some political follow-up in New Scientist, here and here.

Playing the game – The art of getting money for research

  • New Scientist
  • 25 November 1989
  • FRANK WATT

WELL, that’s it,’ thought the Captain. ‘We have the best ship in the world, the most experienced crew, and navigators par excellence. All we need now is a couple of tons of ship’s biscuits and it’s off to the ends of the world.’

NRC (Nautical Research Council) grant application no MOD2154, September 1761. Applicant: J. Cook.

Aim: To explore the world.

Requirements: Supplies for a three-year voyage.

Total cost: Pounds sterling 21 7s 6d.

January 1762: Application MOD2154,rejected by the Tall Ships subcommittee
of the NRC.

Reasons for rejection:

(a) No stated goal.

(b) No details of voyage beyond Africa.

(c) Insufficient details regarding any future discoveries.

‘Damn,’ thought the Captain, ‘that’s nailed our vitals to the plank good and
proper.’ ‘Come back in six months,’ he told his sturdy crew.

NRC grant application no MOD2279, April 1762. Applicant J. Cook.

Aim: To explore the world beyond Africa in a clockwise direction and discover a large continent positioned between New Guinea and the South Pole.

Requirements: Supplies for a three-year voyage.

Total cost: Pounds sterling 21 7s 7d (adjusted for inflation).

September 1762: Application MOD2279 rejected by the Castle and Moats subcommittee
of the NRC.

Reasons for rejection.

(a) Why discover a large continent when there are hundreds of castles in Britain.

(b) It is highly unlikely that Cook’s ship will fit into the average moat.

‘Damn,’ thought the Captain, ‘shiver me timbers, the application has gone to the wrong committee.’ ‘Come back in six months,’ he told his sturdy crew.

Dear NRC, Why did our application MOD2279 go to the Castle and Moats subcommittee instead of the Tall Ships committee? Yours sincerely, James Cook.

Dear Mr Cock, The Tall Ships subcommittee has been rationalised, and has been replaced by the Castle and Moats subcommittee and the Law and Order subcommittee.

Yours sincerely, NRC.

‘Damn,’ thought the Captain, ‘rummage me topsail, we’ll never get off the ground like this. I had better read up on this new chaos theory.’ In fact the Captain did not do this, but instead took advice from an old sea dog who had just been awarded a grant of Pounds sterling 2 million from the emergency drawbridge fund to research the theory of gravity.

NRC Application no MOD2391, January 1763 (to be considered by the Law and Order subcommittee). Applicant J. Cook.

Aim: Feasibility study for the transportation of rascals, rogues and vagabonds to a remote continent on the other side of the world. Initial pilot studies involve a three-year return journey to a yet undiscovered land mass called Australia .

Requirements: Supplies for a three-year voyage.

Total cost: Pounds sterling 21 7s 8d (again adjusted for inflation).

Dear Mr Coko, We are pleased to inform you that your application MOD2391 has been successful. Unfortunately, due to the financial crisis at the moment, the subcommittee has recommended that funding for your three-year round trip to Australia be cut to 18 months.

Yours sincerely, NRC.

Follow-up

A letter to Mr Darwin A correspondent draws my attention to another lovely piece from the EMBO Reports Journal )Vol 10, 2009), by Frank Gannon. [Download the pdf.]

Dear Dr Darwin

” .  .  .  .  In a further comment, referee three decries your descriptive approach, which leaves the task of explaining the ‘how’ to others. His/her view is that any publications resulting from your work will inevitably be acceptable only to lowimpact specialist journals; even worse, they might be publishable only as a monograph. As our agency is judged by the quality of the work that we support—measured by the average impact factor of the papers that result from our funding—this is a strongly negative comment”

Rather sadly, this excellent editorial had to accompanied by a pusillanimous disclaimer

This Editorial represents the personal views of Frank Gannon and not those of Science Foundation Ireland or the European Molecular Biology Organization.

Congratulations to the vice-chancellor of the University of Salford, Michael Harloe.

Times Higher Education announced on 15th January 2009 Salford to shut complementary medicine BSc.

“The University of Salford is to stop offering undergraduate degrees in acupuncture and complementary medicine because they are no longer considered “a sound academic fit”.”

This is the first time that a University has decided to stop teaching quackery altogether.  The university’s press officer told me (22 January 2009)

“all the University’s programmes associated with complementary medicine within the School of Community, Health Sciences & Social Care will be run out. This includes the Homeopathy in Practice programme. “
Salford, before it became a university, was home to the great L.S. Lowry


Salford’s Peel building, where L.S.Lowry worked

“Managers concluded last year that the BSc traditional Chinese medicine and other degrees with a complementary medicine element “cannot really be held to be a good fit with the strategic direction of the school, and resource and energy would be better directed elsewhere”.

There are more than 70 students registered on the Chinese medicine degree course.

The university will continue to offer these subjects at postgraduate level, as short courses and as part of continuing professional development programmes.  Traditional Chinese medicine work will also be linked to the university’s allied
health professions courses.”

Another report appeared in the Manchester Evening News: “Needle over acupuncture course”. “A UNIVERSITY has scrapped a course in acupuncture and aromatherapy branded `anti-science’ by critics.

Salford University said the three-year degree in traditional Chinese medicine didn’t fit with the `strategic direction’ bosses want to adopt.

The move is part of wider cuts which will see 150 teaching and support staff jobs axed.”

One of their students raised the question that the university must dread.

“First-year student Gary Leese, who is organising a petition, said: “Why did the university launch the course if they didn’t think it was good enough?”

The comments left by the readers of the Manchester Evening News were mostly very sensible. The first to come in, from someone with the beautifully Lancastrian name, Gladys Rowbotham, said “Some common sense at last!”.

A brief report appeared also in the Manchester Confidential

Why now?

This is rather an interesting development.  On 19th April 2007, I sent a Freedom of Information request to Salford to ask for course validation documents for their courses in Homeopathy and in Traditional Chinese Medicine.  I also asked for course materials for specified courses.  This request was even less successful than usual.  Not only were the course materials refused (as they always are), but, unusually, the validation documents were refused too.  The excuse for this was more pathetic than usual too.  They claimed it would cost more than £450 to email a few documents and powerpoints, and claimed exemption under Section 21 of the Freedom of Information Act, “Information Reasonably Accessible to the Applicant by Other Means”, rather than the more usual excuse (Section 43, “Commercial interests”).
It was never explained what “other means” were meant to be available. Perhaps they thought I should pay £3000 in fees and enrol for the course?

On 6th April 2007, Times Higher Education (THE) ran an opinion piece “Credible endeavour or pseudoscience?“.  In this, I wrote, as follows.

“Clearly the buck stops with university vice-chancellors who award the degrees. Two weeks ago, after the publication of my opinion article and a special report on university homoeopathy courses in the journal Nature , the BBC tried to get one of the vice-chancellors to defend themselves. They did not succeed. Letters to vice-chancellors on this go unanswered. Requests to see course materials have repeatedly been refused. The QAA is exempt from the Freedom of Information Act. Teaching materials and the names of examiners are kept secret. This I find incomprehensible and indefensible.”

After this appeared, I was sent by the University of Salford a copy of Michael Harloe’s defence of their position at that time, as sent to THE. It relied heavily on validation by the Quality Assurance Agency.  But the QAA is merely a box-ticking organisation that would give top marks to a course in astrology, given a sufficient mound of paperwork, as I pointed out in Nature, “Their own rules prevent them from doing anything useful”.

The statement also said that the courses teach critical thinking about alternative medicine. But it has been pointed out over and over again that what alternative medicine advocates lack, above anything else, is any faculty of critical self-appraisal.

One has to have some sympathy with a vice chancellor who is put on the spot and forced to defend courses in which he probably does not really believe himself. Perhaps it is not surprising that letters so often go unanswered. What can they say?  There really is no answer that doesn’t leave the hapless VC with egg on his face.

If there is one lesson from this, it is not to be discouraged if you get no answer from a vice-chancellor. It has probably been read and may well get acted on eventually.   Shutting down a course is no easy matter.  It takes time.

I said the buck stops with the vice chancellor. Professor Harloe has grasped the nettle and done the right thing.  Let’s hope a few more now follow his excellent lead..

What does this mean for the Pittilo report?

The gamma-minus Pittilo report (see also. The Times) recommended more degrees in alternative medicine, but there seems to be something of a trend developing in exactly the opposite direction.

The University of Central Lancashire has closed the first year entry to its “BSc”  in Homeopathy, and announced a review of all its activities in the area of alternative medicine. Now we have Salford.  There are stirrings among the good scientists even at the University of Westminster which has a new Dean and VC.

This rather absurd situation has arisen because of the adamant refusal of the government, and of a dozen or more quangos, to grasp the nettle of whether or not the alternative treatments work. Time and time again, the one important question that you want to know about any sort of treatment, namely, is it effective, has been pushed under the carpet.

The sort of absurd political correctness that leads to the fraudulent conjurers known as ‘psychic surgeons’ being referred to as a “profession” by the Department of Health has obscured reality. Even the MHRA was persuaded to allow misleading labelling of homeopathic and herbal “remedies”. thus betraying its job.  In its own words “The MHRA is the government agency that is responsible for ensuring that medicines and medical devices work, . . .”.

There is a lesson here.  You can’t go on avoiding reality for ever.  One consolation is that, in the end, it is the universities who are leading the way, albeit slowly.

All we need now is for the Department of Health, the MHRA and the endless box-ticking quangos to wake up too.

Jump to follow-up

I’m perfectly happy to think of alternative medicine as being a voluntary, self-imposed tax on the gullible (to paraphrase Goldacre again). But only as long as its practitioners do no harm and only as long as they obey the law of the land.  Only too often, though, they do neither.

When I talk about law, I don’t mean lawsuits for defamation.  Defamation suits are what homeopaths and chiropractors like to use to silence critics. heaven knows, I’ve becomes accustomed to being defamed by people who are, in my view. fraudsters, but lawsuits are not the way to deal with it.

I’m talking about the Trading Standards laws   Everyone has to obey them, and in May 2008 the law changed in a way that puts the whole health fraud industry in jeopardy.

The gist of the matter is that it is now illegal to claim that a product will benefit your health if you can’t produce evidence to justify the claim.

I’m not a lawyer, but with the help of two lawyers and a trading standards officer I’ve attempted a summary.  The machinery for enforcing the law does not yet work well, but when it does, there should be some very interesting cases.

The obvious targets are homeopaths who claim to cure malaria and AIDS, and traditional Chinese Medicine people who claim to cure cancer.

But there are some less obvious targets for prosecution too.   Here is a selection of possibilities to savour..

  • Universities such as Westminster, Central Lancashire and the rest, which promote the spreading of false health claims
  • Hospitals, like the Royal London Homeopathic Hospital, that treat patients with mistletoe and marigold paste. Can they produce any real evidence that they work?
  • Edexcel, which sets examinations in alternative medicine (and charges for them)
  • Ofsted and the QCA which validate these exams
  • Skills for Health and a whole maze of other unelected and unaccountable quangos which offer “national occupational standards” in everything from distant healing to hot stone therapy, thereby giving official sanction to all manner of treatments for which no plausible evidence can be offered.
  • The Prince of Wales Foundation for Integrated Health, which notoriously offers health advice for which it cannot produce good evidence
  • Perhaps even the Department of Health itself, which notoriously referred to “psychic surgery” as a profession, and which has consistently refused to refer dubious therapies to NICE for assessment.

The law, insofar as I’ve understood it, is probably such that only the first three or four of these have sufficient commercial elements for there to be any chance of a successful prosecution.  That is something that will eventually have to be argued in court.

But lecanardnoir points out in his comment below that The Prince of Wales is intending to sell herbal concoctions, so perhaps he could end up in court too.

The laws

We are talking about The Consumer Protection from Unfair Trading Regulations 2008.  The regulations came into force on 26 May 2008.   The full regulations can be seen here,  or download pdf file. They can be seen also on the UK Statute Law Database.

The Office of Fair Trading, and Department for Business, Enterprise & Regulatory Reform (BERR) published Guidance on the Consumer Protection from Unfair Trading Regulations 2008 (pdf file),
Statement of consumer protection enforcement principles (pdf file), and
The Consumer Protection from Unfair Trading Regulations: a basic guide for business (pdf file).

Has The UK Quietly Outlawed “Alternative” Medicine?

On 26 September 2008, Mondaq Business Briefing published this article by a Glasgow lawyer, Douglas McLachlan.   (Oddly enough, this article was reproduced on the National Center for Homeopathy web site.)

“Proponents of the myriad of forms of alternative medicine argue that it is in some way “outside science” or that “science doesn’t understand why it works”. Critical thinking scientists disagree. The best available scientific data shows that alternative medicine simply doesn’t work, they say: studies repeatedly show that the effect of some of these alternative medical therapies is indistinguishable from the well documented, but very strange “placebo effect” ”

“Enter The Consumer Protection from Unfair Trading Regulations 2008(the “Regulations”). The Regulations came into force on 26 May 2008 to surprisingly little fanfare, despite the fact they represent the most extensive modernisation and simplification of the consumer protection framework for 20 years.”

The Regulations prohibit unfair commercial practices between traders and consumers through five prohibitions:-

  • General Prohibition on Unfair Commercial
    Practices (Regulation 3)
  • Prohibition on Misleading Actions (Regulations 5)
  • Prohibition on Misleading Omissions (Regulation 6)
  • Prohibition on Aggressive Commercial Practices (Regulation 7)
  • Prohibition on 31 Specific Commercial Practices that are in all Circumstances Unfair (Schedule 1).  One of the 31 commercial practices which are in all circumstances considered unfair is “falsely claiming that a product is able to cure illnesses, dysfunction or malformations”. The definition of “product” in the Regulations includes services, so it does appear that all forms medical products and treatments will be covered.

Just look at that!

One of the 31 commercial practices which are in all circumstances considered unfair is “falsely claiming that a product is able to cure illnesses, dysfunction or malformations”


Section 5 is equally powerful, and also does not contain the contentious word “cure” (see note below)

Misleading actions

5.—(1) A commercial practice is a misleading action if it satisfies the conditions in either paragraph (2) or paragraph (3).

(2) A commercial practice satisfies the conditions of this paragraph—

(a) if it contains false information and is therefore untruthful in relation to any of the matters in paragraph (4) or if it or its overall presentation in any way deceives or is likely to deceive the average consumer in relation to any of the matters in that paragraph, even if the information is factually correct; and

(b) it causes or is likely to cause the average consumer to take a transactional decision he would not have taken otherwise.

These laws are very powerful in principle, But there are two complications in practice.

One complication concerns the extent to which the onus has been moved on to the seller to prove the claims are true, rather than the accuser having to prove they are false. That is a lot more favourable to the accuser than before, but it’s complicated.

The other complication concerns enforcement of the new laws, and at the moment that is bad.

Who has to prove what?

That is still not entirely clear.  McLachlan says

“If we accept that mainstream evidence based medicine is in some way accepted by mainstream science, and alternative medicine bears the “alternative” qualifier simply because it is not supported by mainstream science, then where does that leave a trader who seeks to refute any allegation that his claim is false?

Of course it is always open to the trader to show that his the alternative therapy actually works, but the weight of scientific evidence is likely to be against him.”

On the other hand, I’m advised by a Trading Standards Officer that “He doesn’t have to refute anything! The prosecution have to prove the claims are false”.  This has been confirmed by another Trading Standards Officer who said

“It is not clear (though it seems to be) what difference is implied between “cure” and “treat”, or what evidence is required to demonstrate that such a cure is false “beyond reasonable doubt” in court. The regulations do not provide that the maker of claims must show that the claims are true, or set a standard indicating how such a proof may be shown.”

The main defence against prosecution seems to be the “Due diligence defence”, in paragraph 17.

Due diligence defence

17. —(1) In any proceedings against a person for an offence under regulation 9, 10, 11 or 12 it is a defence for that person to prove—

(a) that the commission of the offence was due to—

(i) a mistake;

(ii) reliance on information supplied to him by another person;

(iii) the act or default of another person;

(iv) an accident; or

(v) another cause beyond his control; and

(b) that he took all reasonable precautions and exercised all due diligence to avoid the commission of such an offence by himself or any person under his control.

If “taking all reasonable precautions” includes being aware of the lack of any good evidence that what you are selling is effective, then this defence should not be much use for most quacks.

Douglas McLachlan has clarified, below, this difficult question

False claims for health benefits of foods

A separate bit of legislation, European regulation on nutrition and health claims made on food, ref 1924/2006, in Article 6, seems clearer in specifying that the seller has to prove any claims they make.

Article 6

Scientific substantiation for claims

1. Nutrition and health claims shall be based on and substantiated by generally accepted scientific evidence.

2. A food business operator making a nutrition or health claim shall justify the use of the claim.

3. The competent authorities of the Member States may request a food business operator or a person placing a product on the market to produce all relevant elements and data establishing compliance with this Regulation.

That clearly places the onus on the seller to provide evidence for claims that are made, rather than the complainant having to ‘prove’ that the claims are false.

On the problem of “health foods” the two bits of legislation seem to overlap.  Both have been discussed in “Trading regulations and health foods“, an editorial in the BMJ by M. E. J. Lean (Professor of Human Nutrition in Glasgow).

“It is already illegal under food labelling regulations (1996) to claim that food products can treat or prevent disease. However, huge numbers of such claims are still made, particularly for obesity ”

“The new regulations provide good legislation to protect vulnerable consumers from misleading “health food” claims. They now need to be enforced proactively to help direct doctors and consumers towards safe, cost effective, and evidence based management of diseases.”

In fact the European Food Standards Agency (EFSA) seems to be doing a rather good job at imposing the rules. This, predictably, provoked howls of anguish from the food industry There is a synopsis here.

“Of eight assessed claims, EFSA’s Panel on Dietetic Products, Nutrition and Allergies (NDA) rejected seven for failing to demonstrate causality between consumption of specific nutrients or foods and intended health benefits. EFSA has subsequently issued opinions on about 30 claims with seven drawing positive opinions.”

“. . .  EFSA in disgust threw out 120 dossiers supposedly in support of nutrients seeking addition to the FSD’s positive list.

If EFSA was bewildered by the lack of data in the dossiers, it needn’t hav been as industry freely admitted it had in many cases submitted such hollow documents to temporarily keep nutrients on-market.”

Or, on another industry site, “EFSA’s harsh health claim regime

“By setting an unworkably high standard for claims substantiation, EFSA is threatening R&D not to mention health claims that have long been officially approved in many jurisdictions.”

Here, of course,”unworkably high standard” just means real genuine evidence. How dare they ask for that!

Enforcement of the law

Article 19 of the Unfair Trading regulations says

19. —(1) It shall be the duty of every enforcement authority to enforce these Regulations.
(2) Where the enforcement authority is a local weights and measures authority the duty referred to in paragraph (1) shall apply to the enforcement of these Regulations within the authority’s area.

Nevertheless, enforcement is undoubtedly a weak point at the moment. The UK is obliged to enforce these laws, but at the moment it is not doing so effectively.

A letter in the BMJ from Rose & Garrow describes two complaints under the legislation in which it appears that a Trading Standards office failed to enforce the law. They comment

” . . . member states are obliged not only to enact it as national legislation but to enforce it. The evidence that the government has provided adequate resources for enforcement, in the form of staff and their proper training, is not convincing. The media, and especially the internet, are replete with false claims about health care, and sick people need protection. All EU citizens have the right to complain to the EU Commission if their government fails to provide that protection.”

This is not a good start.   A lawyer has pointed out to me

“that it can sometimes be very difficult to get Trading Standards or the OFT to take an interest in something that they don’t fully understand. I think that if it doesn’t immediately leap out at them as being false (e.g “these pills cure all forms of cancer”)  then it’s going to be extremely difficult. To be fair, neither Trading Standards nor the OFT were ever intended to be medical regulators and they have limited resources available to them. The new Regulations are a useful new weapon in the fight against quackery, but they are no substitute for proper regulation.”

Trading Standards originated in Weights and Measures.   It was their job to check that your pint of beer was really a pint. Now they are being expected to judge medical controversies. Either they will need more people and more training,  or responsibility for enforcement of the law should be transferred to some more appropriate agency (though one hesitates to suggest the MHRA after their recent pathetic performance in this area).

Who can be prosecuted?

Any “trader”, a person or a company. There is no need to have actually bought anything, and no need to have suffered actual harm. In fact there is no need for there to be a complainant at all. Trading standards officers can act on their own. But there must be a commercial element. It’s unlikely that simply preaching nonsense would be sufficient to get you prosecuted, so the Prince of Wales is, sadly, probably safe.

Universities who teach that “Amethysts emit high Yin energy” make an interesting case. They charge fees and in return they are “falsely claiming that a product is able to cure illnesses”.
In my view they are behaving illegally, but we shan’t know until a university is taken to court.  Watch this space.

The fact remains that the UK is obliged to enforce the law and presumably it will do so eventually. When it does, alternative medicine will have to change very radically. If it were prevented from making false claims, there would be very little of it left apart from tea and sympathy

Follow-up

New Zealand must have similar laws.
Just as I was about to post this I found that in New Zealand a

“couple who sold homeopathic remedies claiming to cure bird flu, herpes and Sars (severe acute respiratory syndrome) have been convicted of breaching the Fair Trading Act.”

They were ordered to pay fines and court costs totalling $23,400.

A clarification form Douglas McLachlan

On the difficult question of who must prove what, Douglas McLachlan, who wrote Has The UK Quietly Outlawed “Alternative” Medicine?, has kindly sent the following clarification.

“I would agree that it is still for the prosecution to prove that the trader committed the offence beyond a reasonable doubt, and that burden of proof is always on the prosecution at the outset, but I think if a trader makes a claim regarding his product and best scientific evidence available indicates that that claim is false, then it will be on the trader to substantiate the claim in order to defend himself. How will the trader do so? Perhaps the trader might call witness after witness in court to provide anecdotal evidence of their experiences, or “experts” that support their claim – in which case it will be for the prosecution to explain the scientific method to the Judge and to convince the Judge that its Study evidence is to be preferred.

Unfortunately, once human personalities get involved things could get clouded – I could imagine a small time seller of snake oil having serious difficulty, but a well funded homeopathy company engaging smart lawyers to quote flawed studies and lead anecdotal evidence to muddy the waters just enough for a Judge to give the trader the benefit of the doubt. That seems to be what happens in the wider public debate, so it’s easy to envisage it happening a courtroom.”

The “average consumer”.

The regulations state

(3) A commercial practice is unfair if—

(a) it contravenes the requirements of professional diligence; and

(b) it materially distorts or is likely to materially distort the economic behaviour of the average consumer with regard to the product.

It seems,therefore, that what matters is whether the “average consumer” would infer from what is said that a claim was being made to cure a disease. The legal view cited by Mojo (comment #2, below) is that expressions such as “can be used to treat” or “can help with” would be considered by the average consumer as implying successful treatment or cure.

The drugstore detox delusion. A nice analysis “detox” at .Science-based Pharmacy

It was a great delight to visit Amsterdam on 25 October to speak at a meeting off the Vereniging tegen de Kwakzalverij (Society against quackery).  Unfortunately their excellent web site is in Dutch, so the best you can do at the moment is to use the Google translation, with its frequently hilarious renderings.  Better translations coming soon, I hope.

Symposium

Op weg naar het einde?

Niet-reguliere geneeswijzen in de 21ste eeuw in internationaal perspectief

Towards the end?

Non-mainstream medicine in the 21st century in an international perspective

The Dutch society has 1800 members and is the oldest and biggest such society in the world. I very much hope that their web site will soon have an English version.  That is only appropriate since the origin of the word quack is from the Dutch Kwakzalver.  (Kwak=Chatterer, salesman, zalf = salve, ointment). (In contrast the noise made by a duck is simply described by the OED as being “imitative”, though the great Michael Quinion thinks the two usages may be connected.

De Kwakzalver, Jan Steen (1626-1679) Rijksmuseum Amsterdam. Click to enlarge

The Quack doctor, Jan Steen (1626-1679). Click to enlarge

Translations of some key parts will be posted here soon.  My talk was about Support for alternative medicine in government and universities in the U.K

The meeting started with the announcement of the winner of the Meester Kackadorisprijs.

The Master Kackodoris prize

The Meester Kackadorisprijs is awarded to individuals or institutions who promote quackery and who should know better (the quacks themselves are never nominated). The short list for the 2008 prize included the vice chancellor of the Free University of Amsterdam

Prof. dr. Lex Bouter, rector magnificus Vrije Universiteit

The vice-chancellor was on the short-list for the prize because of his part in a recent paper, “Effects of acupuncture on rates of pregnancy and live birth among women undergoing in vitro fertilisation: systematic review and meta-analysis.” (Manheimer E, Zhang G, Udoff L, Haramati A, Langenberg P, Berman BM, Bouter LM, Brit Med J 336, 545-9) [Available free]

This paper has been cited all over the world, but it seems not to have been very good.  See for example the magnificent analysis of it in “Yawn, still one more overhyped acupuncture study: Does acupuncture help infertile women conceive?” .  See also the Cochrane review (it could all be placebo). The fact that the vice-chancellor appears to have been only a ‘guest author’ anyway does not count as an excuse.  The large number of citations received by this paper should, incidentally, be seen as another nail in the coffin of attempts to measure quality by citation rates.

In the event, vice-chancellor Bouter did not win the Kackodoris prize  this year.  In a speech at the start of the symposium, it emerged that he had been narrowly beaten by the Dutch Christian Radio Association for its assiduous promotion of quackery.

The chair of the Dutch society, Cees Rencken, is doing a great job.  I hope that it will soon be better known outside the Netherlands.

And it’s time we had a UK equivalent of the Kackadoris prize. There will be no shortage of worthy candidates.

Frits Van Dam (Secretary) and Cees Renckens (Chair) of VtdK 
(photo: Sofie van de Calseijde)


Some pictures of Amsterdam

(meetings photos: Sofie van de Calseijde)

Follow-up

Jump to follow-up

It seems that validation committees often don’t look beyond the official documents. As a result, the validations may not be worth the paper they are written on. Try this one.

One of the best bits of news recently was the downfall of Matthias Rath.  He’s the man who peddled vitamin pills for AIDS in Africa, and encouraged the AIDS denialists in the South African government.  Thabo Mbeki and his Health Minister, Mrs Beetroot, have gone now, thank heavens.

Rath was one of the best illustrations of the murderous effect of selling ineffective treatments.  The fact that nobody in the “nutritional therapy” industry has uttered a word of condemnation for this man illustrates better than anything one can imagine the corrupt state of “nutritional therapy”.  The people who kept silent include the British Association of Nutritional Therapists (BANT).

It might be surprising, then, to find the Northern College of Acupuncture proudly adding a course in alternative nutrition to its courses in acupuncture (now known to be a theatrical placebo) and Chinese herbal medicine (largely untested and sometimes toxic).  It might be even more surprising to find the boast that the course is validated by the University of Wales.  It seemed a good idea to find out a bit more about how this came about.  Thanks to the Freedom of Information Act, some interesting things can be discovered.

Polly Toynbee’s superb article, Quackery and superstition – available soon on the NHS,  written in January 2008, mentioned diplomas and degrees in complementary therapies offered by, among others, the University of Wales.  This elicited a letter of protest to Toynbee from the Vice-Chancellor of the University of Wales, Professor Marc Clement BSc, PhD, MInstP, CEng,CPhys,FIET.   He invited her to visit the university to see their “validation and monitoring procedures (including the University’s very specific guidelines on health studies disciplines”.

So let’s take a look at these validation procedures and guidelines.

The validation process

The Northern College of Acupuncture submitted a 148 page proposal for the course in October 2007.   The document has all the usual edu-bollocks jargon, but of course doesn’t say much about clinical trials, though it does boast about an unblinded trial of acupuncture published in 2006 which, because of lack of appropriate controls, served only to muddy the waters.  : This submission was considered by the University’s validation committee last December.


Panel of Assessors:

Professor Nigel Palastanga (Chair), Cardiff University

Dr Celia Bell (School of Health and Social Sciences Middlesex University)

Dr John Fish (Moderator designate) (Institute of Biological Sciences University of Wales, Aberystwyth)

Ms Rhiannon Harris (Centre for Nutrition & Dietetics University of Wales Institute,
Cardiff (UWIC))

Ms Felicity Moir (School of Integrated Health University of Westminster)

The whole validation document is only four pages long [download it]. The most interesting thing about it is that the words ‘evidence’ or ‘critical’ do not occur in it a single time.  It has all the usual bureaucratic jargon of such documents but misses entirely the central point.

Does that mean that the University of Wales doesn’t care about evidence or critical thinking?  Well, not on paper. Two years previously a short document called Health Studies Guidelines had been written by Dr Brian Spriggs (Health Studies Validation Consultant, since retired) for the Health Studies Committee, and it was approved on 21 April 2005.  It starts well.

“Degrees in the Health Studies field are expected to promote an understanding of the  importance of the scientific method and an evidence-base to underpin therapeutic interventions and of research to expand that base.”

It even goes on to say that a BSc degree in homeopathy is “unacceptable”.  Don’t get too excited though, because it also says that acupuncture and Chinese herbal  stuff is quite OK.  How anyone can imagine they live up to the  opening sentence beats me.   And it gets worse. It says that all sorts of rather advanced forms of battiness are OK if they form only part of another degree.  They include Homeopathy, Crystal therapy. Dowsing, Iridology; Kinesiology, Radionics, Reflexology, Shiatsu, Healing, and Maharishi Ayurvedic Medicine.

Dowsing? Crystal therapy?  Just let me remind you. We are living in 2008. It is easy to forget that when ploughing through all this new age junk.

The Validation Handbook of Quality Assurance: Health Studies (2007) runs to an astonishing 256 pages [download the whole thing]. On page 12 we find the extent of the problem.

“The University of Wales validates a number of schemes in the Health Studies field. At the current time we have undergraduate and/or postgraduate degree schemes in Acupuncture, Animal Manipulation, Chiropractic, Herbal Medicine, Integrative Psychotherapy, Osteopathy, Osteopathic Studies, Traditional Chinese Medicine and Regulatory Affairs, both in the UK and overseas.”

That sounds pretty shocking.   Further down on page 12, though, we find this.

“Degrees in the Health Studies field are expected to promote an understanding of the importance of the scientific method and an evidence-base to underpin therapeutic interventions and of research to expand that base. The mission is to promote and require the critical evaluation of the practices, doctrines, beliefs, theories and hypotheses that underlie the taught therapeutic measures of the discipline.”

They are indeed fine words. The problem is that I can detect no sign in the submission, nor in its consideration by the validation committee, that any attempt whatsoever was made to ensure that the course complied with these requirements.

The only sign of concern I could detect of any concern about the quality of what was being taught came in a minute to a meeting of the Health Studies Committee meeting on 24th April 2008.

“Members received a copy of an article entitled Quackery and superstition available soon on the NHS which appeared in The Guardian newspaper in January 2008, and a copy of the Vice- Chancellors response. Members agreed that this article was now historical but felt that if/when the issue were to arise again; the key matter of scientific rigour should be stressed. The Committee agreed that this was the most critical element of all degree schemes in the University of Wales portfolio of health studies schemes. It was felt it would be timely to re-examine the schemes within the portfolio as well as the guidelines for consideration of Health Studies schemes at the next meeting. The Committee might also decide that Institutions would be required to include literature reviews (as part of their validation submission) to provide evidence for their particular profession/philosophy. It was agreed that the guidelines would be a vital document in the consideration of new schemes and during preliminary visits to prospective Institutions. “

The Press Office had passed Polly Toynbee’s article to them.  Curiously the Health Studies Committee dismissed it as “historical”, simply because it was written three months earlier.  That is presumably “historical” in the sense that the public will have forgotten about it, rather than in the sense that the facts of the matter have changed since January.  So, at least for the nutrition degree, Toynbee’s comments  were simply brushed under the carpet.

After a few cosmetic changes of wording the validation was completed on 16th January 2008. For example the word “diagnosis” was removed in 43 places and “rewritten in terms of evaluation and assessment”.  There was, needless to say, no indication that the change in wording would change anything in what was taught to students.

You may think that I am being a bit too harsh. Perhaps the course is just fine after all? The problem is that the submission and the reaction of the validation committee tell you next to nothing about what actually matters, and that is what is taught. There is only a vague outline of that in the submission (and part of it was redacted on the grounds that if it were made public somebody might copy ;it.  Heaven forbid).

That is why I have to say, yet again, that this sort of validation exercise is not worth the paper it’s written on.

How can we find out a bit more? Very easily as it happens. Just Google. What matters is not so much formal course outlines but who teaches them.

The nutrition course

The title of the course is just “Nutrition”, not ‘Nutritional Therapy’ or ‘Alternative Nutrition’.  That sounds quite respectable but a glance at the prospectus shows immediately that it is full-blown alternative medicine.

Already in July 2007, the glowing press releases for the course had attracted attention from the wonderfully investigative web site HolfordWatch.   I see no sign that the validation committee was aware of this. But if not, why not? I would describe is as dereliction of academic duty.

“This pioneering course is unique in that it is firmly rooted in both Western nutritional science and naturopathic medicine and also covers concepts of nutrition within traditional Chinese, Japanese, Tibetan and Ayurvedic medicine.

This means that graduates will gain comprehensive understanding of both modern scientific knowledge and ancient wisdom concerning nutrition and dietetics.”

Ancient wisdom, of course, means something that your are supposed to believe though there is no good reason to think it’s true.  In the end, though, almost the only thing that really matters about any course is who is running it.  The brochure shows that all of the people are heavily into every form of alternative nuttiness.

Course Director and Tutor: Jacqueline Young nutritionist, naturopath, clinical psychologist and Oriental medical practitioner

Nutrition Tutors:

Elaine Aldred  (qualified as a chiropractor with the Anglo European Chiropractic College, as an acupuncturist with the British College of Acupuncture and as a Western Medical Herbalist with the College of Phytotherapy. She recently also qualified in Chinese herbal medicine with the Northern College of Acupuncture.)

Sue Russell (3 year diploma in nutritional therapy at the Institute of Optimum Nutrition. She currently practises as a nutritional therapist and also works part-time as a manager at the Northern College of Homeopathic Medicine.)

Anuradha Sharma (graduated as a dietician from Leeds Metropolitan University in 2002 and subsequently completed a Naturopathy certificate and a post-graduate diploma in acupuncture).

Guest Lecturers include : Dr John Briffa, Professor Jane Plant, M.B.E. (a geochemist turned quack), and, most revealingly, none other than the UK’s most notorious media celebrity and pill peddler, Patrick Holford.

So much has been written about Holford’s appalling abuse of science, one would have thought that not even a validation committee could have missed it.

“The course has been created by Jacqueline Young“, so let’s look a bit further at her track record.

Jacqueline Young has written a book, ‘Complementary Medicine for Dummies’ [Ed: ahem shouldn’t that be Dummies for Complementary Medicine?].  You can see parts of it on Google Books. Did the validation committee bother to look at it?  As far as I can tell, the words ‘randomised’ or ‘clinical trial’ occur nowhere in the book.

The chapter on Tibetan medicine is not very helpful when it comes to evidence but for research we are referred to the Tibetan Medical and Astrology Institute.  Guess what? That site gives no evidence either. So far not a single university has endorsed Astrology (there is a profitable niche there for some vice-chancellor).

Here are few samples from the book. The advice seems to vary from the undocumented optimism of this

Well researched?  No. Safe? Nobody knows.  Or this

Mandarin peel prevents colds and flu?  Old wive’s tale.  Then there are things that verge on the weird, like this one

or the deeply bizarre like this

The problem of Jacqueline Young’s fantasy approach to facts was pointed out at least as far back as 2004, by Ray Girvan., who wrote about it again in May 2005. The problems were brought to wider attention when Ben Goldacre wrote two articles in his Badscience column, Imploding Researchers (September 2005), and the following week, Tangled Webs.

“we were pondering the ethics and wisdom of Jacqueline Young dishing out preposterous, made-up, pseudoscientific nonsense as if it was authoritative BBC fact, with phrases such as: “Implosion researchers have found that if water is put through a spiral its electrical field changes and it then appears to have a potent, restorative effect on cells.” “

and later

“Take this from her article on cranial osteopathy, riddled with half truths: “Sutherland found that the cranial bones (the skull bones encasing the brain) weren’t fused in adulthood, as was widely believed, but actually had a cycle of slight involuntary movement.” In fact the cranial bones do fuse in adulthood.

She goes on: “This movement was influenced by the rhythmic flow of cerebrospinal fluid (the nourishing and protective fluid that circulates through the spinal canal and brain) and could become blocked.” There have now been five studies on whether “cranial osteopaths” can indeed feel these movements, as they claim, and it’s an easy experiment to do: ask a couple of cranial osteopaths to write down the frequency of the rhythmic pulses on the same person’s skull, and see if they give the same answer. They don’t. A rather crucial well-replicated finding to leave out of your story.

That was in 2005 and since then all of Young’s “preposterous, made-up, pseudoscientific nonsense” (along with most of the other stuff about junk medicine) has vanished from the BBC’s web site, after some people with a bit of common sense pointed out what nonsense it was.  But now we see them resurfacing in a course validated by a serious university.  The BBC had some excuse (after all, it is run largely by arts graduates). I can see no excuses for the University of Wales.

Incidentally,  thanks to web archive you can still read Young’s nonsense,  long after the BBC removed it.  Here is a quotation.

“Implosion researchers have found that if water is put through a spiral its ,field changes and it then appears to have a potent, restorative effect on cells. In one study, seedlings watered with spiralised water grew significantly faster, higher and stronger than those given ordinary water.”

The vice-chancellor of the University of Wales, Marc Clement, is a physicist (Department of Electrical and Electronic Engineering), so can he perhaps explain the meaning of this?

Selection committees for jobs (especially senior jobs) and validation committees for courses, might make fewer mistakes if they didn’t rely so much on formal documents and did a little more investigation themselves. That sort of thing is why the managerial culture not only takes a lot more time, but also gives a worse result.

It would have taken 10 minutes with Google to find out about Young’s track record, but they didn’t bother. As a result they have spent a long time producing a validation that isn’t worth the paper it’s written on. That makes the University of Wales a bit of a laughing stock. Worse still, it brings science itself into disrepute.

Follow-up

What does the University of Wales say? So far, nothing.   Last week I sent brief and polite emails to Professor Palastanga and to Professor Clement to try to discover whether it is true that the validation process had indeed missed the fact that the course organiser’s writings had been described as “preposterous, made-up, pseudoscientific nonsense” in the Guardian.

So far I have had no reply from the vice-chancellor, but on .26 October I did get an answer from Prof Palastaga.

As regards the two people you asked questions about – J.Young – I personally am not familiar with her book and nobody on the validation panel raised any concerns about it. As for P.Holford similarly there were no concerns expressed about him or his work. In both cases we would have considered their CV’s as presented in the documentation as part of the teaching team. In my experience of conducting degree validations at over 16 UK Universities this is the normal practice of a validation panel.


I have to say this reply confirms my worst fears. Validation committees such as this one simply don’t do their duty. They don’t show the curiosity that is needed to discover the facts about the things that they are meant to be judging. How could they not have looked at the book by the very person that they are validating? After all that has been written about Patrick Holford, it is simply mind-boggling that the committee seems to have been quite unaware of any of it.

It is yet another example of the harm done to science by an unthinking, box-ticking approach.

Pharmacology. A Handbook for Complementary Healthcare Professionals

Elsevier were kind enough to send me an inspection copy of this book, which is written by one of the nutrition course tutors, Elaine Aldred. She admits that pharmacology is “considered by most students to be nothing more that a ‘hoop-jumping’ exercise in the process of becoming qualified”.  She also says. disarmingly. that “I was certainly not the most adept scientist at school and found my university course a trial”.

The book has all the feel of a cut and paste job. It is mostly very simple (if not simplistic). though for no obvious reason it starts with a long (and very amateur) discussion of chemical bonding  Then molecules are admitted to be indivisible (but, guess what, the subject of homeopathy is avoided).  There is a very short section on ion channels, though, bizarrely, it appears under the heading “How do drugs get into cells?”. Since the author is clearly not able to make the distinction between volts and coulombs, the discussion is more likely to confuse the reader than to help.

Then a long section on plants. It starts of by asserting that “approximately a quarter of prescription drugs contain at least one chemical that was originally isolated and extracted from a plant”.. This cannot be even remotely correct.  There are vast tables showing complicated chemical structures, but the usual inadequate
list of their alleged actions  This is followed by a quick gallop through some classes of conventional drugs, illustrated again mainly by chemical structures not data.  Hormone replacement therapy is mentioned, but the chance to point out that it is one of the best illustrations of the need for RCTs is missed.

The one thing that one would really like to see in such a book is a good account of how you tell whether or not a drug works in man. This is relegated to five pages at the end of the book, and it is, frankly, pathetic.  It
is utterly uncritical in the one area that matters more than any other for people who purport to treat patients. All you get is a list of unexplained bullet points.

If this book is the source of the “scientific content” of the nutrition course, things are as bad as we feared.




Tell a Friend

Jump to follow-up

We know all about the sixteen or so universities that run “BSc” degrees in hokum. They are all “post-1992” universities, which used to be polytechnics. That is one reason why it saddens me to see them destroying their own attempts to achieve parity with older universities by running courses that I would regard as plain dishonest.

Older universities do not run degree courses in such nonsense. Academics (insofar as they still have any influence) certainly would not put up with it if they tried. But nevertheless you can find quackery in some of the most respected universities, and it gets there not via academics but (guess what) via Human Resources.  It creeps in through two routes.  One is the “training courses” that research staff now have to do (the “Roberts agenda”).  The other route is through occupational health services.

Quackery in training courses

It isn’t easy to find out what happens elsewhere, but I was certainly surprised to find out that UCL’s own HR department was offering a course that promised to teach you the “core principles” of Brain Gym and  Neurolinguistic Programming, both totally discredited bits of psycho-babble, more appropriate to the lifestyle section of a downmarket.women’s magazine than a university.  I gather that HR’s reaction after I brought this to light was not to ask what was wrong with it, but just to get angry.

In a spirit of collegiality I offered to run a transferable skills course myself.  I even offered to do it for nothing (rather than the rumoured £700 per day charged by the life style consultants).  I proposed a course in ‘How to read critically’ (subtitle ‘How to detect bullshit’).  This seems to me to be the ultimate transferable skill. Bullshit occurs in every walk of life. My proposal was moderately worded and perfectly serious.

Guess what?  Despite several reminders, I have never had any response to my suggestion.  Well, I suppose that HR people now regard themselves as senior to mere professors and there is really no need to reply to their
letters.

Quackery in occupational health. Leicester sets a good example

If you work at a university, why not search the university’s web site for “complementary medicice” or complementary therapies”. If it is a real university, you won’t find any degrees in homeopathy, or in amethysts
that emit high yin energy
.  But some quite surprising places are found to be recommending magic medicine through their Occupational Health service, which usually seems to be part of HR.  In fact at one time even UCL was doing it, but no soon had somebody sent me the link than it disappeared. As a matter of historical record, you can see it here (it had all the usual junk, as well as harmless stuff like yoga and pilates).

While looking for something else I stumbled recently some other cases.  One was at the University of Leicester, a very good university (and alma mater to the great David Attenborough who must have done more to point out the beauty of science than just about anyone).  But we find on their staff wellbeing site, alongside some perfectly sensible stuff, a link to complementary therapies.

The list of ‘therapies’ includes not only the usual placebos, acupuncture, reiki, reflexology, but, even more exotically, a fraudulent Russian device called SCENAR therapy. They have a nice leaflet that explains all these things in words that run the whole gamut from meaningless gobbledygook to plain wrong.  Here are some examples from the leaflet.

Reflexology

“In the feet, there are reflex areas corresponding to all the parts of the body and these areas are arranged in such a way as to form a map of the body in the feet”

Reflexology has been shown to be effective for:

  • Back Pain
  • Migraine
  • Infertility
  • Arthritis

Well no, there are no such areas in your feet. That is sheer imagination.  And reflexology has not “been shown to be effective” for any of those conditions.  These claims for therapeutic efficacy are not only lies.  They are also illegal.

Reiki

Each hand position is held for a few minutes, and during this time healing energy will flow into you, balancing your energy system, releasing stress, soothing pain, and promoting your body’s natural ability to heal itself.”

This is sheer idiotic mumbo-jumbo. The “flow of healing energy” is totally imaginary. Such talk is offensive to anyone with half a brain. Insofar as they claim to heal anything, it is also illegal.  The comes SCENAR.

What is SCENAR?

SCENAR is an acronym for Self Controlled Energo- Neuro Adaptive Regulator. It is a reflex biofeedback device which when used by a qualified practitioner, can help to alleviate acute and chronic pain. It is licensed in the UK for pain relief but experience has shown that it is helpful in a wide variety of conditions.”

This is even more seriously nuts than the others.  The term “licensed” means merely that it is electrically safe. It certainly does not mean that it works.  Pubmed shows only three publications about the SCENAR device, all in Russian,

One sales site (apparently Russian) makes the following modest claim.

“A prime goal of the Russian Space Program was to provide space travelers with a portable  medical device that would become their “universal medical assistant” in space. So from the beginning, the SCENAR was designed to replace an entire medical hospital, with all its staff, diagnostic and treatment facilities, even the pharmacy. A universal, non-invasive, portable regulator of body functions (among other things) was envisaged.”

The SCENAR device (right) looks like a TV remote control (perhaps it IS a TV remote control -we aren’t anywhere told in comprehensible terms what’s in the box.  The Russian site sells also the rather baffling accessory on the right. The mind boggles.

SCENAR device

Remote rectal-vaginal electrode for SCENAR

How does this rubbish get onto the web site of a good university?

I presume that it is just another sign of what happens when universities come to be run by non-academics.  No doubt the occupational health people are well meaning and kind, but just scientifically illiterate. What about the HR person in charge of them?  They are not known for scientific literacy either (which would not matter if they stuck to their job).  But perhaps they just didn’t notice.  There is only one way to find out. Ask.  So I sent this letter.on 10th September.

Hello

I am a pharmacologist and I have a side interest in public understanding of science, alternative medicine.and medical fraud

I was quite surprised when Google led me unexpectedly to your complementary therapies page at http://www.le.ac.uk/staffwellbeing/complementary_therapy.html

There is, sad to say, a great deal of information on these pages that is simply not true. For example it has NOT been shown that reflexology has been shown to be effective in any of the conditions which you list, as far as I know
(please send me references if you think I’m wrong) “Reflexology has been shown to be effective for: Back Pain Migraine Infertility Arthritis Sleep disorders Hormonal imbalances Sports injuries Digestive disorders Stress-related condition ”

To take only one more example from this page, the SCENAR device is an even more extreme example. It is well known to be fraudulent. and has been investigated by the Washington State Attorney General.

This sort of thing is not what one would expect from a very respectable university, and it must be a great embarrassment to your excellent medical scientists.

Apart from the many scientific inaccuracies (which greatly impede the efforts of those of us who try to improve public understanding of science), you are, I hope, aware that there is a legal aspect.

Since May this year, new regulations have made it illegal to make claims for health benefits if evidence cannot be produced to show that the claims are justified.  I would like to put it to you that many of the claims made on this page are not only immoral, but also illegal.

I wondered whether you , or your HR department, would like to make any comments

Best regards

David Colquhoun


I got an immediate and very sympathetic response from the Director of HR and a week later, on17th September, he wrote

“Hi David,

I have discussed the matter with my manager of Staff Counselling and Welfare and have agreed that it is probably safest that we remove the references to ‘complimentary’[sic] therapies from the site entirely.

Thank you for your helpful input and the recommendations for reading matter.”

So there is a lesson here.  If you find this sort or stuff on your own institution’s web site, all that may be needed is a simple letter that points out what nonsense it is.  Admittedly the HR man seemed rather more worried about whether the claims were illegal than whether they were true, but either way, it worked.

Only one little snag.  As of 6 October the pages still have not been removed.

On the assumption that they eventually will be removed, I have kept copies of the Wellbeing page, of the Complementary Therapies page, and of the ‘explanatory leaflet’. They stand as part of a historical record that
shows, once again, what can happen when scientific matters get into the hands of HR. Fortunately Leicester University has an HR director who is willing to listen to advice.

Follow-up

Something seems to have gone seriously wrong. Despite the rapid response, virtually all the nonsense is still there on 13th October. It seems not to be so simple after all.

And despite several reminders, the advertisement for SCENAR ‘therapy’ is still on  the University web site on December 14th.  I know that no decision by HR can be made with fewer than 25 meetings and an awayday in Majorca, but this is getting ridiculous.


Jump to follow-up

Alfred Joseph Clark FRS held the established chair of Pharmacology at UCL from 1919 to 1926, when he left for Edinburgh.  In the 1920s and 30s, Clark was a great pioneer in the application of quantitative physical ideas to pharmacology.   As well as his classic scientific works, like The Mode of Action of Drugs on Cells (1933) he wrote, and felt strongly, about the fraud perpetrated on the public by patent medicine salesmen.  In 1938 (while in Edinburgh) he published a slim volume called Patent Medicines.  The parallels with today are astonishing.


Alfred Joseph Clark FRS (1885 – 1941)

I was lucky to be given a copy of this book by David Clark, A.J. Clark’s eldest son, who is now 88. I visited him in Cambridge on 17 September 2008, because he thought that, as holder of the A.J. Clark chair at UCL from 1985 to 2004, I’d be a good person to look after this and several other books from his father’s library. They would have gone to the Department of Pharmacology if we still had one, but that has been swept away by mindless administrators with little understanding of how to get good science.

Quotations from the book are in italic, and are interspersed with comments from me.

The book starts with a quotation from the House of Commons Select Committee report on Patent Medicines. The report was submitted to the House on 4 August 1914, so there is no need to explain why it had little effect. The report differs from recent ones in that it is not stifled by the sort of political correctness that makes politicians refer to fraudsters as “professions”.


The problem

“2.2 The situation, therefore, as regards the sale and advertisement of proprietary medicines and articles may be summarised as follows:

For all practical purposes British law is powerless to prevent any person from procuring any drug, or making any mixture, whether patent or without any therapeutical activity whatever (as long as it does not contain a scheduled poison), advertising it in any decent terms as a cure for any disease or ailment, recommending it by bogus testimonials and the invented opinions and facsimile signatures of fictitious physicians, and selling it under any name he chooses, on payment of a small stamp duty. For any price he can persuade a credulous public to pay.”

Select Committee on Patent Medicines. 1914

“The writer has endeavoured in the present article to analyse the reasons for the amazing immunity of patent medicines form all attempts to curb their activity, to estimate the results and to suggest the obvious measures of reform that are needed.”

Clark, writing in 1938, was surprised that so little had changed since 1914.  What would he have thought if he had known that now, almost 100 years after the 1914 report, the fraudsters are still getting away with it?


Chapter 2 starts thus.

THE LAW

The Select Committee appointed by the House of Commons in 1914 ‘to consider and inquire into the question of the sale of Patent and Proprietary Medicines’ stated its opinion in 28 pages of terse and uncompromising invective. Its general conclusions were as follows:

That the trade in secret remedies constituted a grave and widespread public evil.

That the existing law was chaotic and had proved inoperative and that consequently the traffic in secret remedies was practically uncontrolled.

In particular it concluded ‘”that this is an intolerable state of things and that new legislation to deal with it, rather than merely the amendment of existing laws, is urgently needed in the public interest.”

The “widespread public evil”continues almost unabated, and rather than introduce sensible legislation to cope with it, the government has instead given a stamp of approval for quackery by introducing utterly ineffective voluntary “self-regulation”.

Another Bill to deal with patent medicines was introduced in 1931, without success, and finally in 1936, a Medical and Surgical Appliances (Advertisement) Bill was introduced. This Bill had a very limited scope. Its purpose was to alleviate some of the worst abuses of the quack medicine trade by prohibiting the advertisement of cures for certain diseases such as blindness, Bright’s disease [nephritis] , cancer, consumption [tuberculosis], epilepsy, fits, locomotor ataxy, fits, lupus or paralysis.

The agreement of many interests was secured for this measure. The president of the Advertising Association stated that the proposed Bill would not affect adversely any legitimate trade interest. Opposition to the Bill was, however, whipped up amongst psychic healers, anti-vivisectionists and other opponents of medicine and at the second reading in March 1936, the Bill was opposed and the House was counted out during the ensuing debate. The immediate reason for this fate was that the Bill came up for second reading on the day of the Grand National! This is only one example of the remarkable luck that has attended the patent medicine vendors.
(Page 14).

The “remarkable luck” of patent medicine vendors continues to this day, Although, in principle, advertisement of cures for venereal diseases was banned in 1917, and for cancer in 1939, it takes only a few minutes with Google to find that these laws are regularly flouted by quacks,  In practice quacks get away with selling vitamin pills for AIDS, sugar pills for malaria and homeopathic pills for rabies, polio anthrax and just about anything else you can think of.  Most of these advertisements are contrary to the published codes of ethics of the organisations to which the quack in question belongs but nothing ever happens.
Self-regulation simply does not work, and there is still no effective enforcement even of existing laws..

“It has already been stated that British law allows the advertiser of a secret remedy to tell any lie or make any claim that he fancies will sell his goods and the completeness of this licence is best illustrated by the consideration of a few specific points.

Advertisements for secret remedies very frequently contain a list of testimonials from medical men, which usually are in an anonymous form, stating that ………….. M.D., F.R.C.S., has found the remedy infallible. Occasionally, however, the name and address of a doctor is given and anyone unaware of the vagaries of English law would imagine that such use of a doctor’s name and professional reputation could not be made with impunity without his consent. In 1899, however, the Sallyco Mineral Water Company advertised that ‘Dr. Morgan Dochrill, physician to St. John’s Hospital, London and many of the leading physicians are presenting ‘Sallyco’ as an habitual drink. Dr. Dochrill says nothing has done his gout so much good.
Dr. Dochrill, whose name and title were correctly stated above, sued the company but failed in his case. ”

“The statement that the law does not prevent the recommending of a secret remedy by the use of bogus testimonials and facsimile signatures of fictitious physicians is obviously an understatement since it is doubtful how far it interferes with the use of bogus testimonials from real physicians.”

Dodgy testimonials are still a mainstay of dodgy salesman.  One is reminded of the unauthorised citation of testimonials from Dr John Marks and Professor Jonathan Waxman by Patrick Holford to aid his sales of unnecessary vitamin supplements. There is more on this at Holfordwatch.

The man in the street knows that the merits of any article are usually exaggerated in advertisements and is in the habit of discounting a large proportion of such claims, but, outside the realm of secret remedies, the law is fairly strict as regards definite misstatements concerning goods offered for sale and hence the everyday experience of the man in the street does not prepare him for dealing with advertisements which are not merely exaggerations but plain straightforward lies from beginning to end.

Scientific training is undoubtedly a handicap in estimating popular gullibility as regards nostrums. One imagines that no one today would be willing to spend money on pills guaranteed to prevent earthquakes but yet the claims of many of the remedies offered appear equally absurd to anyone with an elementary
knowledge of physiology or even of chemistry. A study of the successes and failures suggests that success depends chiefly on not over-rating the public intelligence. (Page 34)

This may have changed a bit since A.J. Clark was writing in 1938. Now the main clients of quacks seem to be the well-off “worried-well”. But it remains as true as ever that “Scientific training is undoubtedly a handicap in estimating popular gullibility as regards nostrums.” In 2008, it is perhaps more a problem of Ben Goldacre’s dictum ““My basic hypothesis is this: the people who run the media are humanities graduates with little understanding of science, who wear their ignorance as a badge of honour.”

Clark refers (page 36) to a successful conviction for fraud in the USA in 1917.  The subject was a widely advertised ‘get fat quick’ pill that contained lecithin, proteins and sugar.  The BMA analysis (in 1912)
suggested that the cost of the ingredients in a box of 30 tablets sold for 4/6 was 1 1/4 d. [4/6 meant 4 shillings and six pence, or 22.5 pence since 1971, and 1 1/4 old pence, a penny farthing, is 0.52 new pence]. He comments thus.

The trial revealed many interesting facts. The formula was devised after a short consultation with the expert of one of the largest drug manufacturers in the U.S.A. This firm manufactured the tablets and sold them to the proprietary medicine company at about 3/- per 1000, whilst they were retailed to the public at the rate of £7 10s. per 1000. The firm is estimated to have made a profit of about $3,000,000.

These trials in the U.S.A. revealed the fact that in a considerable proportion of cases the ‘private formula’ department of the large and well known drug firm already mentioned had first provided the formula for the nostrum and subsequently had prepared it wholesale.

Nothing much has changed here either. The alternative medicine industry (and it is a very big industry) is fond of denouncing the evils of the pharmaceutical industry, and sadly, occasionally they are right.  One of the less honest practices of the pharmaceutical industry (though one never mentioned by quacks) is buying heavily into alternative medicine. Goldacre points out

“there is little difference between the vitamin and pharmaceutical industries. Key players in both include multinationals such as Roche and Aventis; BioCare, the vitamin pill producer that media nutritionist Patrick Holford works for, is part-owned by Elder Pharmaceuticals.”

And then. of course, there is the deeply dishonest promotion by Boots the Chemists of homeopathic miseducation, of vitamins and of CoQ10 supplements.

The manner in which secret remedies can survive repeated exposure is shown by the following summary of the life history of a vendor of a consumption [tuberculosis] cure.

1904, 1906: Convicted of violating the law in South Africa.

1908:            Exposed in British Medical Association report and also attacked by Truth.

1910:            Sued by a widow. The judge stated: ‘I think this is an intentional and well-considered fraud. It is a scandalous thing that poor people should be imposed upon and led to part with their money, and to hope that those dear to them would be cured by those  processes which were nothing but quack remedies and had not the slightest value of any kind.’

1914:             A libel action against the British Medical Association was lost.

1915              The cure was introduced into the United States.

1919               The cure was sold in Canada.

1924                Articles by men with medical qualifications appeared in the Swiss medical journal boosting
the cure.

Secret remedies have a vitality that resembles that of the more noxious weeds and the examples mentioned suggest that nothing can do them any serious harm.

Most of the time, quacks get away with claims every bit as outrageous today.   But Clark does give one example of a successful prosecution.  It resulted from an exposé in the newspapers -wait for it -in the Daily Mail.

There is, however, one example which proves that a proprietary remedy can be squashed by exposure if this is accompanied by adequate publicity.

The preparation Yadil was introduced as an antiseptic and was at first advertised to the medical profession. The proprietor claimed that the remedy was not secret and that the active principle was ‘tri-methenal allylic carbide’. The drug acquired popularity in the influenza epidemic of 1918 and the proprietor became more and more ambitious in his therapeutic claims. The special virtue claimed for Yadil was that it would kill any harmful organism that had invaded the body. A more specific claim was that consumption in the first stage was cured with two or three pints whilst advanced cases might require a little more.  Other advertisements suggested that it was a cure for most known diseases from cancer downwards.

These claims were supported by an extraordinarily intense advertising campaign.  Most papers, and even magazines circulating amongst the wealthier classes,  carried full page and even double page advertisements. The Daily Mail refused these advertisements and in 1924 published a three column article by Sir William Pope, professor of Chemistry in the University of Cambridge. He stated that
the name ‘tri-methenal allylic carbide’ was meaningless gibberish and was not the chemical definition of any known substance. He concluded that Yadil consisted of :

‘About one per cent of the chemical compound formaldehyde.

About four per cent of glycerine.

About ninety-five per cent of water and, lastly, a smell.

He calculated that the materials contained in a gallon cost about 1/6, whilst the mixture was sold at £4 10s. per gallon.

This exposure was completely successful and the matter is of historic interest in that it is the only example of the career of a proprietary medicine being arrested by the action of the Press.

Clark goes on to talk of the law of libel.


“On the other hand the quack medicine vendor can pursue his advertising campaigns in the happy assurance that, whatever lies he tells, he need fear nothing from the interference of British law. The law does much to protect the quack medicine vendor because the laws of slander and libel are so severe.”

The law of libel to this day remains a serious risk to freedom of speech of both individuals and the media. Its use by rogues to suppress fair comment is routine.  My first encounter was when a couple of herbalists
threatened to sue UCL
because I said that the term ‘blood cleanser’ is gobbledygook.  The fact that the statement was obviously true didn’t deter them for a moment.  The herbalists were bluffing no doubt, but they caused enough nuisance that I was asked to take my pages off UCL’s server.  A week later I was invited back but by then I’d set up a much better blog and the publicity resulted in an enormous increase in readership, so the outcome was good for me (but bad for herbalists).

It was also good in the end for Andy Lewis when his immortal page “The gentle art of homoeopathic killing” (about the great malaria scandal) was suppressed.   The Society of Homeopaths’ lawyers didn’t go for him personally but for his ISP who gave in shamefully and removed the page.  As a result the missing page reappeared in dozens of web sites round the world and shot to the top in a Google search.

Chiropractors are perhaps the group most likely to try to suppress contrary opinions by law not argument.  The only lawyers’ letter that has been sent to me personally, alleged defamation in an editorial that I wrote for the New Zealand Medical Journal.  That was a little scary, but the journal stuck up for its right to speak and the threat went away after  chiropractors were allowed right of reply (but we got the last word).

Simon Singh, one of the best science communicators we have, has not been so lucky. He is going to have to defend in court an action brought by the British Chiropractic Association because of innocent opinions expressed in the Guardian.

Chapter 6 is about “The harm done by patent medicines”. It starts thus.

“The trade in secret remedies obviously represents a ridiculous waste of money but some may argue that, since we are a free country and it pleases people to waste their money in this particular way, there is no call for any legislative interference. The trade in quack medicines cannot, however, be regarded as a harmless one. The Poisons Acts fortunately prevent the sale of a large number of dangerous drugs, but there are numerous other ways in which injury can be produced by these remedies.”

The most serious harm, he thought, resulted from self-medication, and he doesn’t mince his words.

“The most serious objection to quack medicines is however that their advertisements encourage self-medication as a substitute for adequate treatment and they probably do more harm in this than in any other manner.

The nature of the problem can best be illustrated by considering a simple example such as diabetes. In this case no actual cure is known to medicine but, on the other hand, if a patient is treated adequately by insulin combined with appropriate diet, he can be maintained in practically normal health, in spite of his disability, for an indefinite period. The expectation of life of the majority of intelligent diabetics, who make no mistakes in their regime, is not much less than that of normal persons. The regime is both irksome and unpleasant, but anyone who persuades diabetics to abandon it, is committing manslaughter as certainly as if he fired a machine gun into a crowded street.

As regards serious chronic disease the influence of secret remedies may be said to range from murderous to merely harmful.

‘Cures’ for consumption, cancer and diabetes may fairly be classed as murderous, since they are likely to cause the death of anyone who is unfortunate enough to believe in their efficacy and thus delay adequate treatment until too late.

The phrase “‘Cures for consumption, cancer and diabetes may fairly be classed as murderous” made Clark himself the victim of suppression of freedom of speech by lawyers. His son, David Clark, wrote of his father in “Alfred Joseph Clark, A Memoir” (C. & J. Clark Ltd 1985 ISBN 0-9510401-0-3)

“Although tolerant of many human foibles, A. J. had always disapproved fiercely of quacks, particularly the charlatans who sold fraudulent medicines.  During his visits to London he met Raymond Postgate, then a crusading left wing journalist, who persuaded A.J. to write a pamphlet which was published in an ephemeral series called ‘Fact‘ in March 1938. It was a lively polemical piece. . To A.J.’s surprise and dismay he was sued for libel by a notorious
rogue who peddled a quack cure for for tuberculosis. This man said that A.J.’s remarks (such as “‘Cures’ for consumption, cancer and diabetes may fairly be classed as murderous”) were libellous and would damage his business.  A.J. was determined to fight, and he and Trixie decided to put their savings at stake if necessary. The B.M.A. and the Medical Defence Union agreed to support him and they all went to lawyers. He was shocked when they advised him that he would be bound to lose for he had damaged the man’s livelihood!   Finally, after much heart searching, he made an apology, saying that he had not meant that particular man’s nostrum”

Talk about déjà vu!

On page 68 there is another very familiar story. It could have been written today.

“The fact that the public is acquiring more knowledge of health matters and is becoming more suspicious of the cruder forms of lies is also helping to weed out the worst types of patent medicine advertisements. For example, in 1751 a bottle of oil was advertised as a cure for scurvy, leprosy and consumption but today such claims would not be effective in promoting the sale of a remedy. The modern advertiser would probably claim that the oil was rich in all the vitamins and the elements essential for life and would confine his claims to a statement that it would alleviate all minor forms of physical or mental ill-health.

The average patent medicine advertised today makes plausible rather than absurd claims and in general the advertisements have changed to conform with a change in the level of the public’s knowledge.

It is somewhat misleading, however, to speak of this as an improvement, since the law has not altered and hence the change only means that the public is being swindled in a somewhat more skilful manner.

The ideal method of obtaining an adequate vitamin supply is to select a diet containing an abundant supply of fresh foods, but unfortunately the populace is accustomed to live very largely on preserved or partially purified food stuffs and such processes usually remove most of the vitamins.”

The first part of the passage above is reminiscent of something that A.J Clark wrote in  the BMJ in 1927.  Nowadays it is almost unquotable and I was told by a journal editor that it was unacceptable even with asterisks.  That seems to me a bit silly. Words had different connotations in 1927.

“The less intelligent revert to the oldest form of belief and seek someone who will make strong magic for them and defeat the evil spirits by some potent charm. This is the feeling to which the quack appeals; he claims to be above the laws of science and to possess some charm for defeating disease of any variety.

The nature of the charm changes with the growth of education. A naked n****r howling to the beat of a tom-tom does not impress a European, and most modern Europeans would be either amused or disgusted by the Black mass that was popular in the seventeenth century. Today some travesty of physical science appears to be the most popular form of incantation.”

A.J. Clark (1927) The historical aspect of quackery, BMJ October 1st 1927

Apart from some of the vocabulary, what better description could one have of the tendency of homeopaths to harp on meaninglessly about quantum theory or the “scienciness” and “referenciness” of
modern books on nutritional therapy?

So has anything changed?

Thus far, the outcome might be thought gloomy. Judging by Clark’s account, remarkably little has changed since 1938, or even since 1914. The libel law in the UK is as bad now as it was then. Recently the United Nations Human Rights Committee said UK laws block matters of public interest and encourage libel tourism (report here, see also here).   It is unfit for a free society and it should be changed.

But there are positive sides too. Firstly the advent of scientific bloggers has begun to have some real influence. People are no longer reliant on journalists to interpret (or, often, misinterpret) results for them. They can now get real experts and links to original sources.  Just one of these, Ben Goldacre’s badscience.net, and his weekly column in the Guardian has worked wonders in educating the public and improving journalism.  Young people can, and do, contribute to the debate because they can blog anonymously if they are frightened that their employer might object.

Perhaps still more important, the law changed this year. Now, at last, it may be possible to prosecute successfully those who make fraudulent health claims. Sad to say, this was not an initiative of the UK government, which remains as devoted as ever to supporting quacks.  Remember that, quite  shamefully, the only reason given by the Medicines and Health Regulatory Authority (MHRA) gave for allowing false labelling of homeopathic pills was to support the “homeopathic industry”. They suggested (falsely) that the EU required them to take this irresponsible step, which was condemned by just about every scientific organisation. But the new unfair trading regulations did come from the EU. After almost 100 years since the 1914 report, we have at last some decent legislation. Let’s hope it’s enforced.

Postcript

The back cover of the series of ‘Fact‘ books in which A.J. Clark’s article appeared is reproduced below, simply because of the historical portrait of the 1930s that it gives.


Follow-up

This post got a lot of hits from Ben Goldacre’s miniblog which read

Jump to follow-up

After the announcement that the University of Central Lancashire (Uclan) was suspending its homeopathy “BSc” course, it seems that their vice chancellor has listened to the pressure, both internal and external, to stop bringing his university into disrepute.

An internal review of all their courses in alternative medicine was announced shortly after the course  closure.   Congratulations to Malcolm McVicar for grasping the nettle at last.  Let’s hope other universities follow his example soon.

I have acquired, indirectly, a copy of the announcement of the welcome news.

Homeopathy, Herbalism and cupuncture


Concern has been expressed by some colleagues as to whether the University should offer courses in homeopathy, Herbalism and Acupuncture. Therefore, to facilitate proper discussion on this matter I have set up a working party to review the issues.



I have asked Eileen Martin, Pro Vice-Chancellor and Dean of the Faculty of Health, to lead this working party and report to me as soon as possible. Whilst the review is taking place, we need to recognise that there are students and staff studying and teaching on these courses which have satisfied the University’s quality assurance procedures and been duly validated. I would therefore ask that colleagues would refrain from comment or speculation which would cause concern to these students and staff. Staff who wish to express their views on this issue should direct these to Eileen Martin, by the end of September.


Regards

Malcolm McVicar

Vice-Chancellor



Times Higher Education today reports

“The University of Central Lancashire is to review all its courses in homoeopathy, herbalism and acupuncture after some staff said it should not be offering degrees in “quackery”, Times Higher Education has learnt.

A university spokesman said: “As a university we value and practise transparency and tolerance and welcome all academic viewpoints.”

(Later, an almost identical version of the story ran on the Times Online.)

So far, so good.   But of course the outcome of a committee depends entirely on who is appointed to it.  Quite often such committees do no more than provide an internal whitewash.

It does seem a bit odd to appoint as chair the dean of the faculty where all these course are run, and presumably generate income.  Eileen Martin has often appeared to be proud of them in the past. Furthermore, the whole investigation will (or should) turn on the assessment of evidence.  It needs some knowledge of the design of clinical trials and their statistical analysis, As far as I can see, Ms Martin has essentially no research publications whatsoever.

I also worry about a bit about “satisfied the University’s quality assurance procedures and been duly validated”.  One point of the investigation should be recognise frankly that the validation process is entirely circular, and consequently worth next to nothing.  It must be hard for a vice-chancellor to admit that, but it will be an essential step in restoring confidence in Uclan.

Let’s not prejudge though. If there are enough good scientists on the committee, the result will be good.

I hope that transparency extends to letting us know who will be doing the judging.  Everything depends on that.

Follow-up

Well well, there’s a coincidence, Once again, the week after a there is an announcement about degrees in witchcraft, what should pop up again in the column of the inimitable Laurie Taylor in THE. The University of Poppleton’s own Department of Palmistry.

Letter to the editor


Dear Sir

I was shocked to see yet another scurrilous attack upon the work of my department in The Poppletonian. Although Palmistry is in its early days as an academic discipline it cannot hope to progress while there are people like your correspondent who insist on referring to it as “a load of superstitious nonsense which doesn’t deserve a place on the end of the pier let alone in a university”.

A large number of people claim to have derived considerable benefit from learning about life lines, head lines and heart lines and the role of the six major mounts in predicting their future. All of us in the Palmistry Department believe it vitally important that these claims are rigorously examined. How else can science advance?

Yours sincerely,

Janet Petulengro (Doctor)


Jump to follow-up



The Times today has given s good showing for my comment piece. It gives the case against following the advice of the Pittilo report. It simply makes no sense to have government regulation of acupuncture, herbal medicine, traditional Chinese medicine until such time as there is evidence that they work. It makes even less sense to have BSc degrees in them. The Department of Health should have more sense that to use the Prince of Wales as its scientific advisor.

Let’s hope that the recent example set by the University of Central Lancashire is the start of trend for vice-chancellors to appreciate that running such degrees brings their universities into disrepute.

I can only apologise for the dreadful title that The Times’ sub-editors put on the piece, My original title was

A bad report for the vice chancellor

The Pittilo report to the Department of Health will endanger the public and corrupt universities. There is a better way.

I like that much better than “Regulate quack nedicine? I feel sick”.

But, oh dear, the picture that I sent them is on the left, but what appeared is on the right. Spot the difference.


Well now, at least, I can feel I have something in common with Isambard Kingdom Brunel.


Follow-up

It so happens that Professor Pittilo wrote a letter to Times Higher Education this week. I fear that it provided a yet more evidence that he hasn’t really quite got the hang of evidence.

The Lancashire Evening Post catches up with the UCLan story, two days after you read it here.

A reply from Professor Pittilo

This response to the op-ed of 29th August appeared as a letter
in the Times
on Sept 2.

Public health needs protection

Regulation of acupuncture and herbal medicine has been subject to much scrutiny

Sir, Professor Colquhoun’s campaign to discredit our report (“Regulate quack medicine? I feel sick,” Aug 29) is in danger of placing public health at risk. He is entitled to challenge existing evidence for the effectiveness of complementary and alternative medicine (CAM) but fails to acknowledge the key recommendation from the steering group on the essential need to demonstrate efficacy, safety and quality assurance as a prerequisite for NHS funding.

Professor Colquhoun dismisses CAM because of the absence of a rigorous scientific foundation and he asserts that to teach and practise it is unethical. Survey data consistently demonstrates very high demand for CAM with one report estimating that 22 million visits involving 10.6 per cent of the population in England alone occurred in 2008. This demand is one reason why his alternative model of trade law enforcement will not work. He may argue that these people are uncritical recipients of nonsense, but data from the Medicines and Healthcare products Regulatory Agency confirm that they are at significant risk from poor practice. It is essential that we protect the public by implementing statutory regulation alongside demanding evidence of efficacy. Professor Colquhoun’s resistance to the teaching of science to CAM practitioners will do little to help them to critically evaluate effectiveness.

Professor Michael Pittilo

Chair of the Department of Health Steering Group

And Pittilo wrote in similar vein to Times Higher Education.

Science vital to health study

28 August 2008

Your feature on some members of staff at the University of Central Lancashire attacking science degrees in complementary and alternative medicine (“Staff attack science degrees in alternative health”, 7 August) raises a number of concerns.

It is up to any university, taking account of the expert views of staff and external peer review, to determine the appropriate title and award for any degree. It is encouraging to note from the feature that new courses
in acupuncture and Chinese herbal medicine “contain significant elements of science”.

The recent report to Ministers from the Department of Health Steering Group on the Statutory Regulation of Practitioners of Acupuncture, Herbal Medicine, Traditional Chinese Medicine and other Traditional Medicine
Systems Practised in the UK recognises the significant challenges in developing a strong research and evidence base for complementary and alternative medicine (CAM). It also states that the need to demonstrate
benefit is essential if National Health Service resources are to be made available to fund these therapies.

There is no doubt that courses that provide a solid scientific foundation will greatly assist CAM practitioners in establishing evidence-based practice. It would be most unfortunate if the reported resistance to degree titles led to those wishing to practise acupuncture or herbal medicine receiving less hard science than they might have.

To say that acupuncture and herbal medicine degrees have no academic justification appears arrogant in the extreme. Although it is certainly true that some content may not be scientific, this does not invalidate the legitimacy of these courses at degree level, a fact borne out by their successful validation in a number of universities.

R. Michael Pittilo, Principal and vice-chancellor, The Robert Gordon University.


This one got excellent responses from Kevin Smith (University of Abertay, Dundee), and from Peter J. Brophy (Professor of veterinary anatomy and cell biology University of Edinburgh). This was  my comment to THE

There are a few very obvious responses to Professor Pittilo’s letter

(1) “It is encouraging to note from the feature that new courses in acupuncture and Chinese Herbal medicine “contain significant elements of science”.

For many alternative therapies the “philosophy” is simply incompatible with science. One obvious example is homeopathy. On Mondays and Wednesdays (science days) the students will be required to learn that response increases with dose. On Tuesdays and Thursdays will be taught the opposite. But for the exam they must reproduce only the latter (nonsensical) idea because their aim is to get a job as a homeopath. That makes nonsense of the idea of a university.

(2) His report “recognises the significant challenges in developing a strong research and evidence base for complementary and alternative medicine (CAM)”.

This seems to constitute a recognition that the evidence is still very inadequate. The time to start degrees, and the time to give official government recognition, is after the evidence is in, not before. What happens if you start degrees and then find that the subject is so much nonsense? Well, that has already happened in several areas of course. But the people who accredit the course and who act as external examiners just happen to be fervent believers in that nonsense, so all appears to be well (to bean counters anyway).

(3) “It would be most unfortunate if the reported resistance to degree titles led to those wishing to practise acupuncture or herbal medicine receiving less hard science than they might have.”

There is, as it happens, a great deal of evidence now about acupuncture, but the authors of the report do not seem to be aware of it. I recommend Barker Bausell’s book on the topic. If students are educated science, like what constitutes evidence, and our current understanding of words like “energy”, they would have to disavow the subject that there are supposed to training to practise

(4) “To say that acupuncture and herbal medicine degrees have no academic justification appears arrogant in the extreme.”

No, it is not a matter of arrogance, just a matter of careful attention to the evidence. Attention to evidence was notably absent in Prof Pittilo’s report, perhaps because his committee consisted entirely of people who earn their living from the subjects they were supposed to be assessing.

(5) “ . . a fact borne out by their successful validation in a number of universities”.

I have had the misfortune to have waded through a mound of such validation documents. The one thing they never consider is whether the treatment works. Sad to say, these validations are not worth the paper they are written on.


The article below is an editorial that I was asked to write for the New Zealand Medical Journal, as a comment on article in today’s edition about the misuse of the title ‘doctor’ by chiropractors [download pdf]. Titles are not the only form of deception used by chiropractors, so the article looks at some of the others too.  For a good collection of articles that reveal chiropractic for what it is, look at Chirobase


THE NEW ZEALAND
MEDICAL JOURNAL

Journal of the New Zealand Medical Association

NZMJ 25 July 2008, Vol 121 No 1278; ISSN 1175 8716

URL: http://www.nzma.org.nz/journal/121-1278/3158/ ©NZMA

Doctor Who?
Inappropriate use of titles by some alternative “medicine” practitioners

David Colquhoun

Who should use the title ‘doctor’? The title is widely abused as shown by Gilbey1 in this issue of the NZMJ in an article entitled Use of inappropriate titles by New Zealand practitioners of acupuncture, chiropractic, and osteopathy. Meanwhile, Evans and colleagues 2, also in this issue, discuss usage and attitudes to alternative treatments.

Gilbey finds that the abuse of the title doctor is widespread and that chiropractors are the main culprits. An amazing 82% of 146 chiropractics used the title Doctor, andL most of them used the title to imply falsely that they were registered medical practitioners.

Although it is illegal in New Zealand to do that, it seems clear that the law is not being enforced and it is widely flouted. This is perhaps not surprising given the history of chiropractic. It has had a strong element of ruthless salesmanship since it was started in Davenport, Iowa by D.D. Palmer (1845–1913). His son, B.J. Palmer, said that their chiropractic school was founded on “a business, not a professional basis. We manufacture chiropractors. We teach them the idea and then we show them how to sell” (Shapiro 2008)3 It is the same now. You can buy advice on how to build “build high-volume, subluxation-based, cash-driven, lifetime family wellness practices”

In her recent book3 , Rose Shapiro comments on the founder of chiropractic as follows.

“By the 1890s Palmer had established a magnetic healing practice in Davenport, Iowa, and was styling himself “doctor”. Not everyone was convinced, as a piece about him in an 1894 edition of the local paper, the Davenport Leader, shows.

A crank on magnetism has a crazy notion hat he can cure the sick and crippled with his magnetic hands. His victims are the weak-minded, ignorant and superstitious,those foolish people who have been sick for years and have become tired of the regular physician and want health by the short-cut method he has certainly profited by the ignorance of his victim. His increase in business shows what can be done in Davenport, even by a quack.”

D.D. Palmer was a curious mixture: grocer, spiritual healer, magnetic therapist, fairground huckster, religious cult leader—and above all, a salesman. He finally found a way to get rich by removing entirely imaginary “subluxations”.

Over 100 years later, it seems that the “weak-minded, ignorant, and superstitious” include the UK’s Department of Health, who have given chiropractics a similar status to the General Medical Council.

The intellectual standards of a 19th Century Mid-Western provincial newspaper journalist are rather better than the intellectual standards of the UK’s Department of Health, and of several university vice-chancellors in 2007.

Do the treatments work?

Neither Gilbey nor Evans et al. really grasp the nettle of judging efficacy. The first thing one wants to know about any treatment —alternative or otherwise — is whether it works. Until that is decided, all talk of qualifications, regulation, and so on is just vacuous bureaucratese. No policy can be framed sensibly until the question of efficacy has been addressed honestly.

It is one good effect of the upsurge of interest in alternative treatments that there are now quite a lot of good trials of the most popular forms of treatments (as well as many more bad trials). Some good summaries of the results are now available too. Cochrane reviews set the standard for good assessment of evidence. New Zealand’s Ministry of Health commissioned the Complementary and Alternative Medicine
website to assess the evidence, and that seems to have done a good job too. Their assessment of chiropractic treatment of low back pain is as follows:

There appears to be some evidence from one systematic review and four other studies, although not conclusive, that chiropractic treatment is as effective as other therapies but this may be due to chance. There is very little evidence that chiropractic is more effective than other therapies.

And two excellent summaries have been published as books this year. Both are by people who have had direct experience of alternative treatments, but who have no financial interest in the outcome of their assessment of evidence. The book by Singh and Ernst4 summarises the evidence on all the major alternative treatments, and the book by Bausell5 concentrates particularly on acupuncture, because the author was for 5 years involved in research in that area, Both of these books come to much the same conclusion about chiropractic. It is now really very well-established that chiropractic is (at best) no more effective than conventional treatment. But it has the disadvantage of being surrounded by gobbledygook about “subluxations” and, more importantly, it kills the occasional patient.

Long (2004)7 said “the public should be informed that chiropractic manipulation is the number one reason for people suffering stroke under the age of 45.

The chiropractors of Alberta (Canada) and the Alberta Government are now facing a class-action lawsuit8. The lead plaintiff is Sandra Nette. Formerly she was a fit 41 year old. Now she is tetraplegic. Immediately
after neck manipulation by a chiropractor she had a massive stroke as a result of a torn vertebral artery.

Acupuncture comes out of the assessments equally badly. Bausell (2007) concludes that it is no more than a theatrical placebo.

Are the qualifications even real?

It is a curious aspect of the alternative medicine industry that they often are keen to reject conventional science, yet they long for academic respectability. One aspect of this is claiming academic titles on the flimsiest of grounds. You can still be held to have misled the public into thinking you are a medical
practitioner, even if you have a real doctorate. But often pays to look into where the qualifications come from.

A celebrated case in the UK concerned the ‘lifestyle nutritionist’, TV celebrity and multi-millionaire, Dr Gillian McKeith, PhD. A reader of Ben Goldacre’s excellent blog, badscience.net did a little investigation. The results appeared in Goldacre’s Bad Science column in the Guardian9.

She claimed that her PhD came from the American College of Nutrition, but it turned out to come from a correspondence course from a non-accredited US ‘college’. McKeith also boasted of having “professional membership” of the American Association of Nutritional Consultants, for which she provided proof of her degree and three professional references.

The value of this qualification can be judged by the fact that Goldacre sent an application and $60 and as a result “My dead cat Hettie is also a “certified professional member” of the AANC. I have the certificate hanging in my loo”.

Is the solution government regulation?

In New Zealand the law about misleading the public into believing you are a medical practitioner already exists. The immediate problem would be solved if that law were taken seriously, but it seems that it is not.

It is common in both the UK and in New Zealand to suggest that some sort of official government regulation is the answer. That solution is proposed in this issue of NZMJ by Evans et al2. A similar thing has been proposed recently in the UK by a committee headed by Michael Pittilo, vice-chancellor of Robert Gordon’s University, Aberdeen.

I have written about the latter under the heading A very bad report. The Pittilo report recommends both government regulation and more degrees in alternative medicine. Given that we now know that most alternative medicine doesn’t work, the idea of giving degrees in such subjects must be quite ludicrous to any thinking person.

The magazine Nature7 recently investigated the 16 UK universities who run such degrees. In the UK, first-year students at the University of Westminster are taught that “amethysts emit high yin energy” . Their vice chancellor, Professor Geoffrey Petts, describes himself a s a geomorphologist, but he cannot be tempted to express an opinion about the curative power of amethysts.

There has been a tendency to a form of grade inflation in universities—higher degrees for less work gets bums on seats. For most of us, getting a doctorate involves at least 3 years of hard experimental research in a university. But in the USA and Canada you can get a ‘doctor of chiropractic’ degree and most chiropractic (mis)education is not even in a university but in separate colleges.

Florida State University famously turned down a large donation to start a chiropractic school because they saw, quite rightly, that to do so would damage their intellectual reputation. This map, now widely distributed on the Internet, was produced by one of their chemistry professors, and it did the trick.

Other universities have been less principled. The New Zealand College of Chiropractic [whose President styles himself “Dr Brian Kelly”,though his only qualification is B. App Sci (chiro)] is accredited by the New Zealand Qualifications Authority (NZQA). Presumably they, like their UK equivalent (the QAA), are not allowed to take into account whether what is being taught is nonsense or not. Nonsense courses are accredited by experts in nonsense. That is why much accreditation is not worth the paper it’s written on.

Of course the public needs some protection from dangerous or fraudulent practices, but that can be done better (and more cheaply) by simply enforcing existing legislation on unfair trade practices, and on false advertising. Recent changes in the law on unfair trading in the UK have made it easier to take legal action against people who make health claims that cannot be justified by evidence, and that seems the best
way to regulate medical charlatans.

Conclusion

For most forms of alternative medicine—including chiropractic and acupuncture—the evidence is now in. There is now better reason than ever before to believe that they are mostly elaborate placebos and, at best, no better than conventional treatments. It is about time that universities and governments recognised the evidence and stopped talking about regulation and accreditation.

Indeed, “falsely claiming that a product is able to cure illnesses, dysfunction, or malformations” is illegal in Europe10.

Making unjustified health claims is a particularly cruel form of unfair trading practice. It calls for prosecutions, not accreditation.

Competing interests: None.
NZMJ 25 July 2008, Vol 121 No 1278; ISSN 1175 8716
URL: http://www.nzma.org.nz/journal/121-1278/3158/ ©NZMA

Author information: David Colquhoun, Research Fellow, Dept of Pharmacology, University College London, United Kingdom (http://www.ucl.ac.uk/Pharmacology/dc.html)

Correspondence: Professor D Colquhoun, Dept of Pharmacology, University College London, Gower Street, London WC1E 6BT, United Kingdom. Fax: +44(0)20 76797298; email: d.colquhoun@ucl.ac.uk

References:

1. Gilbey A. Use of inappropriate titles by New Zealand practitioners of acupuncture, chiropractic, and osteopathy. N Z Med J. 2008;121(1278). [pdf]

2. Evans A, Duncan B, McHugh P, et al. Inpatients’ use, understanding, and attitudes towards traditional, complementary and alternative therapies at a provincial New Zealand hospital. N Z Med J. 2008;121(1278).

3 Shapiro. Rose. Suckers. How Alternative Medicine Makes Fools of Us All Random House, London 2008. (reviewed here)

4. Singh S, Ernst E. Trick or Treatment. Bantam Press; 2008 (reviewed here)

5. Bausell RB. Snake Oil Science. The Truth about Complementary and Alternative Medicine. (reviewed here)
Oxford University Press; 2007

6. Colquhoun D. Science degrees without the Science, Nature 2007;446:373–4. See also here.

7. Long PH. Stroke and spinal manipulation. J Quality Health Care. 2004;3:8–10.

8. Libin K. Chiropractors called to court. Canadian National Post; June21, 2008.

9. Goldacre B. A menace to science. London: Guardian; February 12, 2007/

10. Department for Business Enterprise & Regulatory Reform (BERR). Consumer Protection from Unfair Trading Regulations 2008. UK: Office of Fair Trading.

Jump to follow up

A report has appeared on Regulation of Practitioners of Acupuncture, Herbal Medicine, Traditional Chinese Medicine. The report is written by people all of whom have vested interests in spreading quackery. It shows an execrable ability to assess evidence, and it advocates degrees in antiscience It would fail any examination. Sorry, Prof Pittilo, but it’s gamma minus.[Download the report]

Alice Miles put it well in The Times, today.

“This week came the publication of the “Report to Ministers from the Department of Health Steering Group on the Statutory Regulation of Practitioners of Acupuncture, Herbal Medicine, Traditional Chinese Medicine and Other Traditional Medicine Systems Practised in the UK”. Otherwise known as twaddle.” . . .

“Regulate the practitioners – for safety, note, not for efficacy, as that is impossible to prove – and you give them official recognition. From recognition it is but a short hop to demand and then prescription: packet of Prozac, bit of yoga and a bag of dodgy herbs for you, sir.” . . .

“The Government responded on Monday – with a three-month consultation. So join in. Write to the Health Minister Ben Bradshaw at Richmond House, 79 Whitehall, SW1A 2NS. Write, on behalf of the NHS: “What I want for my 60th birthday is… the chance to provide medical, dental, and nursing care to all. And absolutely nothing else.”

Judging by Ben Bradshaw’s speech to the Prince’s Foundation, there may be a problem in conveying to him the evidence, but one can and must try.

Why is it that a health joutnalist can do so much better than a university head? Yes, the chair of the steering group is Professor R. Michael Pittilo BSc PhD CBiol FIBiol FIBMS FRSH FLS FRSA, Principal and Vice-Chancellor of The Robert Gordon University, Aberdeen. Despite all those impressive-lookin initials after his name, I believe that this is a very bad report.

Here is something about Prof Pittilo from his university’s web site (the emphasis is mine).

Professor Michael Pittilo joined The Robert Gordon University, Aberdeen, as Principal and Vice-Chancellor on 5th September, 2005.

After postdoctoral research on arterial disease at the University of London, he was appointed to Kingston University where he became Head of Life Sciences. In 1995 he became Foundation Dean of the Faculty of Health and Social Care Sciences at Kingston University and St George’s Medical School (University of London). He was appointed Pro Vice Chancellor at the University of Hertfordshire in 2001.

Professor Pittilo has held a number of additional roles, including chairing Department of Health working groups, and as a trustee for the Prince of Wales’s Foundation for Integrated Health.

Notice that Prof Pittilo is a Trustee of the Prince’s Foundation for Integrated Health, source of some of the least reliable information about alternative medicine to be found anywhere.

This steering group is, as so often, a nest of vested interests. It does not seem to have on it any regular medical or clinical scientist whatsoever. Why not? They just might produce some embarrassing facts perhaps? Like most government committees its members seem to have been chosen to produce the desired outcome.

For a start, the university run by Prof Pittilo, Robert Gordon’s University, is itself involved in a few antiscientific courses. Since his report recommends that degrees in quackery should become mandatory, I expect he’d welcome the chance to run more. Amazingly, Robert Gordon’s University runs an Introduction to Homeopathy, just about the daftest of all the common sorts of magic medicine.

Most of the the members of the steering group represent vested interests, though strangely this is not made clear in the list of members. An earlier report, in 2006, from the steering group was more open about this. Twelve of the members of the group represent Herbal Medicine, Chinese Medicine and Acupuncture (four from each). Most of the rest are lay members or bureaucrats. With membership like that it is, I suppose, not surprising that the assessment of evidence is, to put it kindly, grossly distorted and woefully inadequate.

The report starts badly by failing to mention that the House of Lords report (2000), and the government’s response to it, set the following priorities. Both state clearly

“… we recommend that three important questions should be addressed in the following order . .

  • (1) does the treatment offer therapeutic benefits greater than placebo?
  • (2) is the treatment safe?
  • (3) how does it compare, in medical outcome and cost-effectiveness, with other forms of treatment?

The word ‘placebo’ does not occur a single time in the main report (and only twice in the text of the seven appendices). But they do say (page 11):

“We recommend that public funding from the NHS should be used to fund CAM therapies where there is evidence of efficacy, safety and quality assurance.”

The evidence

The problem is that the assessment of the evidence for efficacy in the report is pathetically poor. The report, sad to say, consists essentially of 161 pages of special pleading by the alternative medicine industry, served up with the usual large dose of HR gobbledygook.

There is really no excuse for this utterly incompetent assessment. There have been plenty of books this year alone that make excellent summaries of the evidence, mostly written for the lay public. They should, therefore, be understandable by any university vice-chancellor (president). The one benefit of the upsurge in public interest in magic medicine is that there are now quite a lot of good clinical trials, and when the trials are done properly, they mostly confirm what we thought before: in most cases the effects are no more than placebo.

Here is one example. Annexe1 concerns “Developing Research and Providing an Evidence Base for Acupuncture and Herbal/Traditional Medicine Treatment”. The wording of the title itself suggests, rightly, that this evidence base does not exist, in which case why on earth are we talking about them as “professions”? The discussion of the evidence in Annexe 1 is nothing if not partial. But what do you expect if you ask herbalists to assess herbal medicine? An honest assessment would put them out of business. The eternal mantra of the alternative industry appears as usual, “Absence of evidence is, of course, not evidence of absence”. True of course, but utterly irrelevant. Annexe 1 says

“Acupuncture is a complex intervention and lack of a suitable placebo control has hindered efforts to evaluate efficacy”

This is simply untrue, In recent years enormous efforts have been put into devising controls for assessment of acupuncture, but they are entirely ignored here. One thing that has been established quite clearly is that it makes no difference where you put the needles, so all the talk of Qi and meridians is obvious mumbo-jumbo.

Have the authors of Annexe 1, and Professor Pittilo, not read the relevant studies? Two books this year have dealt with the question of evidence with great care. They are both by people who have been involved personally with acupuncture research, Prof Edzard Ernst and Dr Barker Bausell. Edzard Ernst is the UK’s first Professor of Complementary Medicine. Barker Bausell was research director of an NIH-funded Complementary and Alternative Medicine Specialized Research Center at the University of Maryland.

Singh and Ernst discuss thoroughly the question of controls and assess all the evidence carefully. Their conclusions include the following.

  • The traditional principles of acupuncture are deeply flawed, as there is no evidence at all to demonstrate the existence of Ch’i [Qi] or meridians.
  • By focussing on the increasing number of high-quality research papers, reliable conclusions from systematic reviews make it clear that acupuncture does not work for a whole range of conditions, except as a placebo.
  • In short, the evidence is neither consistent nor convincing. It is borderline.

Barker Bausell was himself involved in designing and analysing trialsof acupuncture. His conclusions are even less positive.

“There is no compelling, credible scientific evidence to suggest that any CAM therapy benefits any medical condition or reduces any medical symptom (pain or otherwise) better than a placebo”.

These are serious authors with direct experience in CAM research, which is more than can be said of anyone on the steering group. Why are their conclusions ignored entirely? That is sheer incompetence.

Degrees in anti-science

One conclusion of the report is that

“The threshold entry route to the register will normally be through a Bachelor degree with Honours”

This is utter nonsense. It is quite obvious surely that you can’t award honours degrees until after you have the evidence. You can read on page 55 of the report

3a: Registrant acupuncturists must:

understand the following aspects and concepts for traditional East-Asian acupuncture:

– yin/yang, /5 elements/phases, eight principles, cyclical rhythms, qi ,blood and body fluids, different levels of qi, pathogenic factors, 12 zang fu and 6 extraordinary fu, jing luo/ meridians, the major acupuncture points, East-Asian medicine disease categorisation, the three burners, the 4 stages/levels and 6 divisions

– causes of disharmony/disease causation

– the four traditional diagnostic methods: questioning, palpation, listening and observing”

This is utter baloney. Anyone who advocates giving honours degrees in such nonsense deserves to be fired for bringing his university into disrepute (and, in the process, bringing all universities and science itself into disrepute).

That includes also degrees that teach that “amethysts emit high yin energy“.

So what should be done?

If making peole do degrees in mumbo-jumbo is not the answer, what is? Clearly it would be far too draconian to try to ban quackery (and it would only increase its popularity anyway).

The answer seems to me to be quite simple. All that needs to done is to enforce existing laws. It is already illegal to sell contaminated and poisonous goods to the public. It is already illegal to make fraudulent advertisemants and to sell goods that are not as described on the label.

The only problem is that the agencies that enforce these rules are toothless and that there are a lot of loopholes and exceptions that work in favour of quackery. I have tried myself to complain about mislabelling of homeopathic pills to the Office of Fair Trading on the grounds that are labelled Arnica 30C but contain no Arnica. They solemnly bought a bottle and sent it to an analyst and of course they found no arnica, But nothing happened, because an exception to the usual law applies to homeopathic pills.

The Advertising Standards Authority is good as far as it goes. They quickly told Boots Pharmacies to withdraw advertisements that claimed CoQ10 “increased vitality”. But they can exact no penalties and they can’t deal with lies that are told to you orally, or with anything at all on the web.

The Health Professions Council (HPC) says that one of the criteria for registering new professions is aspirant groups must “Practise based on evidence of efficacy”. If that were actually applied, none of this process would occur anyway. No doubt the HPC will fail to apply its own criteria. On past form, it can be expected to adopt a “fluid concept of evidence“.,

One more thing, New European legislation was described recently in the BMJ

“Consumers in the United Kingdom are to receive stronger legal safeguards against products that claim, without any identifiable scientific evidence, to provide physical and mental health benefits such as tackling obesity or depression.”

“The scope of the legislation is deliberately wide and is the biggest shake up in consumer law for decades. It targets any unfair selling to consumers by any business.”

Politicians seem to be immune to rational argument when it comes to quackery. But a few legal actions under these laws could bring the house of cards tumbling so fast that this gamma-minus report would become rapidly irrelevant. There will be no shortage of people to bring the actions. I can’t wait.

Follow up

Dominic Lawson, 24 June 2008. An excellent column appeared today in the Independent. Dominic Lawson writes about the Pittilo report: “So now we will have degrees in quackery. What, really, is the difference between acupuncture and psychic surgery?“. The reference to that well known conjuring trick, “psychic surgery” as a “profession”, revealed here, causes Lawson to say

“It makes it clear that the lunatics have taken over the asylum. For a start, how could Philip Hunt, previously director of the National Association of Health Authorities and Trusts, possibly have thought that “psychic healing” constituted a “profession” – let alone one which would “develop its own system of voluntary self-regulation?”

“One can see how this might fit in with the Government’s “never mind the quality, feel the width” approach to university education. One can also see how established practitioners of such therapies might see this as a future source of income – how pleasant it might be to become Visiting Professor of Vibrational Medicine at the University of Westminster.

Thus garlanded with the laurels of academic pseudo-science, the newly professionalised practitioners of “alternative medicine” can look down on such riff-raff as the “psychic surgeons”

Once again I have to ask, how is it that we have to rely on journalists to prevent vice-chancellors eroding academic standards; indeed eroding simple common sense? I guess it is just another sign of the delusional thinking engendered by the culture of managerialism that grips universities.

This is a follow-up of the poat on BBC2 and the Open University on Alternative Medicine.

Following the article by Simon Singh in the Guardian (25 March 2006), two letters appeared on April 1, 2006. The first, from Prof. Edzard Ernst, confirmed that he felt the BBC had ignored and misrepresented his advice.

 In its response to our criticism of the Alternative Medicine series, the BBC says “it is extremely unusual that Professor Ernst should make these comments so long after the series was aired” (Report, March 25). I made my criticism in writing two months before the programme was broadcast. The reason why I reiterated them when I did was simply because Simon Singh interviewed me in my capacity as adviser to the BBC. Extremely unusual? Long after? I don’t think so.
Prof Edzard Ernst
Peninsula Medical School, Exeter

The second letter defended the BBC. It was unequivocal in its support of the entire series of programmes, and its appearence surprised me.  In the light of all that has been written, one might have hoped that the BBC would listen and learn from its mistakes. The letter has ten signatories.

We are all scientists involved as consultants or contributors to the BBC2 series, Alternative Medicine. We do not in any way recognise the experience of working on the series as described in your article (Was this proof of acupuncture’s power … or a sensationalised TV stunt?, Science, March 25), nor do we share the views of those scientists you have quoted in it. In all its dealings with us, the BBC asked for advice and input where needed, took on board our feedback and incorporated our comments into the final edit of the programme as transmitted, where appropriate. Far from feeling dissatisfied with the final outcome, we feel the series seemed well balanced and informative, doing full justice to the subject matter it addressed.

Dr Jack Tinker
Royal Society of Medicine

Prof Brian Berman
University of Maryland

Prof Liz Williamson
Reading University

Dr Andrew Vickers
Memorial Sloane-Kettering Cancer Center, New York

Dr James Warner
Imperial College London

Dr Mike Cummings
British Medical Acupuncture Society

Prof Gary Green
York University

Dr Carl Albrecht
University of Johannesburg

Dr Jen Cleland
University of Aberdeen

Professor Irving Kirsch
University of Plymouth

But all is not what it seems. Contrary to appearances, this letter was actually written by the BBC who also compiled the signatories (it seems to have been the responsibility of Kim Creed, of BBC Factual Publicity).

    • One of the signatories. Dr James Warner, had never seen the letter until after it was published, and tells me that “[I] substantially do not agree with the sentiments expressed therein. Indeed, we had to resist attempts by the programme makers to sensationalise our work”.
      The Guardian has published a correction.
  • Six other signatories tell me that their approval was limited to the way their own contribution was treated, and was not intended as approval of the whole series. One commented ” I’ve obviously been naïve, and I am very fed up with this whole thing”. Another says ” I suppose I (foolishly by the sounds of things) extrapolated from my own programme and experience, without considering the wider implications of the concluding sentence”.
  • Only one of the eight signatories whom I’ve asked has actually seen all three programmes, as they were transmitted. This makes it rather odd that they should appear to endorse so unequivocally the whole series.
  • One of the signatories, Carl Albrecht, gives his address as “University of Johannesburg”, but oddly the BBC forgot to mention that Dr Albrecht is co-owner (at least until very recently) of the South African Company, Phyto Nova, that makes, promotes and sells the untested herb, Sutherlandia, for treatment of AIDS (see, for example, here).
    He is, therefore, highly biassed. He is also exceedingly controversial. One of his strongest critics has been Stuart Thomson, Director of the Gaia Research Institute,
    hardly an organisation that is biassed against “natural medicines”. Albrecht is indeed a very curious choice of advisor for a programme about science.
  • Three of the signatories (Berman, Cummings and Albrecht) are heavily committed to CAM, and so unlikely to be critical of anything that favours it, even apart from financial interests in the outcome. Brian Berman even has is own an entry in Quackwatch. So several of the signatories are pretty much committed in advance. Asking them if they endorse the programmes is about as informative as asking a group of priests if the endorse god.
  • It gets worse. This morning, 6th April, I heard from Andrew Vickers, of the Memorial Sloan-Kettering Cancer Center, New York. This is what he says.

    “I didn’t sign this letter ”
    “I was shown the text of the letter but didn’t fully agree with it and told them so. I said something along the lines that the series didn’t do ‘full justice to the subject matter’ (how could it possibly?) but that what they did was fair and reasonable within the constraints set by the medium. You are also right to point out that my comments only go so far as the acupuncture episodes (which I saw) rather than the other two shows (which I did not). No doubt had I been shown a final version for signature I would have also pointed this out.”

The BBC brought us superb programmes like Life on Earth and Planet Earth.  They bring us superb news (I’m listening to the incomparable John Humphrys on the Today Programme right now). They have suffered unjustly at the hands of spin-meisters like Alastair Campbell and the execrable Hutton Report (If the Hutton Report had been an undergraduate essay, it would have scored alpha-plus for collection of evidence and gamma-minus for ability to connect evidence to conclusions).

How ironic it is, then, to see the BBC behaving in this case like spin artists.  Deny everything, and, if necessary, falsify the evidence.

Jump to Open University course K221

Jump to follow-up

BBC2 TV showed a much-advertised series on alternative medicine, in February 2006. The programmes seem to be linked with a dubious Open University course.

The programmes are presented by Kathy Sykes, who is professor of the public understanding of science at Bristol University. She has done some excellent work in that area, for example, in the Rough Science TV series.

The first programme: acupuncture

The first programme, on acupuncture, was shown on 24th January, 2006. The programme did not start
in a very promising way. Just lots of testimonials from happy patients, the staple diet of all snake oil salesmen.
They are watchable, of course, but don’t do anything at all to promote public understanding of what constitutes evidence.

There is, of course, little doubt that sticking needles into your body can produce physiological responses. Two things remain uncertain.

  • Just how useful are these responses in helping particular conditions?
  • Is there anything at all in the mumbo jumbo of meridians and chi?.

With a big flourish we were shown “a 21-year-old Shanghai factory worker undergoing open-heart surgery with only the needles to control her pain”. It turns out that this was a sham. The patient was doped on opiates and local anaesthetics. The needles were merely cosmetic. Why were we not told?

The apparently contradictory trials suggested that, at least the alleged principles of acupuncture are nonsense. The programme concentrated on a trial by Berman (Ann Intern Med. 2004,
141, 901-10 ) which used ‘sham acupuncture’, with ‘stage dagger needles’, on osteoarthritis of the knees. In this sort of trial there is no actual penetration, and the sham needles are placed on the places dictated by the mumbo jumbo. This procedure was justly criticised by a subsequent letters in the same journal (Ann
Intern Med
2005, 142, 871
).

Another large study was ignored by the TV programme altogether. This was by Linde et al. (Journal of the American Medical Association. 2005 293(17):2118-25). This study concluded

“Acupuncture was no more effective than sham acupuncture in reducing migraine headaches although both interventions were more effective than a waiting list control.”

As pointed out above, this study is, in many ways, much more interesting than Berman’s, because the control group did not have ‘sham acupuncture’. Needles were really inserted, but they were inserted in points that have nothing to do with the mumbo jumbo of meridians. The fact that the controls were much the same as the treated group suggests that, whatever effect the needles produce, it doesn’t matter much where they are inserted. The only obvious interpretation of this is that the ‘principles’ on which acupuncture is based are so much nonsense (and, therefore, it is not a subject that can possibly be taught in a university).

This crucial point was ignored by the TV programme. A big fuss was made of a functional magnetic resonance experiment, staged for TV, that showed that the effects on brain ‘activation’ are different for superficial needling and for real needling. There is nothing in the least surprising in the observation that have a needle pushed into you affects the brain, but it really does not help at all in answering the important questions. Incidentally that experiment had already been done anyway.

In summary, the first programme, failed to give a fair assessment of current knowledge about acupuncture, and failed to consider the important questions of what sort of controls are appropriate, and whether talk of meridians means anything whatsoever. Sadly, I can’t agree with the boast that “It’s the deepest investigation into the efficacy of alternative medicine ever attempted on TV”.  Let’s hope the second programme is a bit more critical.

The second programme: healing

The second programme (31st January, 2006). I liked this programme much better than the first, even if it left the crucial questions unresolved.

The programme started with a healing meeting by the notorious Benny Hinn.  The meeting had all the mass hysteria of a Nuremburg rally, though no mention was made of the fact that this (very rich) man’s financial malpractice had been revealed by a CBC TV programme.

On the right is his receipt for £3347 for two nights at the Lanesborough hotel in London (that did not include $1700 he gave in tips).

The lovely Ghanaian lady who cleans my office and lab every morning gives gives money to this mega-rich man because “he needs it to preach the gospel”.

The National Institutes of Health provided $1.8 m of US taxpayers’ money for this project which seems not to do real research at all. After seeing a demonstration of the “Gas Discharge Visualization”, GDV, or Kirlian camera, given by a very gullible Dr Melinda Connor, Sykes comments that this ‘research’ “is not so much trying to find the evidence for ‘healing energy’,  but is rather working on the basis that there is one”

Kathy Sykes did, though show a pretty healthy degree of scepticism about the people who pretend to photograph “auras” and other imaginary “force fields”. She visited the “Center for Frontier Medicine in Biofield Science” at the University of Arizona.

In other words, the ‘research’ is a con. Once again (see above) we see money given by well-intentioned governments diverted form the purpose for which it was given.  For more first class boloney on ‘imaging’, see for example, Biofield Sciences in Exeter (UK)  and ‘electro-crystal therapy’.  The list is endless.

Kathy Sykes went on to show several interesting experiments on placebo effects. For example sham healers (played by actors) do at least as well as ‘real’ healers.  And sham knee surgery may be as effective as real surgery, though the programme failed to mention the obvious possibility that this could mean nothing more than that real knee surgery is itself pretty ineffective.  As so often in this series, the producers failed to talk to the right people.

She concludes “healing does not work beyond placebo”.

So I’m right with her, though it would have been better if there had been a more critical mention of the fact that not all placebo effects are real.  Many probably depend on the natural fluctuations in the intensity of the patient’s condition.  Anything can ‘cure a cold’, because you recover from a cold in a few days anyway,

Sykes concludes, speaking of the placebo effect, “I want to see that power properly harnessed -we’d be mad not to”.  But that, disappointingly, was the end of the programme.  That point is where the problems begin.  How do you harness the placebo effect?  How do you justify lying to the patient in order to maximize the effect?  How do you train the ‘healers’? Are they themselves to believe the same lies, or are they to be trained in the art of deception?  As pointed out in a recent review of the neurobiology of placebos (Colloca and Benedetti, 2005)

“For example, the assertion that placebos, fake therapies, fresh water and sugar pills could  positively affect the brain biochemistry in the appropriate psychosocial context might lead to a dangerous justification for deception, lying and quackery”.

These are the central dilemmas of sCAM, as listed at the top of this page. The programme did nothing to solve them, or even to draw attention to them.

The link with Open University Course K221

The blurb on this programme on the Open University/BBC site concludes

“So, could the power of the mind explain the benefits people experience from healers? And have healers tapped into this power somehow? The conclusion throws new light on all healing processes, and has a surprising and inspirational message for every practitioner and patient.”

But what is to be done about this “inspiration”? Nothing is said about that.  The TV programme was immediately followed by voice-over that advertised an Open University pamphlet, which is publicity for their course K221. That course, judging from what is posted on the web, is run by true believers who are a lot less sceptical than Sykes. She says that she did the voice-over but has not yet been shown the contents of the course.

The third programme: herbalism

Oooh dear. The third programme was, in my view, by far the worst.  Hardly a single critical voice was heard. Despite the odd word of reservation,  the programme left the impression of being an advertisement for the herbal medicine industry. Did the BBC not think of asking a pharmacologist?  In my view, this programme was a disservice to human knowledge.  Let’s look at some of the details.

The programme once again starts with dramatic testimonials from satisfied customers. No hint is given to the viewer of the total unreliability of such testimonials. References, in awed voice, are mad to “a vast body of ancient knowledge that herbalists draw on”.  No mention of the superb track record that ‘ancient knowledge’ has for turning out to being dead wrong.  It was 11 minutes into the programme before the question of evidence was even mentioned and then we had a herbalist wandering through a field. At 13 minutes, the herbalist, Simon Mills, was interviewed -he rattled on about dampness. marshy conditions. “There
are herbs for heating and drying”. Sheer gobbledygook. And still no discussion of evidence.

Sutherlandia At 18 minutes “To get another view I’m going to a country where herbs are claimed to have dramatic effects”. Off to Africa to spend a good 10 minutes on Sutherlandia, a totally unverified treatment for AIDS.  Why spend all this time (and licence-payers money) to end up with the conclusion that clinical trials have
not been done yet, and we have no real idea whether it works or not?  A search of Pubmed for Sutherlandia and AIDS produces a mere five papers.  Mills et al. Nutrition Journal 2005, 4:19 write as follows.

“Despite the popularity of their use and the support of Ministries of Health and NGOs in some  African countries, no clinical trials of efficacy exist, and low-level evidence of harm identifies the potential for drug interactions with antiretroviral drugs.”

(and one of the authors on that paper is from the Canadian College of Naturopathic Medicine: hardly likely to have a bias against herbs). The comments made in the programme about AIDS were irresponsible and potentially dangerous:  they could kill people..

It took until almost half way through the programme, before we got round to the question of whether any of these claims are true. Very impressive to learn that the Nazis pushed herbal medicine, but totally uninformative (or does it mean that herbalism appeals to nutters?). We are shown the German herbal bible, but again it is pointed out that it contains no evidence about their efficacy. So no further forward yet.  Then we are introduced to chromatography: very pretty, but still no evidence about whether herbs help people.

At 9.34 pm we are last get round to some evidence. Or do we? Not yet, just another personal testimonial about the the wonders of St John’s Wort. St John’s Wort (Hypericum) is an interesting case, because there is at least some evidence that it works, though certainly not enough for it to be described as a “superherb”, as Sykes did.  Of course depression (like knee surgery -above) makes a pretty good case for herbalists, because conventional antidepressants are so very unsatisfactory themselves.  It doesn’t take much to do better than Seroxat (Paxil, paroxetine).  At 9.38 pm we get the first actual numbers. And very selective numbers they are
too. The view presented in the programme was desperately over-optimistic about the wondrous effects of St John’s wort.  Consider the recent review by Linde et al. (2005 Brit J. Psychiatry, 186, 99-107) (read
it yourself –download pdf file).  The conclusion was as follows.

“Current evidence regarding Hypericum extracts inconsistent and confusing. In patients who meet criteria for major depression, several recent placebo-controlled trials suggest that Hypericum has minimal beneficial effects while other trials suggest that Hypericum and standard antidepressants have similar beneficial effects. ”

And another trial, again not mentioned in the programme, was published in Journal of the American Medical Association, 2002, 287, 1807 – 1814) [download the pdf file]. This paper was interesting because it compared placebo, St John’s Wort and sertraline (Zoloft), a drug of the same class as Seroxat).  All three were indistinguishable (on the two primary outcome measures).  So St John’s Wort was as good as Zoloft, but only because Zoloft was no better than placebo either.  The paper concluded thus.

“This study fails to support the efficacy the efficacy of H. perforatum [St John’s Wort] in moderately severe major depression. The result may be due to low assay sensitivity of the trial, but the  complete absence of trends suggestive of efficacy for H. perforatum is noteworthy.”

Why were we not told about trials like these?

At 9.43 pm, almost three quarters of the way through the programme, we are eventually told that ginseng, echinacea and evening primrose oil do not work. What took so long?

9.46 pm. Off to South Africa to look at research in Johannesburg on Sutherlandia by Carl Albrecht (more of him below).  Some impressive stuff about flavonoids but no results.   Flavonoids can’t be absorbed, but, aha, it contains saponins too. Perhaps they allow the flavonoids into cells. Well perhaps.
But this is not information, it is idle speculation.

At 9.51, we get back to brain imaging, this time at Imperial College. Professor Sykes seems to be excessively impressed by brain imaging. We are then treated to more idle speculation about how ginko might help in Alzheimer’s disease. Dr Warner is running a clinical trial to find out whether ginko really helps. But there were no results yet. In that case why not wait until there is a result, before telling us all about it?

We are told that herbs now “have to go through rigorous quality standards”.  It was NOT made clear that the standards don’t include anything about the herb actually doing anything useful.  The standards may give some protection against your being poisoned.  They do nothing at all to guarantee you’ll be helped.

The conclusions

“What’s really impressed me is the way that different ingredients from particular herb can combine together and have really powerful effects on us humans. So I believe that herbs are going to play a key role in medicines of the future”

“What started as an ancient wisdom may just might provide new medicines that will help us all live longer, fuller lives”

These statements are quite outrageous!   The first statement has no basis whatsoever.  It is sheer idle speculation.  It could be true, but there is no reason to believe it is.

The second statement is content-free.  Yes, it “may just” do that. On the other hand it may not.

The web site for the third programme. (7th February, 2006, 2100-2200) concludes thus.

“So, what’s their secret? Working with fellow scientists, Kathy discovers that plants contain much  more than a single – or even two or three – active ingredients. They are enormously complex

Chemical cocktails that have medicinal properties modern pharmaceuticals simply can’t reproduce.”

Just one snag (apart from the misleading implication the Sykes was doing pharmacological experiments), There is not the slightest reason, thus far, to think there is any advantage in using an “enormously complex chemical cocktail”.


Stop press: on Saw palmetto (one of the “superherbs” of the TV series)

The New England Journal of Medicine, for February 9th 2006 (354, 557 – 566), reports a clinical trial of “Saw Palmetto for Benign Prostatic Hyperplasia”. This is what they say.

“Saw palmetto is used by over 2 million men in the United States for the treatment of benign prostatic hyperplasia and is commonly recommended as an alternative to drugs approved by the Food and Drug Administration.”

“In this double-blind trial, we randomly assigned 225 men over the age of 49 years who had moderate-to-severe symptoms of benign prostatic hyperplasia to one year of treatment with saw palmetto extract (160 mg twice a day) or placebo.”

“Conclusions. In this study, saw palmetto did not improve symptoms or objective measures of benign prostatic hyperplasia.”

I hope that the BBC, the Open University and Prof Sykes now appreciate the folly of judging treatments before the results are in.

Postscript. Some reviews of the TV programmes

  • There has been some lively discussion of the BBC2 series on a forum of the James Randi Educational Foundation, on the BBC2/Open University site, on Ben Goldacres’s Badscience site, and at ebm-first.com.

  • The Times TV critic was unenthusiastic.

    “So having started out as a sceptic, Sykes ended the programme chirruping, like a born-again Christian, about how herbs contain complex combinations of chemicals that scientists cannot yet reproduce&”;

  • Simon Singh writes in the Daily Telegraph (14 Feb., 2006): "Did we really witness the ‘amazing power’ of acupuncture?

    “A BBC series on unorthodox therapies was devoid of scepticism and rigour, says Simon Singh.”

    “Although the second programme was indeed a rational look at the placebo effect, the other two episodes were little more than rose-tinted adverts for the alternative medicine industry.”

    “For example, the scene showing a patient punctured with needles and undergoing open heart surgery left viewers with the strong impression that acupuncture was providing immense pain relief. In fact, in addition to acupuncture, the patient had a combination of three very powerful sedatives (midazolam, droperidol, fentanyl) and large volumes of local anaesthetic injected into the tissues on the front of the chest.
    With such a cocktail of chemicals, the acupuncture needles were apparently cosmetic. In short, this memorable bit of telly was emotionally powerful, but scientifically meaningless in building a case for acupuncture. ”

    “This TV series pretended to be scientific and had the chance to set the record straight, but instead it chickened out of confronting the widespread failure of alternative medicine. ”

  • Advertisers cash in. Sadly, but predictably, the programme on herbalism has
    already been exploited by vendors of unproven treatments. While it is true that the programme did not actually assert that this herb cured AIDS, it certainly left the impression that it was good stuff.  Here is an example: “As seen on BBC2”

    “In South Africa, BBC 2 TV presenter, Professor Kathy Sykes learnt of the herb Sutherlandia, which is being touted as a new weapon in the fight against HIV and ”

    “It is with thanks to programmes such as Alternative Medicine shown on BBC 2 on Tuesday 7th February, and the work carried out by Professor Kathy Sykes that medicinal herbs can receive the acknowledgement they truly deserve, and this knowledge be passed on to the general public.”

    “Bioharmony Sutherlandia is available from Revital Ltd in 60 x 300mg tablets for £19.99rrp. ”

  • A groundbreaking experiment … or a sensationalised TV stunt?

    Simon Singh, in The Guardian (25 March 2006) followed through with some more details on the BBC2 series. It’s not only pharmacologists who were unhappy about it. So were several of the people who advised the BBC and/or appeared on the programme.

    “But this week scientists involved in the series have complained that elements of the programmes were misleading, the production team was uninformed, and scientists were used as “marionettes” ”

    At the end of the first programme a “hugely ambitious” imaging experiment was shown with an enormous flourish. The outcome was, roughly speaking, that pushing needles into yourself produces a signal in the brain. Good heavens! Who’d have thought it? Even George Lewith, normally an apologist for CAM, was critical.

    “The interpretation of the science in this particular programme was not good and was inappropriately sensationalised by the production team. I think all of us on the experiment felt like that.”

    “The experiment was not groundbreaking, its results were sensationalised and there was insufficient time to analyse the data properly and so draw any sound conclusions. It was oversold and over-interpreted. We were encouraged to over-interpret, and proper scientific qualifications that might suggest alternative interpretations of the data appear to have been edited out of the programme.”

    Edzard Ernst, professor of complementary medicine at Exeter University, and the main consultant for the series says:

    “The BBC decided to do disturbingly simple storylines with disturbingly happy endings. But none of these stories is as simple as they presented, nor do they have such happy endings. Even when the evidence was outright negative, they somehow bent over backwards to create another happy ending.
    “I feel that they abused me in a way. It was as if they had instructions from higher up that this had to be a happy story about complementary medicine without any complexity, and they used me to give a veneer of respectability.”

    The BBC, thus far, remain unapologetic

    “We take these allegations very seriously and we strongly refute them.We used two scientific consultants for the series, Prof Ernst and Dr Jack Tinker, dean emeritus of the Royal Society of Medicine, both of whom signed off the programme scripts.”

    This is the same Jack Tinker who, as Chairman of the Ethics Committee of the Dr Foster organisation, also approved their “COMPLEMENTARY therapists Guide 2004”, and the utterly uncritical complementary practioner directory. The ‘Dr Foster’ organisation is a commercial business that supplies "management information", "market research services", "marketing services" and "information for the public". Let’s hope their services in conventional health care are a bit more critical than their evaluation of CAM. Their “Guide to [CAM] therapies” repeats all the usual pseudo-scientific gobbledygook in a totally uncritical way.

    Singh’s article ended with some quotations from this site, concerning Sutherlandia and AIDS, with the remark made above, highlighted: "Comments about Aids were irresponsible and potentially dangerous".

  • Science accuses BBC of medical quackery

    Lois Rogers, in the Sunday Times for 26th March, reports on the same topic.

    “Ernst yesterday released the contents of a letter that he has written to Martin Wilson, the series producer, criticising him for promoting “US-style anti-science”.

    He said he felt “abused” by the programme makers: “It was as if they had instructions from higher up that this had to be a happy story about complementary medicine without any complexity, and they used me to give a veneer of respectability.”  “

    “This is no longer a fringe game played by new age people,” said Colquhoun. “It is beginning to erode intellectual standards at real universities.”

Later a letter appeared in defence of the programmes. Investigation showed that this letter had actually been written by the BBC and not all of the ‘signatories’ had seen it.This is dealt with in a separate post, Alternative Medicine series: dirty tricks at the BBC?