The mainstream media eventually catch up with bloggers. BBC1 TV (Wales) produced an excellent TV programme that exposed the enormous degree validation scam run by the University of Wales. It also exposed the uselessness of the Quality Assurance Agency (QAA). Both these things have been written about repeatedly here for some years. It was good to see them getting wider publicity.
Watch the video of the programme (Part 1, and Part 2) "Week In Week Out – University Challenged." “The programme examines how pop stars and evangelical Christians are running colleges offering courses validated by the University of Wales.” (I make a brief appearance, talking about validation of degrees in Chinese Medicine).
In October 2008 I posted Another worthless validation: the University of Wales and nutritional therapy. With the help of the Freedom of Information Act, it was possible to reveal the mind-boggling incompetence of the validation process used by the University of Wales.
McTimoney College of Chiropractic
The Chiropractic “degrees” from the McTimoney College of Chiropractic are also validated by the University of Wales by an equally incompetent, or perhaps I should say bogus, procedure. More details can be found at The McTimoney Chiropractic Association would seem to believe that chiropractic is “bogus”, and in a later post, Not much Freedom of Information at University of Wales, University of Kingston, Robert Gordon University or Napier University.
Andy Lewis has also written about chiropractic in The University of Wales is Responsible for Enabling Bogus* Chiropractic Claims to be Made.
Sadly the BBC programme did not have much to say about these domestic courses, but otherwise it was excoriating. In particular it had extensive interviews with Nigel Palastanga, whose astonishing admission that courses were validated withour seeing what was taught on them was revealed here two years ago. After that revelation, the vice-chancellor of UoW, Marc Clement BSc PhD CEng CPhys FIET FInstP, promoted Palastanga to be pro-vice-chancellor in charge of Learning, Teaching and Enhancement (I know, you couldn’t make it up).
In the documentary Palastanga said
"It’s a major business. We earn a considerable amount of money."
That was obvious two years ago, but it’s good to hear it from the horse’s mouth.
After a section that revealed a bit about what goes on at two very fundamentalist bible colleges which gave University of Wales degrees, A. C. Grayling commented thus.
"They are there to train advocates for the biblical message and that is absolutely not, by a very very long chalk, what a university should be doing.. . . A respectable British Higher education institution like the University of Wales shouldn’t be touching them with a bargepole."
Undaunted, Palastanga responded
“That’s his opinion. I would say they are validated to the highest standards. They match what are called QAA benchmark. We have serious academics looking at them, and their academic standards are established at the very highest level.”
And if you believe that, you will truly believe anything.
You can download here one of many moderator’s reports obtained under the Freedom of Information Act. This one is for the BSc (Hons) Chiropractic. It is entirely typical of theuncritical boxticking approach to validation, Nowhere does it say "subluxation is nonsense", though even the GCC now admit that.
Traditional Chinese Medicine
The University of Wales validates several courses in what almost everyone but them classifies as quackery. As well as chiropractic and “nutritional therapy”, there is herbalism. For example a course at a college in Barcelona issues University of Wales degrees in Traditional Chinese medicine, a subject that is a menace to public health.. I was asked to comment on the course, and on a bag of herbs that the presenter had been sold to treat depression.
Radix Bupleuri Chinensis
Radix Angelicae Sinensis
Radix Paeoniae Lactiflorae
Rhizoma Atractylodis Macrocephalae
Sclerotium Poriae Cocos
Radix Glycyrrhizae Uralensis
Cortex Moutan Radicis (Paeonia Suffruticosa)
Fructus Gardeniae Jasminoidis
Herba Menthae Haplocalycis
Zingiber officinale rhizome-fresh
Ingredients of a custom mixture.
There is no good evidence that any of the ingredients help depression, in fact next to nothing is known about most of them, apart from liquorice and ginger. Swallowing them would be rather reckless. They fall right into the description of any herbal medicine, in the Patients’ Guide, "Herbal medicine: giving patients an unknown dose of an ill-defined drug, of unknown effectiveness and unknown safety. "
Of the degrees, I said
"There’s no evidence that it [the herbs] does you any good. It may be dangerous because you have no idea of the dose. Degrees in Chinese Medicine consist of three years spent memorising myths and pre-scientific, er, untruths. That isn’t a degree, it’s a travesty."
"We’ve had long debates in the Health Committee about where we would draw the line about what we validate. They have to demonstrate to us that there is some scientific basis for the practice, that there is an established curriculum, that there is an established safe practice."
The presenter asked him "So you are confident that Chinese medicine works? Palastanga replied
" I didn’t say that. I said that there is evidence that it does work . . We are trying to enforce these professions to undertake effective research."
That statement is simply not true, as shown by the response of the validation committee to the application for validation of the course in “Nutritional Therapy” at the Northern College of Acupuncture, documented previously. The fact of the matter is that the validation proceeded without looking at what was actually taught, and without even a detailed timetable of lectures. The committee looked only at the official documents presented to it and was totally negligent in failing to discover some of the bizarre beliefs of the people who were giving the course.
Palastanga went on to raise the usual straw man argument, about how little regular medicine is based on good evidence (though admittedly that is certainly true in his own field -he is a physiotherapist).
Fazley International College Kuala Lumpur
This business college in Kuala Lumpur offered University of Wales degrees. Its 32-year old president is a part time pop star with impressive looking qualifications
The presenter pointed out that
" His doctorate and his MBA were awarded in that citadel of education, Cambridge. Here he is, pictured at the city’s prestigious business school. He was there for all of four days and walked away with a doctorate. But the degree was not from the University of Cambridge, but from the now defunct "European Business School Cambridge". It never had the right to award degrees."
Neither the University of Wales nor the QAA had noticed this unfortunate fact. Once the TV team had done their job for them, the UoW withdrew support. though, as of 15 November 2010, that is not obvious from Fazley’s web site.
Mr (not Dr) Fazley seemed rather pleased about how students were attracted by the connection with the Prince of Wales. The fact that he is Chancellor of the University of Wales seems not inappropriate, given the amount of quackery they promote.
Quality Assurance Agency (QAA)
In 2007, I wrote, in Nature (see also here),
“Why don’t regulators prevent BSc degrees in anti-science? The Quality Assurance Agency for Higher Education (QAA) claims that “We safeguard and help to improve the academic standards and quality of higher education in the UK.” It costs taxpayers £11.5 million (US$22 million) annually. It is, of course, not unreasonable that governments should ask whether universities are doing a good job. But why has the QAA not noticed that some universities are awarding BSc degrees in subjects that are not, actually, science? The QAA report on the University of Westminster courses awards a perfect score for ‘curriculum design, content and organization,’ despite this content consisting largely of what I consider to be early-nineteenth-century myths, not science. It happens because the QAA judges courses only against the aims set by those who run the QAA, and if their aims are to propagate magic as science, that’s fine.”
That was illustrated perfectly in the documentary when Dr Stephen Jackson of the QAA appeared to try to justify the fact that the QAA had, like the University of Wales, failed entirely to spot any of the obvious problems. He had a nice dark suit, tie and poppy, but couldn’t disguise the fact that the QAA had given high ratings to some very dubious courses.
The QAA sent nine people to the other side of the globe, at a cost of £91,000. They could have done a lot better if they’d spent 10 minutes with Google at home.
Universities UK (UUK)
Needless to say, the Committee of Vice-Chancellors and Principals has said nothing at all. As usual, Laurie Taylor had it all worked out in Times Higher Education (4th November).
Speaking to our reporter Keith Ponting (30), he commended UUK’s decision to say absolutely nothing whatsoever about the abolition of all public funding for the arts and humanities.
He also praised UUK’s total silence on Lord Browne’s view that student courses should primarily be evaluated by their employment returns.
When pressed by Ponting for his overall view of UUK’s failure to respond in any way at all to any aspect of the Browne Review, he described it as “welcome evidence, in a world of change, of UUK’s consistent commitment over the years to ineffectual passivity”.
Meanwhile, a University of Wales video on YouTube
A couple of days later, a search of Google news for the “University of Wales” shows plenty of fallout. The vice-chancellor claims that ““The Minister’s attack came as a complete and total surprise to me”. That can’t be true. It is over two years since I told him what was going on, and if he was unaware of it, that is dereliction of duty. It is not the TV programme that brought the University into disrepute, it was the vice-chancellor.
It seems that validation committees often don’t look beyond the official documents. As a result, the validations may not be worth the paper they are written on. Try this one.
One of the best bits of news recently was the downfall of Matthias Rath. He’s the man who peddled vitamin pills for AIDS in Africa, and encouraged the AIDS denialists in the South African government. Thabo Mbeki and his Health Minister, Mrs Beetroot, have gone now, thank heavens.
Rath was one of the best illustrations of the murderous effect of selling ineffective treatments. The fact that nobody in the “nutritional therapy” industry has uttered a word of condemnation for this man illustrates better than anything one can imagine the corrupt state of “nutritional therapy”. The people who kept silent include the British Association of Nutritional Therapists (BANT).
It might be surprising, then, to find the Northern College of Acupuncture proudly adding a course in alternative nutrition to its courses in acupuncture (now known to be a theatrical placebo) and Chinese herbal medicine (largely untested and sometimes toxic). It might be even more surprising to find the boast that the course is validated by the University of Wales. It seemed a good idea to find out a bit more about how this came about. Thanks to the Freedom of Information Act, some interesting things can be discovered.
Polly Toynbee’s superb article, Quackery and superstition – available soon on the NHS, written in January 2008, mentioned diplomas and degrees in complementary therapies offered by, among others, the University of Wales. This elicited a letter of protest to Toynbee from the Vice-Chancellor of the University of Wales, Professor Marc Clement BSc, PhD, MInstP, CEng,CPhys,FIET. He invited her to visit the university to see their “validation and monitoring procedures (including the University’s very specific guidelines on health studies disciplines”.
So let’s take a look at these validation procedures and guidelines.
The validation process
The Northern College of Acupuncture submitted a 148 page proposal for the course in October 2007. The document has all the usual edu-bollocks jargon, but of course doesn’t say much about clinical trials, though it does boast about an unblinded trial of acupuncture published in 2006 which, because of lack of appropriate controls, served only to muddy the waters. : This submission was considered by the University’s validation committee last December.
The whole validation document is only four pages long [download it]. The most interesting thing about it is that the words ‘evidence’ or ‘critical’ do not occur in it a single time. It has all the usual bureaucratic jargon of such documents but misses entirely the central point.
Does that mean that the University of Wales doesn’t care about evidence or critical thinking? Well, not on paper. Two years previously a short document called Health Studies Guidelines had been written by Dr Brian Spriggs (Health Studies Validation Consultant, since retired) for the Health Studies Committee, and it was approved on 21 April 2005. It starts well.
“Degrees in the Health Studies field are expected to promote an understanding of the importance of the scientific method and an evidence-base to underpin therapeutic interventions and of research to expand that base.”
It even goes on to say that a BSc degree in homeopathy is “unacceptable”. Don’t get too excited though, because it also says that acupuncture and Chinese herbal stuff is quite OK. How anyone can imagine they live up to the opening sentence beats me. And it gets worse. It says that all sorts of rather advanced forms of battiness are OK if they form only part of another degree. They include Homeopathy, Crystal therapy. Dowsing, Iridology; Kinesiology, Radionics, Reflexology, Shiatsu, Healing, and Maharishi Ayurvedic Medicine.
Dowsing? Crystal therapy? Just let me remind you. We are living in 2008. It is easy to forget that when ploughing through all this new age junk.
The Validation Handbook of Quality Assurance: Health Studies (2007) runs to an astonishing 256 pages [download the whole thing]. On page 12 we find the extent of the problem.
“The University of Wales validates a number of schemes in the Health Studies field. At the current time we have undergraduate and/or postgraduate degree schemes in Acupuncture, Animal Manipulation, Chiropractic, Herbal Medicine, Integrative Psychotherapy, Osteopathy, Osteopathic Studies, Traditional Chinese Medicine and Regulatory Affairs, both in the UK and overseas.”
That sounds pretty shocking. Further down on page 12, though, we find this.
“Degrees in the Health Studies field are expected to promote an understanding of the importance of the scientific method and an evidence-base to underpin therapeutic interventions and of research to expand that base. The mission is to promote and require the critical evaluation of the practices, doctrines, beliefs, theories and hypotheses that underlie the taught therapeutic measures of the discipline.”
They are indeed fine words. The problem is that I can detect no sign in the submission, nor in its consideration by the validation committee, that any attempt whatsoever was made to ensure that the course complied with these requirements.
The only sign of concern I could detect of any concern about the quality of what was being taught came in a minute to a meeting of the Health Studies Committee meeting on 24th April 2008.
“Members received a copy of an article entitled Quackery and superstition available soon on the NHS which appeared in The Guardian newspaper in January 2008, and a copy of the Vice- Chancellors response. Members agreed that this article was now historical but felt that if/when the issue were to arise again; the key matter of scientific rigour should be stressed. The Committee agreed that this was the most critical element of all degree schemes in the University of Wales portfolio of health studies schemes. It was felt it would be timely to re-examine the schemes within the portfolio as well as the guidelines for consideration of Health Studies schemes at the next meeting. The Committee might also decide that Institutions would be required to include literature reviews (as part of their validation submission) to provide evidence for their particular profession/philosophy. It was agreed that the guidelines would be a vital document in the consideration of new schemes and during preliminary visits to prospective Institutions. “
The Press Office had passed Polly Toynbee’s article to them. Curiously the Health Studies Committee dismissed it as “historical”, simply because it was written three months earlier. That is presumably “historical” in the sense that the public will have forgotten about it, rather than in the sense that the facts of the matter have changed since January. So, at least for the nutrition degree, Toynbee’s comments were simply brushed under the carpet.
After a few cosmetic changes of wording the validation was completed on 16th January 2008. For example the word “diagnosis” was removed in 43 places and “rewritten in terms of evaluation and assessment”. There was, needless to say, no indication that the change in wording would change anything in what was taught to students.
You may think that I am being a bit too harsh. Perhaps the course is just fine after all? The problem is that the submission and the reaction of the validation committee tell you next to nothing about what actually matters, and that is what is taught. There is only a vague outline of that in the submission (and part of it was redacted on the grounds that if it were made public somebody might copy ;it. Heaven forbid).
That is why I have to say, yet again, that this sort of validation exercise is not worth the paper it’s written on.
How can we find out a bit more? Very easily as it happens. Just Google. What matters is not so much formal course outlines but who teaches them.
The nutrition course
The title of the course is just “Nutrition”, not ‘Nutritional Therapy’ or ‘Alternative Nutrition’. That sounds quite respectable but a glance at the prospectus shows immediately that it is full-blown alternative medicine.
Already in July 2007, the glowing press releases for the course had attracted attention from the wonderfully investigative web site HolfordWatch. I see no sign that the validation committee was aware of this. But if not, why not? I would describe is as dereliction of academic duty.
“This pioneering course is unique in that it is firmly rooted in both Western nutritional science and naturopathic medicine and also covers concepts of nutrition within traditional Chinese, Japanese, Tibetan and Ayurvedic medicine.
This means that graduates will gain comprehensive understanding of both modern scientific knowledge and ancient wisdom concerning nutrition and dietetics.”
Ancient wisdom, of course, means something that your are supposed to believe though there is no good reason to think it’s true. In the end, though, almost the only thing that really matters about any course is who is running it. The brochure shows that all of the people are heavily into every form of alternative nuttiness.
Course Director and Tutor: Jacqueline Young nutritionist, naturopath, clinical psychologist and Oriental medical practitioner
Elaine Aldred (qualified as a chiropractor with the Anglo European Chiropractic College, as an acupuncturist with the British College of Acupuncture and as a Western Medical Herbalist with the College of Phytotherapy. She recently also qualified in Chinese herbal medicine with the Northern College of Acupuncture.)
Sue Russell (3 year diploma in nutritional therapy at the Institute of Optimum Nutrition. She currently practises as a nutritional therapist and also works part-time as a manager at the Northern College of Homeopathic Medicine.)
Anuradha Sharma (graduated as a dietician from Leeds Metropolitan University in 2002 and subsequently completed a Naturopathy certificate and a post-graduate diploma in acupuncture).
Guest Lecturers include : Dr John Briffa, Professor Jane Plant, M.B.E. (a geochemist turned quack), and, most revealingly, none other than the UK’s most notorious media celebrity and pill peddler, Patrick Holford.
So much has been written about Holford’s appalling abuse of science, one would have thought that not even a validation committee could have missed it.
“The course has been created by Jacqueline Young“, so let’s look a bit further at her track record.
Jacqueline Young has written a book, ‘Complementary Medicine for Dummies’ [Ed: ahem shouldn’t that be Dummies for Complementary Medicine?]. You can see parts of it on Google Books. Did the validation committee bother to look at it? As far as I can tell, the words ‘randomised’ or ‘clinical trial’ occur nowhere in the book.
The chapter on Tibetan medicine is not very helpful when it comes to evidence but for research we are referred to the Tibetan Medical and Astrology Institute. Guess what? That site gives no evidence either. So far not a single university has endorsed Astrology (there is a profitable niche there for some vice-chancellor).
Here are few samples from the book. The advice seems to vary from the undocumented optimism of this
Well researched? No. Safe? Nobody knows. Or this
Mandarin peel prevents colds and flu? Old wive’s tale. Then there are things that verge on the weird, like this one
or the deeply bizarre like this
The problem of Jacqueline Young’s fantasy approach to facts was pointed out at least as far back as 2004, by Ray Girvan., who wrote about it again in May 2005. The problems were brought to wider attention when Ben Goldacre wrote two articles in his Badscience column, Imploding Researchers (September 2005), and the following week, Tangled Webs.
“we were pondering the ethics and wisdom of Jacqueline Young dishing out preposterous, made-up, pseudoscientific nonsense as if it was authoritative BBC fact, with phrases such as: “Implosion researchers have found that if water is put through a spiral its electrical field changes and it then appears to have a potent, restorative effect on cells.” “
“Take this from her article on cranial osteopathy, riddled with half truths: “Sutherland found that the cranial bones (the skull bones encasing the brain) weren’t fused in adulthood, as was widely believed, but actually had a cycle of slight involuntary movement.” In fact the cranial bones do fuse in adulthood.
She goes on: “This movement was influenced by the rhythmic flow of cerebrospinal fluid (the nourishing and protective fluid that circulates through the spinal canal and brain) and could become blocked.” There have now been five studies on whether “cranial osteopaths” can indeed feel these movements, as they claim, and it’s an easy experiment to do: ask a couple of cranial osteopaths to write down the frequency of the rhythmic pulses on the same person’s skull, and see if they give the same answer. They don’t. A rather crucial well-replicated finding to leave out of your story.
That was in 2005 and since then all of Young’s “preposterous, made-up, pseudoscientific nonsense” (along with most of the other stuff about junk medicine) has vanished from the BBC’s web site, after some people with a bit of common sense pointed out what nonsense it was. But now we see them resurfacing in a course validated by a serious university. The BBC had some excuse (after all, it is run largely by arts graduates). I can see no excuses for the University of Wales.
Incidentally, thanks to web archive you can still read Young’s nonsense, long after the BBC removed it. Here is a quotation.
“Implosion researchers have found that if water is put through a spiral its ,field changes and it then appears to have a potent, restorative effect on cells. In one study, seedlings watered with spiralised water grew significantly faster, higher and stronger than those given ordinary water.”
The vice-chancellor of the University of Wales, Marc Clement, is a physicist (Department of Electrical and Electronic Engineering), so can he perhaps explain the meaning of this?
Selection committees for jobs (especially senior jobs) and validation committees for courses, might make fewer mistakes if they didn’t rely so much on formal documents and did a little more investigation themselves. That sort of thing is why the managerial culture not only takes a lot more time, but also gives a worse result.
It would have taken 10 minutes with Google to find out about Young’s track record, but they didn’t bother. As a result they have spent a long time producing a validation that isn’t worth the paper it’s written on. That makes the University of Wales a bit of a laughing stock. Worse still, it brings science itself into disrepute.
What does the University of Wales say? So far, nothing. Last week I sent brief and polite emails to Professor Palastanga and to Professor Clement to try to discover whether it is true that the validation process had indeed missed the fact that the course organiser’s writings had been described as “preposterous, made-up, pseudoscientific nonsense” in the Guardian.
So far I have had no reply from the vice-chancellor, but on .26 October I did get an answer from Prof Palastaga.
|As regards the two people you asked questions about – J.Young – I personally am not familiar with her book and nobody on the validation panel raised any concerns about it. As for P.Holford similarly there were no concerns expressed about him or his work. In both cases we would have considered their CV’s as presented in the documentation as part of the teaching team. In my experience of conducting degree validations at over 16 UK Universities this is the normal practice of a validation panel.|
I have to say this reply confirms my worst fears. Validation committees such as this one simply don’t do their duty. They don’t show the curiosity that is needed to discover the facts about the things that they are meant to be judging. How could they not have looked at the book by the very person that they are validating? After all that has been written about Patrick Holford, it is simply mind-boggling that the committee seems to have been quite unaware of any of it.
It is yet another example of the harm done to science by an unthinking, box-ticking approach.
Pharmacology. A Handbook for Complementary Healthcare Professionals
Elsevier were kind enough to send me an inspection copy of this book, which is written by one of the nutrition course tutors, Elaine Aldred. She admits that pharmacology is “considered by most students to be nothing more that a ‘hoop-jumping’ exercise in the process of becoming qualified”. She also says. disarmingly. that “I was certainly not the most adept scientist at school and found my university course a trial”.
The book has all the feel of a cut and paste job. It is mostly very simple (if not simplistic). though for no obvious reason it starts with a long (and very amateur) discussion of chemical bonding Then molecules are admitted to be indivisible (but, guess what, the subject of homeopathy is avoided). There is a very short section on ion channels, though, bizarrely, it appears under the heading “How do drugs get into cells?”. Since the author is clearly not able to make the distinction between volts and coulombs, the discussion is more likely to confuse the reader than to help.
Then a long section on plants. It starts of by asserting that “approximately a quarter of prescription drugs contain at least one chemical that was originally isolated and extracted from a plant”.. This cannot be even remotely correct. There are vast tables showing complicated chemical structures, but the usual inadequate
list of their alleged actions This is followed by a quick gallop through some classes of conventional drugs, illustrated again mainly by chemical structures not data. Hormone replacement therapy is mentioned, but the chance to point out that it is one of the best illustrations of the need for RCTs is missed.
The one thing that one would really like to see in such a book is a good account of how you tell whether or not a drug works in man. This is relegated to five pages at the end of the book, and it is, frankly, pathetic. It
is utterly uncritical in the one area that matters more than any other for people who purport to treat patients. All you get is a list of unexplained bullet points.
If this book is the source of the “scientific content” of the nutrition course, things are as bad as we feared.