Comments from Keith Laws and Peter Kinderman re antipsychotics and CBT.
Kinderman: Throughout the report we were careful to say that different things help different people, and that (and I quote) âprofessionals need to acknowledge that the only way someone can find out for sure what helps them personally, is to try things outâ. The comment that people have taken objection to is this one: â⌠on average, people gain around as much benefit from CBT as they do from taking psychiatric medicationâ. I think this is a defensible statement. Of course itâs true that there has not been a series of direct RCT comparisons between antipsychotic medication and CBT; those comparisons have not been conducted (although perhaps they should be). That doesnât mean itâs appalling misrepresentation to say that the effectiveness appears about the same â it means that we have to synthesise other forms of data.
So the effect sizes of CBT for helping people with psychotic experiences in well-conducted meta-analyses of RCTs are modest, but clearly significant. My judgement is that the effect sizes are broadly comparable with the effect sizes reported for anti-psychotic medication.
This is an authoritative, consensual report, read and double-checked by many people, including many of the people speaking on Thursday. Some people disagree with the conclusions weâve drawn from published findings, and life would be dull if we all agreed. But honourable disagreements are the stuff of science. The available evidence-base include a wide range of meta-analyses (often using different statistical estimates of effect-sizes) of the effectiveness of a wide range of anti-psychotic medication. That converges on an effect-size for the acute and medium-term reduction of psychotic experiences of somewhere between 0.2 and 0.9 (using Hedgesâ g)(see http://bjp.rcpsych.org/content/198/4/247.full for one example, I canât offer a systematic review here for obvious reasons). Recent meta-analyses offer an effect-size for CBTp of maybe 0.33, with some people (in, for instance the recent Maudsley debate on this issue http://www.kcl.ac.uk/ioppn/news/maudsleydebates/debate-archive-31-50.aspx) converging on an average effect size for CBTp between 0.5 and 0.7. S
There has, itâs true, been no direct comparison, so we have to make reasonable judgements of the available literature and I, for one, stand by that statement. Itâs also worth noting that, in that judgment, issues of longer-term adverse effects should, I believe, be part of the consideration. And itâs worth noting that some people (at least) can benefit from CBT in the absence of anti-psychotic medication.
My judgement is that this particular statement does indeed reflect the available evidence, even if that evidence is limited.
Laws: A quick reply to the key claim that Peter Kinderman makes.
He states âThere has, itâs true, been no direct comparison, so we have to make reasonable judgements of the available literature and I, for one, stand by that statement.â
So letâs go with his suggestion of comparing effect sizes in separate meta-analyses for antipsychoitics and CBT
He argues that antipsychotics for the acute and medium-term produce a âreduction of psychotic experiences of somewhere between 0.2 and 0.9 (using Hedgesâ g)(see http://bjp.rcpsych.org/content/198/4/247.full for one example
And that âRecent meta-analyses offer an effect-size for CBTp of maybe 0.33, with some people (in, for instance the recent Maudsley debate on this issue http://www.kcl.ac.uk/ioppn/news/maudsleydebates/debate-archive-31-50.aspx) converging on an average effect size for CBTp between 0.5 and 0.7.â
Re the claim about antipsychotic effect sizes, Iâm not sure why he references the Farooq and Taylor editorial â its about clozapine and comparisons of clozapine vs antipsychotics â I also cannot locate the effect size range he quotes in that editorial.
Nevertheless, we can turn to the excellent recent meta analysis by Leucht et al looking at 15 antipsychotics (first and second generation) in blind placebo RCTs measuring total symptom scores http://www.ncbi.nlm.nih.gov/pubmedhealth/PMH0057475/
Data from 43, 049 participants showed that all drugs were significantly more effective than placebo. The standardised mean differences with 95% credible intervals were: clozapine 0â˘88, 0â˘73-1â˘03; amisulpride 0â˘66, 0â˘53-0â˘78; olanzapine 0â˘59, 0â˘53-0â˘65; risperidone 0â˘56, 0â˘50-0â˘63; paliperidone 0â˘50, 0â˘39-0â˘60; zotepine 0â˘49, 0â˘31-0â˘66; haloperidol 0â˘45, 0â˘39-0â˘51; quetiapine 0â˘44, 0â˘35-0â˘52; aripiprazole 0â˘43, 0â˘34-0â˘52; sertindole 0â˘39, 0â˘26-0â˘52; ziprasidone 0â˘39, 0â˘30-0â˘49; chlorpromazine 0â˘38, 0â˘23-0â˘54; asenapine 0â˘38, 0â˘25-0â˘51; lurasidone 0â˘33, 0â˘21-0â˘45; and iloperidone 0â˘33, 0â˘22-0â˘43.
So a range at lowest .33 to highest of .88 â all significantly better than placebo in blind trials
Lets turn now to CBT meta analyses â Of course, I could present just our own recent meta-analysis (Jauhar et al 2014), but here are 9 recent meta outcomes for total symptoms (which tend to be better than positive or negative separately in the case of CBT) where blind outcomes were assessed:
Zimmerman et al 05 0.37
Wykes et al 08 0.22
Lincoln et al 08 0.25
NICE 09 0.27
Lynch et al 10 0.08
Sarin et al 11 0.07
Newton-Howes 11 0.04
Jauhar et al 14 0.15
Turner et al 14 0.12
They average out at 0.17 â almost spot on with our meta analysis (Jauhar et al 2014)
And .17 clearly doesnât get anywhere near the effect sizes for even the poorest outcome antipsychotics
Just to finish the irony is not lost on me that the 0.33 for CBT that Peter Kinderman quotes is actually from my own meta analysis (Jauhar etal 2014) for all RCTs regardless of blindingâ which we know to be crucial, though he seems keen to ignore blinding for some reason (except when it comes to measuring drug effects). Notably the UPS document also ironically references the same paper of ours as evidence that CBT effects are comparable to drug effects
And last, his claim that a wide range of meta analyses converge âon an average effect size for CBTp between 0.5 and 0.7.â The reference he ascribes is to his colleague David Kingdon from the Maudsley Debate we had earlier in the yearâ In it you will see Kingdon says âMeta-analyses âhave consistently shown an effect size of around 0.3â which although is itself incorrect (as you can see above) is nowhere near the .5 to .7 ascribed
The bottom line is that when we go with Peter Kindermanâs suggested comparison, CBT effect size is nowhere near those for any antipsychotic and doesnât even approach the poorest performing antipsychotic.