I critiqued a paper that purported to show that Diagnostic and Statistical Manual criteria produce an impossibly large number of possible combinations and that this somehow invalidates their use. As a refresher, combinations are basically any pool of n elements combined k at a time. For example, in the case of major depression, the diagnosis requires at least 5 (k ≥ 5) of 9 (n=9) elements. That would lead to a calculation of C(n,k) = C(9,5) + C(9,6) + C(9,7) + C(9,8) + C(9,9) or 126 + 84 +36 + 8 + 1 = 255 I have illustrated the total combinations for the first expression at the top of this post. In each case the elements 1 – 9 are the DSM diagnostic criteria for depression. Note that adhering to the diagnostic criteria eliminates the last column of combinations to the far right since elements 1, 2, or 1 and 2 are required for the diagnosis.
Reading the actual diagnostic criteria illustrates that this
is a crude measure because there are implicit unknowns – most significantly the
total number of medical unknowns suggested by the criteria “The episode is not
attributable to the physiological effects of a substance or to another medical
disorder.” Historically reviews of those disorders suggest that they are in the
200 to 300 range with some being far more common than others. If all those
conditions were included in the combinatoric expression it would be very large
– but not necessarily that much more inclusive because of the low frequency of
many conditions. Additional exclusion
criteria include psychiatric disorders with depressed mood as a feature and any
previous episodes of mania. Since they
are exclusion criteria – it is reasonable to say that there may be only 255
combinations of rule in symptoms, but being able to make the calculation is no
assurance that they exist in practice.
Following the authors assumption about the combinatoric
possibilities we can substitute short had for criteria 1-9. In the following manner (as noted in their
Table 1):
1. Depressed Mood
2. Loss of Interest or Pleasure
3. Appetite/Weight Disturbance
4. Sleep Disturbance
5. Psychomotor Change
6. Loss of Energy
7. Worthlessness/Excessive Guilt
8. Concentration/Indecision
9. Death/Suicidal Thoughts
A further restriction is included in criteria A: “…at
least one of the symptoms is either (1) depressed mood or (2) loss of interest
or pleasure.” That eliminates any
combination that does not include 1, 2, or 1 and 2. That changes the above expression to 105 + 77
+ 35 + 9 + 1 = 227 possible combinations just based on the numbers. The authors were interested in seeing how
many of these possible combinations exist in the clinic and that was the goal
of this paper.
The sample for the paper was 1,566 subjects with a diagnosis
of major depression out of a total sample of 3,800 evaluations. All subjects were being seen on a clinical
basis and the Structured Clinical Interview for DSM-IV (SCID) was administered
by trained examiners and the interrater reliability was sampled and posted for
all of the depressive symptoms. The
number of subjects in each group of combinations was determined and the results
were interesting.
For starters – 57 of the 227 combinations or about 1/4 did
not occur in a single patient. In the case of 5, 6, and 7 criteria the
combinations that did not occur are listed in tables 3, 4, and 5. The most common combination was all nine
criteria and that occurred in 10% of the sample (N=157). The authors were able to observe that 9
combinations from the 9,8,7, and 6 criteria categories accounted for 40% of all
diagnoses. They suggest that these might be prototypical combinations in a
field of diagnostic heterogeneity. Apart from diagnostic prototypes the authors
suggest that it may facilitate the search for biological markers but they
conceded that those would need to be very large and expensive studies.
As I thought about that proposition, a few things came to mind. First, Mayo Clinic multi-omics studies. Some of these studies have already identified biomarkers and possible genetic markers on heterogenous groups of subjects with major depression. The subjects were all administered standardized DSM based interviews and the combinatorics could be determined. This would be an efficient way to see if symptom combinatorics match the biomarkers. Second, why would we expect there to be any correlation between symptoms and biomarkers? Most medical illnesses would not have a correlation and in fact the more complex illness can be expected to produce significant non-specific symptoms like fatigue and malaise. Some authors have suggested that very specific subtypes of depression are more likely to produce reliable biomarkers. Taylor and Fink (2) have written extensively about melancholia and biomarkers associated with that illness. I also recall work done by Linkowski and Mendlewicz (3) that they published in the endocrine literature. Their work was almost exclusively on subjects with very severe forms of depression (HAMD ratings > 30) and their neuroendocrine biomarkers were more robust. Third, is there a time domain consideration with the combinatoric groups? For example, do the people meeting 8 or 9 criteria have depression that has persisted for a longer period and does attempted treatment or not treatment affect that group? Fourth are some of these symptoms complexes generated by others - are they secondary to sleep and appetite disruption?
Either way, the application of combinatorics to some of
these situations is very interesting in the field. As noted in my previous post, combinatorics
reflects biological scaling at some point. That occurs at the molecular as well
as the evolutionary level. Large numbers
of combinations should be expected when combining either molecular
components of organisms, metabolic networks, or the organism wide effect.
Thinking about these combinations clinically is also an interesting
exercise. During my tenure as an acute
care psychiatrist it was rare to see anyone without most of the symptoms in an
inpatient setting. Doing consults on
medical and surgery wards there were often more novel symptom
combinations. Looking at the author’s
tables and the combinations they did not see in their study is an interesting
exercise. One example would be the
combination 1,2,3,4,5,7,9 from Table 3.
That would be a person with depressive symptoms except for loss of energy
and concentration problems. According to this study that person does not exist.
And of course all of the combinations
that lack depressed mood, anhedonia, or that combination have been eliminated
by definition.
I hope to expand my look at combinatorics to the genetic, evolutionary,
and molecular levels in subsequent posts as well as trying to see if there are
mappings from one level to the other. I am also interested in any books or papers that use similar analyses so please send those references my way,
George Dawson, MD, DFAPA
References:
1: Zimmerman M,
Ellison W, Young D, Chelminski I, Dalrymple K. How many different ways do
patients meet the diagnostic criteria for major depressive disorder? Compr
Psychiatry. 2015 Jan;56:29-34. doi: 10.1016/j.comppsych.2014.09.007. Epub 2014
Sep 6. PMID: 25266848.
2: Taylor MA, Fink
M. Melancholia: The Diagnosis,
Pathophysiology, and Treatment of Depressive Illness. 544 pp. New York,
Cambridge University Press, 2006.
3: Linkowski P,
Mendlewicz J, Kerkhofs M, Leclercq R, Golstein J, Brasseur M, Copinschi G, Cuater
EV. 24-hour profiles of adrenocorticotropin, cortisol, and growth hormone in
major depressive illness: effect of antidepressant treatment. The Journal of
Clinical Endocrinology & Metabolism. 1987 Jul 1;65(1):141-52.
Apps:
Very good apps are available for calculating combinations,
permutations, and the varieties. For
example – if you think back to your probability and statistics course in
college at one point the professor was talking about combinations occurring
where elements could be used more than once (with repetition). That is
typically demonstrated by taking numbered balls out of a container and
replacing them in one situation and in the other cases leaving them out. Those
are different calculations. For the
above calculations the assumption is that each k element can only be
used once (no repetition). There are
apps that give you both calculations.
I found that what are called the "3 P's" (described in the instructions on administering the SCID exam) were much better at clinically distinguishing major depression from dysthymia than which combinations of symptoms a patient had: pervasiveness (all the symptoms present at the same time and nearly omnipresent), persistence (the duration criteria), and pathological - the mood state and reactiveness had to be qualitatively and clearly different from the patient's baseline mood reactiveness such as when they were in the middle of a stressful environmental event like being dumped by a lover.
ReplyDeleteThe "P" I use is "phasic" but it essentially means the same thing. That is a distinctive continuous depressed mood without the reactive quality. I have seen too many people with adjustment disorders misdiagnosed with depression. The good news was that I could taper them off of antidepressants. Interestingly melancholia - is described using those same characteristics by some - but it has more severity. In the popular press there are stories about high functioning depression where people don't seem to be depressed to most people they encounter over the course of the day. The people I saw with that presentation tended to be dysthymic.
DeleteIt looks to me like a lot of the more recent studies on antidepressants fail to make this distinction with their subjects, leading to the conclusion that anti-depressants "don't work" and that more expensive (and more toxic and far less effective) anti-psychotics should be used in their place. Of course, these results give the anti-psychiatry groups ammunition to make their ridiculous case that many psychiatric conditions such as MDD are figments of the psychiatry profession's imagination.
DeleteWorse than that - most depression studies these days use phenotypes that are easily determined by a rating scale. The patient is not seen by a psychiatrist. And to think I was skeptical of days of lay administered DIS interviews!
Delete