JAMA Psychiatry Suicide Article, Statistics and AI

Suicide Rates - Selected OECD Countries

Suicide is a very important problem for psychiatrists.  Even though it is a rare event, it seems like most of our time is focused on preventing suicide.  There are many days where many high risk patients and patients with chronic suicidal ideation are seen in clinics and hospitals.  Most of them are treated in outpatient settings and very few are treated on an involuntary basis in hospital settings.  Since suicide is diametrically opposed to self preservation it is assumed that any rational person would want to get help with those thoughts and impulses.  Like most things in psychiatric practice it is almost never than simple.  Psychiatrists encounter a wide range of of reasons for suicidal thinking.  At times, the suicidal thinking was not obvious until it was declared after a suicide attempt.  Many people decide to see psychiatrists after a first suicide attempt.  Even at that point it is common to find a person who is disappointed that they did not succeed.  It is more common to find a person greatly relieved that they survived but even then that does not assure the cooperation necessary to prevent another attempt.

The standard of practice for assessing suicidal thinking or ideation and potential risk is risk factor analysis.  This has been the standard of practice for as long as I have practiced over the past 30 years.  To do this analysis, it requires making a diagnosis or a series of diagnoses and looking at associated factors and how the patient describes his/her mental state at the time.  Major psychiatric diagnoses like major depression, schizophrenia, bipolar disorder, panic disorder, borderline personality disorder and chronic substance use disorders all have significant lifetime prevalences of suicide varying from 3 to 15%.  Psychological autopsies of series of suicides find that nearly all of the patients who have suicided in these studies had a significant psychiatric disorder.  There are also studies done from a social science perspective that emphasize the social risk factors for suicide including sex, martial and relationship status, economic factors and loss.

Suicide is a widely misunderstood problem sometimes even for the patients who are experiencing the thoughts.  It is common for example to encounter people with suicidal thinking who say that their only deterrent to suicide is that they don't "have the guts" to do it.  An associated worry might be that it is "too painful."  They feel a need to explain why they cannot carry out an irrational act.  I take this to mean that at some point in time, the suicidal person's conscious state has changed.  They are no longer a rational person and that is why they must explain away the fact that they cannot carry out an irrational act.  Another common observation that speaks to the conscious state is that many people will say "I never understood how a person could be suicidal until I finally felt that way."  That suggests that the altered conscious state is associated with a mood state of depression or many times a mixture of depression, anger, and anxiety resulting in an agitated state that led to the understanding about suicidal thoughts.  A final observation is one of the most stressful parts of psychiatric practice and that is:  "Can I believe this person when they tell me they are not going to kill themselves?"  Much of acute care psychiatry hinges on that ultimate question.  The risk factor analysis is essentially nullified if the patient is in an emergency department and their diagnosis and past suicide attempts are known.  The only thing left to go on are the standard questions about current state of mind, deterrents, safety plans and whether the person seems reliable and says they will not kill themselves.   It is widely known that people kill themselves after leaving emergency departments and hospitals.  People have killed themselves in hospitals while under direct observation.

Many of these assessments become adversarial.  By the time a psychiatrist sees a patient in a hospital, a lot has already happened. In all of the hospitals where I have practiced, crisis teams, paramedics, and the police have assessed the person in the community and brought them in to the hospital.  Very few people were under psychiatric care at the time of that intervention.  Friends and family members of the patient were the people who called the first responders.  The patient is usually there out of some concern for their welfare that they may not be aware of.  The psychiatrist comes around sometime in the next 24 hours and the interaction unfolds.  Very few people seem interested in the fact that they might kill themselves.  Getting out of the hospital may be the priority.  Their approach might be one of non-disclosure or denial: "I really did not say I was suicidal." or "I did not mean it",  or "I was drunk or high at the time".  Even those responses can vary from very unlikely (as in a patient with a serious self inflicted gunshot wound) to unlikely (a patient with delusional depression stopped in the midst or a suicide attempt) to possible (the intoxication history with no suicidal ideation while sober).  The interview dynamic is also quite variable.  A person may be sullen, irritated, and not wanting to discuss much information.  They may express concerns about self incrimination: "I know what I can and cannot say to psychiatrists.  I know if I say the wrong thing you will lock me up and throw away the key."  They may blame their problems on the psychiatrist: "Look - I know you don't care about me.  The only thing you care about is covering your ass.  You are going to do whatever you want to do."  They may be more hostile and sarcastic: "Look if I was really going to kill myself I wouldn't be sitting here talking to you.  I'd be dead.  I wouldn't be talking about it."

All of these statements ignore the fact that the person is sitting in front of the psychiatrist as the result of the actions of several other people including persons affiliated with them and having their best interests at heart.  That situation is so intense and uncomfortable that it prevents physicians from going into psychiatry.  I  have had many physicians tell me they could not go into psychiatry because:  "Guessing about whether or not a person will kill themselves is too stressful."  There are many ways to reduce the guesswork involved but the point I am trying to make here is that all of these behaviors are consistent with the patient having undergone a change in their conscious state.  They are no longer acting like a person interested in self preservation, but they are now a person who is contemplating self destruction and taking active measures to hide that thought pattern.  That is the main reason why psychiatrists can't predict suicide over long periods of time with any degree of certainty.  When a person's conscious state changes that completely, their actions are less predictable even to the point that they may be potentially self destructive and want to cover it up.

That is also why risk factor analysis is so imperfect.  In the case of the diagnosis, a lot of clinicians are under the impression that if a person satisfies some written criteria for a diagnosis that provides a lot of critical information about the potential for suicide.  Many clinicians seem to miss the point that a patient can have the exact same written criteria for major depression with psychotic features and the same chronic markers on a suicide risk assessment and suddenly be much more likely to attempt suicide.  The only thing that has changed has been the patient's conscious state and their awareness that suicide is an unwanted state.  The evidence that this happens is clinical and ample.  Patients will report back to their psychiatrists that they were in this conscious state and the psychiatrist did or did not miss it.  Either way, there is no clinician in this situation who could make the correct call.  Without any clear markers, there is no way to figure out if this change in conscious state has occurred.  The patient usually recognizes it only in retrospect.

This clinical information on the assessment of suicide is what makes this JAMA Psychiatry article interesting.  In this article the authors attempt to determine predictors of suicide by soldiers in the year following psychiatric hospitalization within the Veteran's Administration hospital system over a 6 year period.  That was a total of 40,820 hospitalizations or 0.9% of the total Army personnel in any 12 month period.  During that time there were a total of 68 deaths by suicide.  That is number is 12% of all US Army suicides.  The authors consider a long list of potential risk factors that are largely demographic in nature to determine concentration of risk of suicide.  That list includes a law enforcement data base that clinicians do not have access to.  Their overall goal was to determine of it was practical identify high risk patients for post hospitalization intervention and whether that might be a cost effective way to prevent suicide.  They were able to identify the highest risk group - the 5% of hospitalizations in which 52.9% of the suicides occurred.  Like many similar studies the authors also comment on  how their "actuarial" methods usually trump clinicians making the same predictions.  I found very limited commentary on that fact that it is generally possible to illustrate what you want with enough variables or as we used to say "a large enough spreadsheet".  In this case they looked at a large number of variables to come up with 421 predictors for further analysis.  I have reviewed hospital records consisting of the printout of the electronic health record where there were scarcely 421 words and it was usually impossible to determine an admission or discharge date.  Any information on even a short term assessment of suicide risk is scant and it frequently says basically that the patient told us he or she was not going to make a suicide attempt.  In some cases a rating scale approach like the Columbia is used.  Clinicians using these scales are often surprised about how few variables change after the initial rating and how the numerical risk does not necessarily reflect an inpatient versus and outpatient population.

As I read through the article, I was also impressed with the amount of alien statistics and fairly esoteric statistical terms.  If JAMA Psychiatry wants to include these methods, I think an example of the calculations and a bibliography of additional reading would be a minimal requirement.  The addition of statistical reviewers' comments or an independent statistical discussion of the pros and cons of these methods would only enhance the quality of the discussion.  One of my concerns is that as the statistical methods get more abstract and vague notions about big data are more accepted, clinical complexity and wisdom are completely diluted down and out.  I saw a headline the other day that Internet sellers know more about your "personality" than your spouse.  It should be fairly obvious from all of the healthcare research done that is based on HEDIS (The Healthcare Effectiveness Data and Information Set) information, that demographic variables and product choices are not the same thing as clinical assessment and treatment.

If the headlines about artificial intelligence replacing doctors ever comes true, it will only happen if the machine can implement the required knowledge.  The performance of computers sifting through text based findings and diagnostic criteria has been know for 20 years (reference 3).   Those data points were generally far superior to demographics.  I owned 2 of those programs and they don't bother to sell them anymore.  In terms of the assessment and treatment of suicide a knowledge base included in the Harvard  Medical School Guide To Suicide Assessment and Intervention might be a step in the right direction.  A lot of that knowledge depends on the skill of a particular clinician and that includes the personality factors of clinicians who continue to do this impossible job day after day.      

Trying to predict suicide and prevent it can't currently be done with an algorithm.  If I see an algorithm I will consider why the high risk people aren't being seen in follow up from the hospital rather than who should get an intervention.   And I would not mind errors on the false positive side.


George Dawson, MD, DFAPA

1:  Kessler RC, Warner CH, Ivany C, Petukhova MV, Rose S, Bromet EJ, Brown M 3rd, Cai T, Colpe LJ, Cox KL, Fullerton CS, Gilman SE, Gruber MJ, Heeringa SG, Lewandowski-Romps L, Li J, Millikan-Bell AM, Naifeh JA, Nock MK, Rosellini AJ, Sampson NA, Schoenbaum M, Stein MB, Wessely S, Zaslavsky AM, Ursano RJ; Army STARRS Collaborators. Predicting Suicides After Psychiatric Hospitalization in US Army Soldiers: The Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). JAMA Psychiatry. 2015 Jan 1;72(1):49-57. doi: 10.1001/jamapsychiatry.2014.1754. PubMed PMID: 25390793.

2:  Douglas G. Jacobs, editor.  Harvard  Medical School Guide To Suicide Assessment and Intervention.  Jossey-Bass Inc., San Francisco, CA, 1998.

3:  Berner ES, Webster GD, Shugerman AA, Jackson JR, Algina J, Baker AL, Ball EV,Cobbs CG, Dennis VW, Frenkel EP, et al. Performance of four computer-based diagnostic systems. N Engl J Med. 1994 Jun 23;330(25):1792-6. PubMed PMID: 8190157.