Showing posts sorted by relevance for query rosenhan. Sort by date Show all posts
Showing posts sorted by relevance for query rosenhan. Sort by date Show all posts

Sunday, October 11, 2020

Book Review of The Great Pretender by Susannah Cahalan

 



 This is the second book review of this book on my blog.  I was asked by the editor of The Philosophy Special Interest Group of the Royal College of Psychiatrists - Dr. Abdi Sanati to write another review for this newsletter.  I looked at it as an opportunity to cover some things I may have missed in the first review.  I agreed to not put it on my blog until the newsletter came out.  The latest review follows:

The Great Pretender (1) is written as an exposé of a famous experiment conducted by Rosenhan (2) that purported to discredit psychiatric diagnoses.  The original article was published in in the journal Science in 1973.  Whether you we aware of the original article or not depended on when you were trained and the extent to which you followed that literature. I was just finishing my undergraduate degree at that point and did not complete psychiatric training until 1986.  We had a community psychiatry seminar for 6 months during my last year that was taught by some of the innovators in the field.  It was common to analyze and discuss controversial papers of the day.  A good example would have been the paper that suggested that people with schizophrenia had a much better outcome in the developing countries (3).  At no point did we hear about or discuss the Rosenhan paper.  In fact, for the next 24 years the paper never came across my desk. It was only when I started writing a psychiatry blog that I realized it played a major role in psychiatric criticism and antipsychiatry rhetoric.  At that point, I read the paper and the associated criticism and concluded independently that the methodology was extremely weak and that pseudopatients were not really a good test of medical or psychiatric diagnoses.  I thought it would just fade away on that basis.

I was as surprised as anyone when I heard that investigative reporter Susannah Cahalan had written a book about this experiment, the author, and the methods used.  The investigation begins with a visit to one of Rosenhan’s former colleagues. This colleague shows her a stack of anti-psychiatry books that he thinks “were the key to his thinking”. There is also a file labeled “pseudopatients” that contain the names of all eight pseudopatients and details surrounding their hospitalizations. All the names or aliases and the hospital names had also been changed.

Cahalan’s approach is to write about three parallel subjects.  The most thorough and objective analysis is about the pseudopatient experiment. She covers everything from the available remaining data and the problems with it to the likelihood that the experiment actually occurred the way it was described in the Science paper.  The second broad subject was a character study of Rosenhan.  How did people describe him?  What was he like? Did people especially his colleagues believe that he conducted the experiment.  And finally, the book is a vehicle for Cahalan to comment on psychiatry.  She comes to this work with the direct experience of having experienced autoimmune encephalitis and writing about that experience in the book Brain on Fire.

Reading the original paper is a good starting point for understanding the book.  If you do pull up that article, a few details are immediately evident. The author begins the introduction using the terms “sane” and “insane” as though this is technical language used by psychiatrists. That use of language is interesting because he is listed as a professor of both psychology and law at Stanford.  Since the days of my training, insanity is a strictly legal term and it is without meaning in psychiatry.  The use of these legal terms allows him to point out the unreliability of the “sane”-“insane” dichotomy based on expert witnesses disagreeing in adversarial court hearings.  That has nothing to do with the clinical diagnoses in psychiatry. To what extent were formal diagnoses used in 1973? Rosenhan refers to the Diagnostic and Statistical Manual in the body of his paper.  Interestingly, the authors of my community psychiatry paper (3) reported on the 2-year follow-up of patients from the International Pilot Study of Schizophrenia (1973) and concluded that schizophrenia could be reliably diagnosed so that international comparisons and follow up were possible.  A sanity metric during the same time frame is crude by comparison. There are many additional examples of a lack of objectivity toward the issue of psychiatric diagnosis in the introductory section of the paper (paragraphs 4-7) and the discussion. Excellent critiques of the scientific merit of the paper were available at the time most notably by Robert Spitzer. 

The author describes his pseudopatient experiment as consisting of 8 people – three women and four men of various occupations. Cahalan identifies Rosenhan as pseudopatient number 1.  Twelve hospitals in various locations were chosen.  One was a private hospital.  Pseudopatients were supposed to call the hospital, present for an intake appointment, and then complain that they were hearing voices. When asked to elaborate they were supposed to say the voices were unclear except for the words “empty”, “hollow”, and “thud”.  Rosenhan provides a rationalization for this symptom choice about how on the one hand these symptoms were supposed to have existential meaning and yet there was not a single report of existential psychosis in the literature. Once admitted, the patient was supposed to cease simulating any symptoms and give their actual social history and behave “normally”. They were to take notes and be as cooperative as possible to get discharged. The length of stay was 7-52 days with an average of 19 days. 

Rosenhan also claims in the body of this paper that a second experiment occurred at a “research and teaching hospital” where the staff were informed ahead of time that pseudopatients were going to seek admission during a 3-month period.  Staff were asked to rate whether a patient was a pseudopatient or not.  Of 193 admissions during that time 41 were ranked as likely being a pseudopatient. In this case, Rosenhan did not send any pseudopatients to the facility and claims this false experiment represents “massive errors”.  

One of the elements of the paper that is really never discussed is it structure. The primary data points were eight pseudopatients were admitted and discharged from psychiatric hospitals without being discovered. The secondary data points were a series of observations of the staff that is largely unstructured, highly anecdotal, and contrasted with other situations that seem to lack relevance. The bulk of Rosenhan’s discussion is judgmental and there is no discussion of the limitations of the experimental design or data. Instead the author leaps to clear-cut conclusions that are in some cases only peripherally connected to the data.

Cahalan expends a lot of effort to try to identify and find the pseudopatients and ask them what their experience was like. She locates the records of Rosenhan’s own admission as a pseudopatient. The first real sign of a departure from the research protocol described in Science, occurs in Rosenhan’s recorded admission interview. He recited the voices script and said the symptoms had been going on for four months. He was admitted on an involuntary commitment and discharged nine days later. The hospitalization ended in 1969 - four years before the article came out. The first major sign that the experiment described in Science was not quite the way it was described in the paper occurs when Cahalan looks at the record of the admission interview. In addition to the vague description of hallucinations, Rosenhan states that he believes he can “hear what people are thinking”, that he has tried to “insulate out the noises by putting copper over my ears”, and that he has “suicidal thoughts”. These are all more serious psychiatric symptoms than factitious “existential hallucinations”. Rosenhan also altered his occupational history during one assessment to say that his psychiatric illness led him to give up a job in economics 10 years earlier. At one point he stated that his wife is probably unaware of how useless he felt and that “everyone would be better off if he was not around”.  Considering the seriousness of his fake history, I was surprised that he was discharged in 9 days.

What about the other 8 pseudopatients?  Cahalan was able to locate two – only one of whom was part of the research protocol and shared Rosenhan’s experience. The second patient started out as a psychologist and co-authored a couple of papers with Rosenhan. The author was surprised at how little preparation went into the pseudopatient role. Patient 2 was taught to cheek medications and spit them out. He was reassured by Rosenhan that he had filed a writ of habeus corpus to get him out of the hospital at any time.  When Cahalan tracked down that attorney who said the writs had been discussed but never prepared and that he did not consider himself to be “on call” to get pseudopatients immediately released. Patient 2 was also in the hospital for 9 days and basically released upon his request.  There was no reason for discharge given on the official form but he recalled a psychiatrist approaching him prior to discharge and making remarks to suggest that there was still some concern that he may still be suicidal. Despite that concern there was apparently no discharge plan.

The third pseudopatient discovered by Cahalan was interesting in that he was eliminated from the original protocol and not counted by Rosenhan.  Cahalan discovered that the ninth uncounted pseudopatient was a research psychologist named Harry Lando.  Dr. Lando is well represented in the smoking cessation literature and had published an article in the Professional Psychologist (4) stressing the positive aspects of his pseudopatient experience.  His observations were in direct contrast to Rosenhan and he states as much in the observation: “My overall impressions of the hospital are overwhelmingly positive. The powerlessness and depersonalization of patients so strongly emphasized by Rosenhan simply did not exist in this setting.” He goes on to suggest that using better hospitals as models may be a way to improve the quality of care.  He also questions the ethics of placing pseudopatients in “already overcrowded and understaffed institutions”.  Lando does express a concern about the diagnostic process since all three pseudopatients received diagnoses of schizophrenia.

The key question about why the data of the ninth pseudopatient was omitted from the original paper is answered as a footnote number 6 on page 258 of the original paper:

“Data from a ninth pseudopatient are not included in this study because although his sanity went undetected, he falsified aspects of his personal history. Including marital status and parental relationships. His experimental behaviors therefore were not identical to the other pseudopatients.” 

That footnote is exactly what Rosenhan did when he was admitted as pseudopatient 1 as documented in the existing medical record.  Rosenhan’s lapses were discovered and discussed by Cahalan and are included in the following table.

 

 

Rosenhan’s Lapses

 

1.  Data was improperly recorded. The two pseudo-patients interviewed by Cahalan pointed out that their durations of stay in the hospital were not correctly recorded.

2.  His private notes indicated strong influence by Szasz and Laing. Prior to the pseudopatient experiment he assigned work to his students describing psychiatric hospitals as “authoritarian”, “degrading”, and “illness-maintaining”.

3.  He told a pseudopatient that a writ of habeas corpus was prepared and an attorney was on call to get them out of the hospital if necessary. That was not true.

4.  Professional and possibly “unethical” mistakes (p. 173) about length of stay in pseudopatient number two (7 days versus 8) and pseudopatient number 9 (26 days versus 9 days), patient population in the hospital 8,000 vs 1,510), the specific discharge diagnoses of pseudopatients 2 and 9, and details of staff behavior on the ward.

5.  Sending a pseudo-patient into a hospital that was in disarray because it was closing.

6.  Rosenhan at one point lied in correspondence to Spitzer about his stay in the hospital and said it was part of a “teaching exercise” that had nothing to do with research(p. 180). Cahalan describes this as “an outright lie”.

7.  During his admission Rosenhan “goes off script” and gives far more fabricated symptoms and history than the “empty, hollow, thud” existential hallucinations he described in the protocol. Additional symptoms suggest a significant psychiatric disorder. He describes suicidal ideation and significant conflict with his employer – the same falsification of personal history that led him to eliminate the data of the ninth pseudopatient.

8.  Rosenhan fabricated an excerpted portion of the medical record and both the original record and the excerpt are published for A - B comparison on page 190. Cahalan concludes that the facts “were distorted intentionally by Rosenhan himself.”

9.  Inadequate preparation of the research subjects. Patient 2 ended up taking a dose of chlorpromazine and patient 9 was given liquid chlorpromazine so it could not be cheeked as instructed.  Pseudopatient 9 estimated the preparation time for hospital admission by Rosenhan was about 15 minutes.

10.  When patient 9 was eliminated from the study none of the data about pills dispensed or staff contact time in the paper was changed.

11.  In an National Public Radio program that aired before the publication of his paper (December 14, 1972) he misstated his time in the hospital as a pseudopatient (several weeks versus 9 days) and the amount of medications dispensed to pseudopatients (5,000 pills versus 2,000 pills) while building to the conclusion that psychiatric hospitals are non-therapeutic and should be closed (p.234)

12.  Pseudopatient 9 commented that what Rosenhan had written about him in the experiment was “total fiction” (p.269)

13.  Rosenhan did not complete a book about the pseudopatient experience, despite an advance from the publisher, a subsequent lawsuit from the publisher and what is described as plenty of publicity around the time the paper came out in Science. He also never published on the topic again (p. 295). 

 

Rosenhan did continue to publish a description and discussion of his study in the text Abnormal Psychology (5). The discussion emphasized that the simple hallucinations described with nothing else being unusual would have been detected outside of a hospital. In the context dependent setting it was not.  In other words – he maintained one of the same themes as in the original paper.

One of the areas that really piqued my interest was why Science published this paper in the first place.  Cahalan got the opinion from an academic psychologist that the peer review in a non-psychology journal would be less rigorous.  When she approached the journal she was told that records were confidential and that they were not kept back that far.  Accessing Retraction Watch (6) demonstrated that there has been a total of 120 papers retracted from Science since 1963. The reasons for the retractions are given as data errors, errors in methods, result errors, errors in conclusions, errors due to contaminated experiments, falsification/fabrication of data, irreproducible results, misconduct by the author, ethical violations by the author, investigation by a company, institution, or third-party.  Only three of these papers had anything to do with psychiatry and those papers were primarily about the neurobiology of the brain. Cahalan’s investigation suggests that several of the reasons for retraction have been met.

Apart from the details of the Science paper, Cahalan also does a character study of Rosenhan. We learned that his brother had bipolar disorder and did well on lithium. It was suggested that was why he became interested in psychology. He was described as bright and charismatic. He was clearly influenced by the work of anti-psychiatrists and assigned work to his students that “describe psychiatric hospitals as authoritarian, degrading, and illness maintaining among other terms”. (p 73).  The title of the book highlights Rosenhan’s characteristics as a raconteur who would occasionally pretend to be someone who he was not. His son described an incident in New York City where he introduced himself as a professor of engineering at Stanford in order to get a tour of an interesting construction site with his son. In another scene he is joking about the wig he wore to get into the psychiatric hospital.  Cahalan finds the admission photo showing that he is bald without a wig. The people who knew him the best – acknowledge the he was difficult to know and just like Rosenhan’s arguments about psychiatric diagnoses being context dependent – his personality was as well.   

Apart from academic books about the history of psychiatry – most books review sensational history and arguments that by their very nature diminish the field.  This book is intermediate in that tone with those arguments interspersed through the investigative journalism about Rosenhan. They touch on the familiar themes of biological reductionism as opposed to a clinical psychiatry where patients are actually listened to with no reference to how clinical psychiatrists really practice every day. Some psychiatrists end up being caricatured and some are acknowledged as being highly motivated and humanistic. I am probably far too invested in clinical psychiatry and the good I have seen done to tolerate a journalist’s approach to the field.  I give Cahalan credit for touching on the current situation that has resulted in severely rationed care and the transinstitutionalization of patients in jails.  The overall concept that psychiatrists have little to do with the systems of care that are controlled by businesses and governments is not emphasized even though it was recognized as a problem by two of the pseudopatients.  She also points out that the pseudopatient experiment is irrelevant to psychiatric practice today but her resounding theme throughout the book was that it was extremely relevant irrespective of what actually happened.  The book also gives Rosenhan too much credit for psychiatric criticism. Like many books of this nature – there is little to no evidence that psychiatrists might be their own best critics or that outrage might be a legitimate reaction to outrageous criticism rather than defensiveness.

 In conclusion The Great Pretender identifies very specific problems with the original Rosenhan paper that have been listed in the narrative and table in this report. He gained initial celebrity status from the study and signed a book contract. Even though he was given an advance on the book and wrote a manuscript he never produced a book.  The author suggests that may have been due to the fact that Robert Spitzer was aware of Rosenhan’s nonadherence to the research protocol during his admission. As Rosenhan withdrew from the pseudopatient limelight he also stated that none of his research should lead to the conclusion that psychiatric hospitals were unnecessary and that represented a complete turnaround form earlier statements.

The controversy, the original paper and the book could be the subject of seminars in the history or philosophical aspects of psychiatry. It touches on a number of themes primarily the ethics of research and how it should be conducted. It also touches on psychiatric criticism and may be useful in discussing how future generations of psychiatrists can prepare to deal with it. 

 

George Dawson, MD, DFAPA

 

References:

 

1: Susannah Cahalan.  The Great Pretender. Grand Central Publishing. New York, 2019. 382 p.

2: Rosenhan DL. On being sane in insane places. Science 1973 Jan 19;179(4070):250-258.

3: Sartorius N, Jablensky A, Shapiro R. Cross-cultural differences in the short-term prognosis of schizophrenic psychoses. Schizophr Bull. 1978;4(1):102113. doi:10.1093/schbul/4.1.102

4: Lando, H. A. (1976). On being sane in insane places: A supplemental report. Professional Psychology, 7(1), 47–52. https://doi.org/10.1037/0735-7028.7.1.47

5: David E. Rosenhan, Martin E.P. Seligman. Abnormal Psychology- 2nd Ed. WW Norton and Company, New York City, 1984, 1989; p 181-183.

6: Retraction Watch: Retractions from Science.  Accessed on May 22, 2020: http://retractiondatabase.org/RetractionSearch.aspx#?jou%3dScience

7:  Gaudino M, Robinson NB, Audisio K, et al. Trends and Characteristics of Retracted Articles in the Biomedical Literature, 1971 to 2020. JAMA Intern Med. Published online May 10, 2021. doi:10.1001/jamainternmed.2021.1807

The authors cite retracted literature (5209 papers) back to the year 1923. Scientific misconduct like fabrication of data was cited as the most common reason.  


Supplementary:

The review was written for Philosophy Special Interest Group of the Royal College of Psychiatrists September 2020 newsletter and it can be found starting on page 8.


Additional Reference posted on July 17, 2021:

Justman, Stewart, "Below the Line: Misrepresented Sources in the Rosenhan Hoax" (2021). Global Humanities and Religions Faculty Publications. 13. https://scholarworks.umt.edu/libstudies_pubs/13

This author fact checks Rosenhan's references and footnotes and finds they do not support his points.

 

 

 

 

Tuesday, November 12, 2019

Rosenhan Uncovered






I have been on record for many years regarding the Rosenhan experiment. To briefly recap, that was a paper published in Science in 1973 (1). In the paper the author described how eight pseudopatients were admitted to psychiatric hospitals and the treatment they received. He describes their varied backgrounds. He says that they were admitted to 12 hospitals in five states on the East and West Coast. The hospitals also varied from research institutions to institutions with much fewer resources. Most importantly he describes the script that each pseudo-patient is supposed to adhere to in order to get admitted and how they are supposed to behave post admission. 

Specifically:

“After calling the hospital for an appointment, the pseudopatient arrived at the admissions office complaining that he had been hearing voices. Asked what the voices said, he replied that they were often unclear, but as far as he could tell they said "empty," "hollow," and "thud." The voices were unfamiliar and were of the same sex as the pseudopatient. The choice of these symptoms was occasioned by their apparent similarity to existential symptoms.” (p. 251)

Apart from the false symptoms, false name, false vocation, and false employment the social history provided by the pseudopatients was supposed to be identical to their real social history. After gaining admission so patient was supposed to “cease simulating any symptoms of abnormality.”

From the purported data, Rosenhan pointed out that none of the pseudo-patients were discovered, they were hospitalized for varying lengths of time, they were given medications that they may have been trained to not take and spit out, and they made a number of observations inside the hospital. Rosenhan concluded that “It is clear that we cannot distinguish the sane from the insane in psychiatric hospitals”.  He also uses at least half of the article for highly speculative observations on powerlessness, depersonalization, and labeling none of which really pertain to the study.

I just finished reading Susannah Cahalan’s new book The Great Pretender. It is about Rosenhan’s study and Rosenhan himself.  She has quite a lot to say about him including how this paper changed the face of psychiatric care and was a major factor in closing down psychiatric institutions.

Let me start by describing what I experienced at that time. In 1973, I was just finishing an undergraduate degree and although I was a science major - heard nothing about this paper. I was reading Science and Nature at the time. I did medical school and residency training between the years 1978 and 1986 and again heard nothing about Rosenhan - even during psychiatry rotations and seminars. That was a controversial time in psychiatry because of the tension between biological psychiatry and psychotherapy. The controversy seemed to be largely from the psychotherapy side of the equation. Psychiatry residents were pulled to one side or the other. It was always clear to me that both modalities were critical. I got what I consider to be good psychotherapy training at two different Midwest residency programs.

A unique aspect of my training happened at the University Wisconsin training program. Community Psychiatry was a mandatory six-month rotation that consisted of an outpatient clinic, crisis intervention training, and an active seminar every week. One of the leaders of that seminar was Len Stein MD. Dr. Stein was a major force and originator of Assertive Community Treatment (ACT) and other forms of community treatment that were focused on maintaining people with severe mental illness in the community. To this day I can recall a slide from one of his presentations that showed a gymnasium sized room at the local state mental hospital. In that room were cots arranged edge to edge across the entire floor. Rows and rows of these cots covering the entire floor. The men who slept on those cots were standing in the foreground. They were all wearing the same pajamas. After showing that slide, Dr. Stein would point out that this was one of the motivators that led him to help people get out of hospitals into their own apartments.  His goal at the time of Rosenhan’s paper, was to develop a way to help people with severe mental illnesses live independently in the community.  He was not only successful at it – he trained psychiatry residents how to do it. After completing my training, I went to a community mental health center and helped run an ACT team for three years.  We were highly successful at maintaining people outside of the hospital and helping them function independently.

My introduction here is to illustrate that one of the main theses of The Great Pretender, namely that Rosenhan’s experiment was one of the main forces in deinstitutionalization and closing down psychiatric hospitals is something that I disagree with. It seems to be a good theory if you want to suggest that psychiatry only changes from the outside and the change happens by people who are not psychiatrists. You can probably make that argument if you don’t know psychiatrists like Len Stein and all of the other community psychiatrists out there who were highly motivated to maintain people outside of state hospitals because it was the right thing to do. It was the right thing to do because states ration resources to the mentally ill. They always have and they always will.  Politicians don't really care about anyone with severe mental illness. Community psychiatrists know that. They know the only way to provide good treatment to those patients is to make sure that public funds follow the individual patient.

In her book Susannah Cahalan, spends a lot of time describing how seminal the Rosenhan study was. She has numerous testimonials from important psychiatrists at the time. There is even a suggestion that Robert Spitzer, MD used the study politically to advance his own agenda in writing more precise diagnostic criteria for the DSM-III. I can state unequivocally that I had not heard of this experiment until I started encountering anti-psychiatrists. That didn’t happen much until I started this blog in 2012.

What did I like about the book? I was impressed with the investigative aspects of the book. She carefully details how Rosenhan’s original description in Science does not accurately reflect what actually happened. There is not enough information available to verify whether or not the entire pseudoexperiment was completed as written. In addition to that research, she has detailed impressions of Rosenhan from fellow faculty members, coworkers, friends, and family members who knew him well. Many of these people had reservations about him and his work. Many believed that there were problems with the original paper. Many had concerns about his character that are clearly described in this book. In brief, there is plenty of circumstantial evidence in addition to the direct evidence that something was wrong with this paper.  I take this circumstantial and character evidence with a grain of salt. In any clinical or academic settings, there are always plenty of personality conflicts and politics. There is one scene in the book where Rosenhan is throwing a party and tells a colleague that he had a wig made for the pseudopatient role (Rosenhan was bald). Cahalan confirms by photo and the attending psychiatrist’s notes that he was bald and not wearing a wig during the hospitalization. I also do not consider that to be a big deal. He was described as a raconteur who liked to hear himself talk. Making up stories at parties to keep people engaged is what raconteurs and extroverts do.  

She also builds a careful case of additional red flags along the way. Rosenhan apparently achieved celebrity status for brief period of time. When that occurs he got a book deal and was advanced substantial sum of money. He also wrote several chapters that were read by Cahalan. He never finished the book even when he was sued by the publisher.  He never did any further research on the subject of pseudopatients getting into psychiatric hospitals or psychiatric hospitals at all. He had an active correspondence with Spitzer and one point recruited psychiatrists to convince Spitzer not to publish criticisms of his paper. Spitzer was very content with his criticism, but Cahalan points out that he may have had direct information at the time to refute the paper entirely. Rosenhan clearly broke the protocol that he described as evidenced by the medical record. The treating psychiatrist apparently sent Spitzer a copy of those records showing that as the original pseudo-patient, Rosenhan broke protocol. In addition to describing vague auditory hallucinations he added historical data that would have resulted in him being hospitalized anywhere.  Excerpts from the exact medical record are included in the book on pages 184 and 190. The author concludes (and any reader can do the same) that the facts were intentionally distorted by Rosenhan primarily with more elaborate delusional material and suicidal thoughts including the statement “everyone would be better off if he were not around.” What is recorded in the actual medical record is a person feigning a much more serious mental illness than “existential symptoms.”

Cahalan was able to locate two more pseudopatients, but one of them was not included in the study. Cahalan was unable to locate any of the other six pseudo-patients described in the Science paper despite an intensive effort.  Rosenhan also removed the data from the ninth pseudo-patient. The data from the ninth pseudo-patient was inconsistent with the others in that this patient liked his experience in the psychiatric hospital and in fact found to be very positive. He liked it so much that he published that positive experience in Professional Psychology in February 1976 (2) including the following conclusion “He recommends stressing the positive aspects of existing institutions in future research.” (p 213).

Cahalan approached Science directly. She asked them directly why they published this article in the first place given the concerns she outlined in her book. They refused to discuss their editorial process. A psychologist speculated that the submission to Science would be less rigorously reviewed because they probably did not have the top peer reviewers in the field. Although Cahalan uses a fair amount of anti-psychiatry rhetoric in her book, and seems to talk authoritatively about that field, there is no speculation that bias against psychiatry may have been involved in publishing this article.  Given what we know about general bias against psychiatry, that would seem to be a real possibility to me.

I am already on record saying that there is enough information in this book to retract the original article. I admit I don’t know the criteria for retractions or whether there is any time limit. Having been a Science subscriber for decades I know that it certainly does not meet their typical standards. I will happily go back and read articles from medicine and psychiatry in their 1973 editions to illustrate that fact if there is a shot at retraction.

Retraction would certainly create a furor in the anti-psychiatry community. Their arguments rest almost entirely on false premises and pseudoscience. As I noted in my post from seven years ago, anyone can walk into a medical facility and lie about a condition for any number of motives. In my current field, I have talked with hundreds of people who tell me they asked for a second or third opioid prescription when they did not need it for pain. They were taking it to get high. Before that I did consults in a general hospital, we were often asked to see people with factitious disorders who are feigning some medical illness. We also saw significant numbers of people who had medical symptoms but were not consciously feigning illness. The author mentions some of this but is usually quick to make it seem like psychiatry is the wildcard relative to the rest of medicine. 

I have had several people ask me if they should buy this book. I have also been asked to write a book review for newsletter.  My response is consistently, buy the book if you want to see the clear evidence that the Rosenhan experiment was more than seriously flawed – the protocol was violated by the author himself and the evidence is there black on white. A second protocol violation occurred when the Rosenhan decided to eliminate the experience of the pseudopatient who enjoyed being in the hospital and found it to be useful. I will say again that I am not an expert in retractions but believe that papers are retracted today for violations of data integrity.

Don’t buy this book if you are expecting to read a valentine to psychiatry. The author's previous book was about her episode of inflammatory encephalitis that was misdiagnosed as a psychiatric disorder. She mentions it several times to point out her credibility as a person who has experienced severe psychiatric symptomatology. At one point in the book she undergoes a SCID (Structured Clinical Interview for DSM-IV) evaluation by a psychiatrist who had a lot of input into DSM-5. After a tedious exchange he tells her that his going charge for the exam is $550. When I read that, I asked myself why would this psychiatrist go along with a SCID when he knew it was irrelevant to Cahalan’s diagnosis? Several other prominent psychiatrists are quoted in the book in a way that fits Cahalan’s thesis that psychiatry is in fact a weak link in medicine and even though Rosenhan’s pseudoexperiment was grossly flawed there is a still some valuable lesson there.

I would suggest that is really not the case. I don’t know why anyone would want to try to resuscitate this work and I sure don’t know why Science wants to keep it in a reputable journal.  The original responses over 40 years ago pointed that out. I would highly recommend reading the  original responses by Spitzer.


George Dawson, MD, DFAPA



References:

1: Rosenhan DL. On being sane in insane places. Science. 1973 Jan 19;179(4070):250-8. PubMed PMID: 4683124.

2: Lando H. On being sane in insane places: a supplemental report. Professional Psychology, February 1976: 47-52.



Additional Reference posted on July 17, 2021:

Justman, Stewart, "Below the Line: Misrepresented Sources in the Rosenhan Hoax" (2021). Global Humanities and Religions Faculty Publications. 13. https://scholarworks.umt.edu/libstudies_pubs/13

This author fact checks Rosenhan's references and footnotes and finds they do not support his points.




Wednesday, July 18, 2012

On the Validity of Pseudopatients


Every now and again the detractors and critics of psychiatry like to march out the results of an old study as "proof" of the lack of validity of psychiatric diagnoses.  In that study,  8 pseudopatients feigned mental illness to gain admission to 12 different psychiatric hospitals.  The conclusion of the study author was widely seen as having significant impact on the profession, but that conclusion seems to have been largely retrospective.  I started my training about a decade later and there were no residuals at that time.  I learned about the study largely through the work of antipsychiatrists and psychiatric critics.

Several obvious questions are never asked or answered by the promoters of this test as an adequate paradigm.  The first and most obvious one is why this has not been done in other fields of medicine.  It would certainly be easy to do.  I could easily walk into any emergency department in the US and get admitted to a Medicine or Surgical service with a faked diagnosis.  I know this for a fact, because one of the roles of consulting psychiatrists to Medicine and Surgery services is to confront the people who have faked illness in order to be admitted.  Kety (9) uses a more blunt example in response to the original pseudopatient experiment (1):

"If I were to drink a quart of blood and, concealing what I had done, come to the emergency room of any hospital vomiting blood, the behavior of the staff would be quite predictable. If they labeled and treated me as having a bleeding peptic ulcer, I doubt that I could argue convincingly that medical science does not know how to diagnose that condition. "(9)

I also know that this happens because of the current epidemic of prescription opiate abuse and the problem of drug seeking and being successful at it.  An estimated 39% of diverted drugs (7) come from "doctor shopping."  By definition that involves presenting yourself to a physician in a way to get additional medications.  In the case of prescription opioids that usually means either faking a pain disorder or misrepresenting pain severity.  So it is well established that medical and surgical illness well outside of the purview of psychiatry can be faked.  And yet to my knowledge, there is hardly any research on this topic and nobody is suggesting that medical diagnoses don't exist because they can be faked.  Does that mean the researchers consider the time of these other doctors too valuable to waste?  More likely it did not fit a preset research agenda.

The second obvious question has to do with conflict of interest.  It is currently in vogue to suggest that psychiatrists are swayed in their prescribing practices by incentives ranging from a free pen to a free meal.  Compensation as a company employee or to give lectures is also thought of as a compromising incentive. The free pen/free meal incentive is pretty much historical at this time.  What about intentionally misrepresenting yourself?  What is the conflict of interest involved at that level and how neutral can you stay when you are trying to escape detection in order to prove a point?  A vague script like a mono-symptomatic presentation of schizophrenia should suggest that the intent is to escape detection.  How should a person with a vague script act when they are face to face with a real clinician?  The logical conclusion is that they would be as evasive as possible even if they were adhering to that protocol.

The bottom line is that the pseudopatient experiments were seriously flawed out of the box.  Continuing to promote them as meaningful reflects a serious lack of scholarship in reading the relevant literature and a need to suspend the reality that in fact mental illness does exist, that distinctions can be made among various types of mental illness, and that those distinctions are useful to psychiatrists trying to help people with those problems.

George Dawson, MD, DFAPA

1: Rosenhan DL. On being sane in insane places. Science. 1973 Jan 19;179(4070):250-8. PubMed PMID: 4683124.

2: Fleischman PR, Israel JV, Burr WA, Hoaken PC, Thaler OF, Zucker HD, Hanley J, Ostow M, Lieberman LR, Hunter FM, Pinsker H, Blair SM, Reich W, Wiedeman GH, Pattison EM, Rosenhan DL. Psychiatric diagnosis. Science. 1973 Apr 27;180(4084):356-69. PubMed PMID: 17771687.

3: Bulmer M. Are pseudo-patient studies justified? J Med Ethics. 1982 Jun;8(2):65-71. PubMed PMID: 7108909; PubMed Central PMCID: PMC1059372.

4: Spitzer RL, Lilienfeld SO, Miller MB. Rosenhan revisited: the scientific credibility of Lauren Slater's pseudopatient diagnosis study. J Nerv Ment Dis. 2005 Nov;193(11):734-9. PubMed PMID: 1626092

5: Spitzer RL. More on pseudoscience in science and the case for psychiatric diagnosis. A critique of D.L. Rosenhan's "On Being Sane in Insane Places" and "The Contextual Nature of Psychiatric Diagnosis". Arch Gen Psychiatry. 1976 Apr;33(4):459-70. PubMed PMID: 938183.

6: Zimmerman M. Pseudopatient or pseudoscience: a reviewer's perspective. J Nerv Ment Dis. 2005 Nov;193(11):740-2. PubMed PMID: 16260928.

7: Inciardi JA, Surratt HL, Cicero TJ, Kurtz SP, Martin SS, Parrino MW. The "black box" of prescription drug diversion. J Addict Dis. 2009 Oct;28(4):332-47.  PubMed PMID: 20155603; PubMed Central PMCID: PMC2824903.

8: Millon T. Reflections on Rosenhan's "On being sane in insane places". J AbnormPsychol. 1975 Oct;84(5):456-61. PubMed PMID: 1194506.

9: Kety SS. From rationalization to reason. Am J Psychiatry. 1974 Sep;131(9):957-63. PubMed PMID: 4413516.





Tuesday, February 7, 2023

Even More Epistemic and Hermeneutical Injustice......




My latest foray into the philosophical was reading a paper by Bennet Knox (1) called “Exclusion of the Psychopathologized and Hermeneutical Ignorance Threaten Objectivity”. In it he argues for inclusion of persons affected by mental illnesses or at least as they are defined in the DSM into the scientific process of revising the DSM. He prefers the term psychopatholigized that he shortens to pathologized to other terms used in the philosophical literature. He makes the argument against a severely truncated form of psychiatry that he can conveniently describe as hermeneutically ignorant while characterizing a brief comment by Spitzer as hostile. His argument hinges on a concept of social objectivity that necessarily means all viewpoints of the psychiatrically involved including those who want to burn the profession down are valid and must be considered.

As I have stated before on this blog (and given examples) – this is a standard philosophical approach to criticizing psychiatry while ignoring what actually goes on in the field and how psychiatrists are trained. So, I will start there.

Let me start with the concept of “social objectivity” since the early claim by the author is:

“Further, insofar as the objectivity which psychiatry should aspire to is a kind of “social objectivity” which requires incorporation of various normative perspectives, this particular form of epistemic injustice threatens to undermine its scientific objectivity.”

I am not completely sure of how philosophers use the term normative here so I am assuming that it means – what other people approve of or endorse.  The other people here would be the pathologized.  He uses examples of the pathologized in this paper as members of the Hearing Voices Movement and the Autistic Self-Advocacy Network (ASAN).  He states that social objectivity is defined in two books by Helen Longino but does not include an operational definition.  Instead, he comments throughout the paper on how various circumstances do not meet these criteria.  He openly acknowledges that his argument is deficient:

“Although I can provide only a limited argument for embracing the social objectivity model in psychiatry here, my main goal is to show fellow proponents of social objectivity that the particular kind of hermeneutical ignorance I describe presents a significant obstacle to achieving it in psychiatry.”

I agree that the argument presented is very limited.  If that is the case, why should it be achieved in psychiatry?  Will it be theoretically useful in some way? 

His introduction to the need for social objectivity and objectivity in general in psychiatry is based on the philosophy of psychiatry.  More to the point non-empiricist philosophy. If that is considered, an empirically adequate model is all that is required.  Instead, he introduces three models that all suggest that values play a role in psychiatric diagnosis. He acknowledges that dysfunction is a value free criterion for diagnosis but then goes on to separate out a category of mental disorder that also contains judgements about dangerousness.  He lands on the DSM definition of dysfunction but explains it away as “there is reason to believe that it is impossible (and undesirable) to uncover dysfunctions in mental processes without reference to values.”  He goes on to explain how “a scientific process is more objective insofar as it engages a diverse array of points of view with different normative background assumptions in a process of “transformative criticism.”

There are multiple points of disagreement with this viewpoint starting with a basic misunderstanding of what psychiatry is and how psychiatrists work. The key element in the DSM that is ignored here are all of the qualifications for subpopulations ranging from cultural differences to gender differences that include a moving threshold for the diagnosis of disorders and recognizing that in some cultures or subcultures varying degrees of psychopathology are tolerated (or not) and that also includes a tendency to stigmatize individuals with that psychopathology. Breaking that down – psychiatry parses scientific objectivity and normative perspectives when it comes to diagnosis and treatment planning. That not only occurs in psychiatry but in all of medicine and it may actively include the outside input from philosophers on ethics committees.  Here are a couple of clear examples.

Example 1:

Bob is a 65-year-old married man admitted for hepatic encephalopathy from alcoholic cirrhosis. The Internal Medicine team requests psychiatric consultation for further diagnosis and referral.  The psychiatrist assesses the patient as improved (less delirious) and competent.  No other psychopathology is noted. He discussed treatment options for the alcohol use disorder and the patient is willing to listen.  He has never attended an AA meeting or been in treatment in the past. The family (wife and adult children) enter the room and are all adamant about taking the patient home with no treatment. They are angry and state several times “If he wants to drink himself to death it is none of your business doctor. Let him drink himself to death.”  The family and the patient are approached by social workers and the Internal medicine team over the next two days but he is discharged home with no treatment.

All of the people in this case were white 4th or 5th generation Americans. There are no assumed cultural differences, but they are implicit. Patients and families affected by substance use disorders have known patterns of adapting and some of them are not functional adaptations. Was an attempt at involuntary treatment needed in this case? The psychiatrist knew that hardly ever happens by local probate courts in substance use disorders unless there was an actual suicide attempt or the family supported civil commitment. Should adult protection social workers have been involved?  Referrals could have been made to county social workers who might invoke a societal level value judgment on this situation but instead dialogue was established with the family and they agreed to call if problems occurred and take referral numbers for additional assistance. They were also informed that the patient had a life threatening alcohol use disorder and severe complications (including death) could occur with any future episodes of drinking.

To the point of the article this example points out that DSM diagnosis (alcohol use disorder, delirium plus dysfunction) were the objective considerations. It also illustrates a point about social objectivity and that is that it needs to be elaborated for every individual patient, family, and culture/subculture specifically. Suggesting that physicians or psychiatrists don’t have the capacity for recognizing these exceptions and planning according is not accurate. Suggesting that the patient and family were ignored or that their opinions were not considered is also inaccurate.  The entire treatment and discharge plan was based on those opinions - even after the recommended treatment was rejected and the high level of risk was explained.

Example 2:

Tony is a 28-year-old man seen in hospital following a suicide attempt. He shot himself through the shoulder and is on the trauma surgery service. When interviewed by psychiatry he says” “I did not shoot myself. Sure, I had the gun pointed at myself but it just went off.  I am not suicidal and I want to leave.” He gives the additional explanation that he was using large quantities of alcohol even though he has been hospitalized for alcohol poisoning in the past. When the psychiatrist points out the dangers of alcohol poisoning including death he says “Look I already said I was not suicidal.  I was just trying to get high.  I get to the point where I don’t care if I live or die but I am not trying to kill myself.”  He has had multiple admissions for depression and suicide attempts in the past.  He is currently on a 72-hour hold pending a court hearing at that time. The psychiatrist requests a review from the Ethics Committee composed of a number of local philosophy professors. They decide that the patient should be released despite the recommendation to the court for extended treatment of the substance use disorder and depression.  During the hearing the psychiatrist testifies that he has seen this type of treatment work and that he considers the patient to be at very high risk.  The court releases the patient. A week later he is found dead from acute alcohol poisoning.

Again, there are no major cultural differences in this case but clear subcultural differences based on the patient’s family and social history.  The psychiatric diagnoses are clear and indisputable.  The clinical judgment of the psychiatrist based on risk factors was also clear. The value judgments introduced here are the probate court and Ethics Committee as a proxies for society’s charge to balance a persons need for autonomy against their need for protection.  Those decisions were spread over multiple people and agencies outside of the field of psychiatry.  

These basic case examples (I say basic because they are encountered in acute care psychiatry every day and multiple times a day) illustrate a few facets of social objectivity.  First, it is poorly defined.  Second, it is impossible to achieve primarily because is consists of an infinite number of subsets that cannot be averaged if the expected result is to achieve active input into the field of psychiatry. Third, for social objectivity to be useful it needs to be recorded as unique for every person that comes into treatment and handled as it was in the above vignettes.  That way the relevant considerations of every unique history and constellation of signs and symptoms can be evaluated in the proper context. It turns out that technique has been around in clinical psychiatry for as long as I have been a psychiatrist and it is called cross cultural psychiatry.

For 22 years, I practiced on an acute care unit where we had access to professional interpreters who were fluent in both the language and cultures of several countries as well as the hearing-impaired population who used American Sign Language to communicate.  There were 15 language interpreters who spoke a number of African and Asian languages in addition to Spanish. Professional interpreters do a lot more than translate languages - they also interpret cultural and subcultural variations as well as normative behaviors. We had access to telephone interpreters in any language if we encountered a patient outside of the hospital staff expertise. The interviews were lengthy and often incorporated family members, community members, and in some cases local shaman. Without this intensive intervention attempting to assess and treat these problems would be a set up for the epistemic and hermeneutical injustices the author refers to. In fact, treatment would have been impossible. In completing these assessments there was not only an elaboration of the stated problem, how the relevant community conceptualized that problem, a discussion of how it may be treated psychiatrically and the rationale for that treatment, as well as whether the family wanted the patient treated in general or more specifically in the hospital and whether their shaman or medicine man would be involved.

These are just a few examples of how social objectivity is approached in clinical psychiatry.  The result is that values are incorporated that are important to the patient and their family even if they affect diagnostic thresholds and treatment planning.  That is also clearly stated in the DSM.  It is a much more practical and personalized approach than trying to incorporate all of those opinions into the DSM diagnosis and it gives a voice to many more people than would be involved in that process. It also considers a multitude of local factors (budgets and attitudes of social service agencies, budgets and attitudes of local courts, community resources, etc.) that all factor prominently in values-based decision making.

The other important aspect of an all-inclusive process for social objectivity is that the normative thinking of some - may result in exclusion rather than inclusion. Normative thinking based on beliefs can be political thinking and in the past two years we have seen that lead to fewer rights for women, the banning of books, a widening scope of gun permissiveness in a society rocked by gun violence, gross misinformation about the pandemic, and an attempt to overthrow the elected government of the United States. These are all good examples of how including normative thinking outside the scope of medical practice could lead to disruption of the entire field. The author suggests that the opinions expressed do not need agreement - they only need to be aired. That strikes me as the basis for a very bad meeting. Unless there is basic agreement on the values and rationale for a diagnostic system – I think Spitzer has a point that opinions for the sake of stating an opinion is a futile exercise especially if it is not in basic agreement with medical and psychiatric values and ethics.

The author defines hermeneutical ignorance in psychiatry somewhat clearer. He suggests that marginalized groups (like the pathologized) develop their own conceptual resources that are not shared with other groups.  The example suggests that willful hermeneutical ignorance results when the marginalized group does not share the conceptual resources and the dominant group (inferring psychiatry) are unaware of the resources or dismiss them.  There are numerous examples of how this is not the case with psychiatrists.  Obvious examples include Alcoholics Anonymous and other 12 step groups as well as community psychiatry programs that actively use advocates and develop resources with the active input from people with severe mental illness who are affiliated with specific programs. Psychiatrists see a general knowledge about non-psychiatric resources as necessary to provide people with additional assistance.  In many cases that can include discussions of how to better utilize the resource and what to expect.  

There are several additional points of disagreement with the author on many points where he seems unaware of how psychiatrists actually practice or he is unwilling to give credit where credit is due. The best example is his description of Spitzer’s brief commentary (2) on a paper written in Psychiatric Services. He was responding to a lead paper (3) on including patients and their families in the DSM process. The author characterizes Spitzer’s general attitude toward the idea as hostile and characteristic of injustices that he writes about but important context is not given.  Spitzer was the major architect of DSM criteria and studied the process for decades. He wrote a comprehensive defense of psychiatric diagnosis in response the Rosenhan study that has been discredited. He was also responsible for removing homosexuality from the DSM and he did that by directly engaging with activists who presented him with clear information about why it was not a diagnosis. Critics like to use the homosexuality issue as a defect with psychiatry while never pointing out it was self-corrected and that correction happened decades before progress was made at societal levels.  Even now there is a question about whether societal progress is threatened by the normative thinking and agenda of conservative groups. Spitzer was responding to the political aspects of the process with political rhetoric. 

The best argument against inclusion in the original paper was:  “The DSM process is already compromised by excessive politics.” by several groups who are not psychiatrists.  That argument has been expanded in the past 18 years to the point where it is a frequent criticism in the popular media. Even in the original paper the authors suggest that these political processes may have stifled innovation and scientific progress.

Psychiatry has not “escaped” from considering values – as noted in the above examples they are incorporated into clinic practice when the specific social and cultural aspects that apply to a certain patient are explored and considered.  Contrary to philosophical opinion – the pathologized are not a marginalized group to psychiatrists. It is who we are interested in seeing and treating.  Our interest in treatment goes beyond what is typically considered evidence-based medicine. We are interested in any modality that might be useful and that includes using resources developed or available to the people who need them. It is clear that the DSM has been overly politicized and it is routinely mischaracterized in the media. Adding  additional elements - some that have strictly political agendas that include the destruction of the field - adds nothing to improving that process. There are existing avenues for that input and they are readily available outside of the DSM process in day-to-day psychiatric practice.

 

George Dawson, MD, DFAPA

 



References:

 

1:  Knox B. Exclusion of the psychopathologized and hermeneutical ignorance threaten objectivity. Philosophy, Psychiatry, & Psychology. 2022;29(4):253-66.

2:  Spitzer RL. Good idea or politically correct nonsense? Psychiatr Serv. 2004 Feb;55(2):113. doi: 10.1176/appi.ps.55.2.113. PMID: 14762229.

3:  Sadler JZ, Fulford B. Should patients and their families contribute to the DSM-V process? Psychiatr Serv. 2004 Feb;55(2):133-8. doi: 10.1176/appi.ps.55.2.133. PMID: 14762236.

4:  Dawson G. More on epistemic injustice.   https://real-psychiatry.blogspot.com/2023/01/more-on-epistemic-injustice.html

5:  Dawson G.  Epistemic injustice is misapplies to psychiatry.   https://real-psychiatry.blogspot.com/2019/07/some-of-greatest-minds-in-psychiatry.html