Sunday, October 5, 2014

Live by the Customer Satisfaction Ratings and Die By Them




My original intent was to look at the problem of what happens to a group of physicians who are sailing along with very high patient satisfaction ratings.  Then for no particular reason, their ratings drop by about 20-25%.  At the high point they did not question the validity of the ratings.  They just assumed the satisfaction ratings reflected their high quality work.  The problem is that nothing they did changed and suddenly their ratings were significantly lower and people were looking for explanations.  Hence the title of this post.  If these ratings really mean something in the first place the physicians are suddenly thrown into a lot of self doubt.  If they believe the ratings are unscientific, designed by people who don't know much about survey design or sampling, and are actually biased because of the way the staff presents the surveys - they are much less worried.

I posted to above bar graph as an introduction to this post.  It is a composite of the opinions that several primary care physicians have given me about the correlation between benzodiazepine and opiate prescriptions and customer satisfaction ratings.  More prescriptions for controlled substances equals greater customer satisfaction.    Some clinics have adapted to this by letting patients know that they do not prescribe benzodiazepines or deal with psychiatric disorders.  That eliminates physician-to-physician variability in prescribing.  It also demonstrates that certain overprescribed medications are viewed as more serious than others.  I have not for example seen any similar clinic rules for antibiotics even though they are also widely over prescribed.

I hope it is not a news flash to anyone that highly satisfied customers in the health care system have the highest mortality and probability of hospitalization (1).  I know that at least some of the customers out there may be very surprised to hear that doctors can't be rated like a Toyota dealership.  Toyota dealers after all have a product that is high in quality, uniform, and the same irrespective of those pesky human factors that we all have to deal with in human encounters.    I am referring of course to things like communication,  interpersonal skills, thinking capacity, personality traits and personality disorders.  A Toyota dealer is out to satisfy all customer needs in the very circumscribed area of personal transportation.  Even then there will be bumps in the road.  A customer may not like the way the vehicle has turned out or some of the results from the service department.  But generally Toyota dealers have a great product and most of their customers are highly satisfied.

This may be hard to believe but the MBAs that currently run medicine in the USA decided to introduce management principles into the field that were designed for the auto industry.   The details and names of those management principles is irrelevant at this time, but when they were introduced it was a big deal.  I had to listen to several hours of lectures on Six Sigma.  Feel free to read about it and let me know how it possibly applies to the practice of medicine.  After those lectures it was obvious to me that the MBAs running medicine were completely clueless about medical care.  One small piece of evidence in what is now a mountain of evidence that the business emphasis in managing hospitals and doctors is completely off the rails.   Most business concepts are introduced to groups of physicians as a manipulation.  They have to be because no rational person would buy what appears to be Dilbert style management.  It goes something like this:

"Look - we know that physicians don't like the idea that they can measured.   We know you don't like that idea, but let's face it, this is a new era.  Things aren't like they used to be.  The day of the physician running things is over.  You are all going to have to be accountable now.  Some day your reimbursement is going to be tied to these satisfaction ratings."

Administrators like to seethe a little bit when they play the authoritarian act with physicians.  They think it gives them more credibility.  They could also be playing off the collective seething in the room.  The logical questions followed:

"Well what about clinicians seeing patients with cognitive impairment or who are being treated on an involuntary basis.  What can you say about the validity of those satisfaction ratings?"

That led to some laughter, but no explanations.  Everybody would be rated and that was the end of it.  There would be no exceptions.  The irrational authoritarian business model rules.

Before anyone gets too bent out of shape about my view of the business model let me illustrate with an second example of what I mean.  Earlier this evening I consulted with a colleague from another state on an inpatient problem.  When that was over I asked her how things were going in general and she told me:  "It's really kind of tough.  The patients are never really stable, they have multiple psychiatric, substance use, and medical diagnoses and they are very hard to stabilize."  She was thinking about moving on.  She was in a meeting and an administrator said:  "This patient has been here (x number of days) what is the plan?"   She said:  "What do you mean what is the plan?  The plan is what the plan always is - stabilize the patient and discharge them."  Managed care administrators have the uncanny ability to blame the physician for any discrepancy with a pure business approach to medicine.  They apparently believe that hospital treatment and discharges are as predictable as Toyotas rolling off an assembly line.  That is as true for customer satisfaction ratings as length of stay outliers.  It give the administrators leverage against physicians, especially any physician who buys in to the idea that these are valid metrics.

Let me illustrate by considering two different physicians Doc A and Doc B.  Both are very competent psychiatrists, but for some reason Doc A consistently scores lower on customer satisfaction ratings than Doc B.   From the research in this area, it may simply mean that Doc B gives his patients more of what they want than Doc A.  My speculation is that personality is a big factor.  A simple mismatch between extroverts and introverts can fuel a lot of dissatisfaction.  The extroverts on both ends (doctor and patient) like to be engaged and they like the conversation to have no dead air.  A doctor that is too reserved may be perceived as being disinterested or not giving them enough in the interaction.  Some patients want special treatment and others just want confirmation of their perceptions of other doctors and in:  "I was not really impressed with your colleague.  What do you think of him?"  Psychiatrists generally know better, especially psychiatrists who recognize that their organization is set up to facilitate splitting and chaos.  There may be a difference between the doctors in terms of prescribing patterns in terms of my previous analysis of the overprescribing problem.  In this case Doc A may be known for no sleep medications, no benzodiazepine prescriptions, no opiate maintenance prescriptions and no high dose amphetamines for narcolepsy and no stimulant prescriptions for adult ADHD when the patient is functioning well in school or work.  Denying those groups of prescriptions will not only result in low physician satisfaction scores but threats of violence and suicide.  That is not to say that other tests or medication would not result in and extremely dissatisfied patient.  There are thousands of scenarios where the patient does not take the physicians advice in the manner with which it is intended and that is - the best possible advice to diagnosis or treat a problem at a given point in time.

I did not write this post to "prove" that being satisfied with your physician is necessarily a good thing or a bad thing.  If I wanted to approach problems like that I could probably get my own TV show.  The whole point here is that any potential patient-customer needs to know what these things mean.  You may not want to keep hearing the word but politics is the major reason.  People trying to sell their business based idea about medicine versus physicians who have no similar notions.  People trying to sell their idea that medicine is just like making widgets rather than treating people who have tremendous biological variability.  You don't want your Toyota to have tremendous mechanical variability, but for human beings biological variability is both a fact of life and a distinct advantage from an evolutionary standpoint.

And finally what about news from your physician that you don't want to hear.  Certainly there is widespread fear of a dreaded incurable diagnosis.  There is the concern of diagnoses associated with disability and loss of function.  But there is also straightforward advice on how to avoid fatal illnesses and disability.  The way that is presented varies considerably from physician to physician.  You have to ask yourself: "Would I rather hear that I am overweight and need to lose weight or that I should stop smoking or that I should stop using hydrocodone or alprazolam or would I rather be talking with a physician who would keep quiet on those issues?"

I don't think there is a good study of the issue and if somebody knows one please let me know so that I can post it here.  I can provide another anecdote.  I worked with a group of women once many of who consulted a female internist who was bright, attractive and wore very high fashion clothing (their characterization not mine).  Things were generally going along pretty well until this internist told some of them that they were overweight and needed to lose weight.  That elicited a very strong reaction and it seemed amplified by their perception of this physician as being "perfect".  When I thought about my experience with physicians - nobody has ever told me to lose weight even in situations where they should have.  I suggested it to a physician once and he said: "I concur with your recommendation doctor" but never told me that outright.  Social and cultural factors all play a part in the patients perception of the physician and their satisfaction ratings.

It is a good idea to keep all of those factors in mind in attempting to interpret physician satisfaction ratings especially since most consumer web sites focus entirely on these measures.


George Dawson, MD, DFAPA

1:  Fenton JJ, Jerant AF, Bertakis KD, Franks P. The Cost of Satisfaction: A National Study of Patient Satisfaction, Health Care Utilization, Expenditures, and Mortality. Arch Intern Med. 2012;172(5):405-411. doi:10.1001/archinternmed.2011.1662

From the reference:

"Patient requests have also been shown to have a powerful influence on physician prescribing behavior, and our findings suggest that patient satisfaction may be particularly strongly linked with prescription drug expenditures." (p. 408)

"While we do not believe that patient satisfaction should be disregarded, our data suggest that we do not fully understand what drives patient satisfaction as now measured or how these factors affect health care use and outcomes. Therapeutic responsibilities often require physicians to address topics that may challenge or disturb patients, including substance abuse, psychiatric comorbidity, nonadherence, and the risks of requested but discretionary tests or treatments. Relaxing patient satisfaction incentives may encourage physicians to prioritize the benefits of truthful therapeutic discourse, despite the risks of dissatisfying some patients." (p. 409)

Supplementary 1:  If you are a primary care physician I am very interested in your thoughts about how patient satisfaction scores correlate with prescriptions for benzodiazepines, opioids, and stimulant medications as qualitatively depicted in the above bar graph. 

4 comments:

  1. These patient surveys are time suckers and how many people complete them? I never do them, even though I find my providers, and those who see family members (whom I help out with their medical problems) to be competent and caring doctors. I feel guilty that I don't do these surveys because these are all great doctors, but it's hard enough getting people to their myriad appointments and I already don't get my own health problems treated promptly. I don't do the ones from restaurants to get a free meal, either. DOES ANYONE FILL OUT THESE STUPID FORMS?

    As a psychiatric patient, it bothers me when you mention some clinics aren't treating mental disorders due to these stupid surveys. How do they word that? Mental patients not welcome here? Of course not, but still, I have to wonder. Mental patients not welcome here appears to be what they mean to say. I've always gone to community clinics for health care, and they always have had a psychiatrist or two on staff, or coming by once a week, even if that's not the psychiatrist I went to. So that's surprising information to me.

    ReplyDelete
  2. Other ways for psychiatrists to avoid negative comments from patients on rating forms and doctor rating websites: do not accept any difficult or complex cases, and by all means do not treat anyone with borderline personality disorder.

    ReplyDelete
  3. For an analogy in the business world - employee satisfaction surveys. After the results are published, schedule endless meetings to beat employees over the head with them and place all of the burden on them to fix the issues. (A co-worker once remarked "Why do we have to work so hard so that we will be satisfied with managers' performance").

    In addition, do not implement any policies employees come up with except the most cosmetic ones and/or implement management inspired ones that only make things worse while they claim it is what employees wanted.

    Result: Employees give up on being honest on surveys and rate everything as good to buy themselves some relief from being badgered by management.

    End Result: Nothing ever good. Lousy or evil management continues to look great and nothing changes for the better.

    If psychiatrists appease or write off difficult patients to get good patient sat. scores, managers do not care. They still look good. Better in fact, since they can claim they are the reason for it. Plus, they don't have to expend resources on the highest users of services. It's a win-win for them.

    Welcome to my world

    Isn't it wonderful?

    ReplyDelete
    Replies
    1. The only thing more onerous than patient satisfaction surveys is the so-called employee performance review. It is generally about trying to humiliate the people doing the work by those who don't even know how to coach. I worked at a place where employees were encouraged to submit anonymous criticisms about one another that everyone had to respond to and then come up with an improvement plan. What organization would want to give a blank check to the most personality disordered among us and base their "employee improvement" based on that nonsense?

      In his book: "Get Rid of the Performance Review: How Companies Can Stop Intimidating, Start Managing - and Focus on What Really Matters" Samuel Culbert comments on this practice:

      "A case in point is the performance review fad called 360-degree feedback because it comes from a variety of sources. So does hate mail. People are told, "I can't tell you who said this," as if the alleged truth teller has no axe to grind and that the timing of the allegation is unrelated to a specific motive or problematic relationship."

      Reminds me of one of my Dilbert books:

      "What Do You call a Sociopath In A Cubicle? (Answer: A Coworker)."

      Delete