The High Cost of Public Reporting

The High Cost of Public Reporting

In an age where big data is king and doctors are urged to treat populations, the journey of one man still has much to tell us. This is a tale of a man named Joe.

Joseph Carrigan was a bear of a man – though his wife would say he was more teddy than bear.  He loved guitar playing,  and camp horror movies.  Those who knew him well said he had a kind heart, a quick wit and loved cats.

I knew none of these things when I met Joe in the Emergency Department on a Sunday afternoon.  I had been called because of an abnormal electrocardiogram – the ER team was worried he could be having a heart attack.  Not able to make sense of the story on the phone, I was in to try to sort it out.  Joe was gruff, short with his answers – but clearly something just wasn’t right.   He was only 54 but had more problems than the average 50 year old.   Progressive calcification of his aortic valve  some years ago  had caused intolerable shortness of breath resulting in  replacement with an artificial valve. Longstanding diabetes had resulted in kidney failure and dialysis,  and most recently abnormal liver tests had  revealed the presence of the early stages of cirrhosis from hepatitis C.  Yet Joe continued to live an active life – with only a tight circle of family and friends aware of the illnesses beneath the surface.

But on this particular day it was readily apparent Joe was not well.  It didn’t take long to figure out that Joe had an infection somewhere.  He had come in feeling hot at times, but having chills at others.  Review of his ECG, stored telemetry in the ER revealed a conduction disturbance not infrequently seen called a left bundle branch block, as well as a rhythm disturbance called atrial fibrillation , but no evidence of a heart attack  that had prompted the ER to call me.   I told Joe and is anxious wife that he needed to be admitted to the hospital to find where the infection may be coming from.

Joe had a number of places he could be harboring an infection.   While dialysis maybe one of the modern marvels of the world, the concept is fairly crude. In the absence of functioning kidneys an artificial machine does the work of the kidneys. Via large catheters the patient’s blood is removed, circulated through the machine and then returned to the patient.  The flow required to circulate enough blood over a course of three hours involves creation of large conduits between arteries and veins, or placement of artificial grafts.   Every access of these vessels with dialysis sessions  carries a risk of introducing bacteria into the bloodstream, making infections a common event in this population.  Complicating matters further, Joe had an artificial heart valve,  which lacking the natural immunity of native heart valves,  are especially prone to seeding by bacteria.

I told the admitting team that if no other source of infection became immediately obvious he would need an ultrasound to more closely examine his valve. That night I was called by the overnight resident in the hospital because Joe had a low heart rate. He felt fine,  and his blood pressure was OK .  I stopped a heart rate lowering medication that he had been on hoping this may be the cause.   The next morning a review of his electrocardiogram and recorded telemetry demonstrated an ominous finding – episodic heart block.   The heart’s four chambers are segregated into two small upper chambers that contain the pacemaker function of the heart and two lower chambers  that are the powerful mechanical pumps which circulate blood.   The upper chambers are electrically insulated from the lower chambers except for narrow specialized bundles of tissue that function as electrical cables.   The specialized conduction fibers form an intricate lattice that allows the normal heart to contract  in less than 100 ms.  The weak point is a narrow isthmus in close  proximity to the  aortic valve that the electrical bundles must navigate near their origin.   In Joe’s case, the electrical bundles were conducting in a stuttering fashion because bacteria was eating away at precious cardiac tissue surrounding the artificial valve.

There is only one treatment for this: surgery.  John needed a surgeon to open his chest, take out his infected  aortic valve, wash out the abscess and put another valve  in its place .

I called the surgery team immediately –  Joe was clearly a high risk case.   The  presence of kidney disease, liver disease, and prior open heart surgery were all independently high-risk markers.  Joe of course had all three.  Yet, he was an active functional 54-year-old. What was the other option? Let him die?  My initial conversation with the surgeon was a positive one, and surgery was scheduled for the following day.

The following day brought a decidedly different tone.   There was a brief discussion about a conversation with the hepatology team having changed the surgeon’s mind.  A prediction score for patients with liver disease suggested there was a 50% chance he would be dead in 6 months regardless of his current life threatening cardiac abscess.  That score seemed to be an overestimate, and hepatitis C is now a treatable illness but regardless, I pushed back and responded that the chances he would be dead in 2 weeks with his current condition was 100%.  After some more parrying back and forth – the real reason for the cold feet emerged.  Outcomes of cardiac surgery are publicly reported for all institutions and surgeons nationally, and in the state of Pennsylvania.  After discussing the case with the other surgeons at the institution, the decision at this hospital had been made: Joe had too high a chance of making the institution look bad.

How did we get here?

Public reporting

The desire for public reporting arises from an attempt to broadcast value to a public eager for information.  The Institute of Medicine’s seminal report in 1999 suggesting 98,000 patients die due to preventable medical errors every year added a sense of urgency and necessity to the push to grade providers.

Public reporting actually began more than thirty years ago – in 1984 – when the Health Care Financing Administration (HCFA), now known as the Centers for Medicare and Medicaid Services (CMS), began to publicly report the hospital mortality rates of Medicare patients.  The agency identified 269 hospitals that were outliers with regards to death rates. Although the analysis attempted to control for a variety of risk factors, it was heavily criticized and eventually HCFA stopped publishing the data.

There was no turning back though. New York state and Pennsylvania followed suit and started publicly reporting cardiac surgery outcomes.  The group in charge of reporting in Pennsylvania was the Pennsylvania Health Care Council (PHC4) -created by the Pennsylvania General Assembly with the charge of improving the quality of care and restraining health care costs.

As the HCFA learned, reporting outcomes is a complicated business.  Reporting outcomes  relies heavily on the ability to risk stratify patients.  The PHC4 struck on what is now a common model – calculate the expected mortality of each patient based on who they are and how they present and compare this to the actual reported mortality.  A number of factors are considered, and each factor is weighted with regards to its impact on mortality with surgery.

Figure 1 Clinical Predictor data table, Calculating expected mortality

The final data is then presented for the public’s perusal in an easy to understand table with actual and expected mortality for every hospital and surgeon in Pennsylvania.

The figure below demonstrates the results of three large hospital systems in the Philadelphia region.

Figure 2 . Observed/Expected Hospital mortality

Teaching to the test

Proponents of public reporting will point to improved outcomes in the era of public reporting.  In Pennsylvania, for instance, hospital mortality for Bypass (CABG) surgery dropped from 3.2% to 1.5%, and for Valve surgery dropped from 5.2% to 2.7%.

Figure 3. Cardiac surgery in-hospital mortality

The only thing more impressive than this is the drop in bypass procedures done statewide between 2000 and 2015 – which reflects an almost 60% drop from 20,029 procedures to 7,962 procedures.

Figure 4. Volume of cardiac surgery

An optimistic conclusion to draw from the data is that there are fewer unnecessary procedures being performed and those that are being done are of higher quality in a safer environment. The more troubling explanation is that surgeons are operating less, and improved mortality relates to avoiding high risk patients.

I spoke to a cardiac surgeon who had practiced in the public reporting era in New York State to ascertain his thoughts.  He told me that “without a doubt” this was a consideration that impacted who he and his colleagues would take to the operating room.  He spoke of how surgeon’s would “play the game” to improve their numbers by not necessarily denying the sickest patient, but rather waiting them out.  He gave me an example.

One of the stronger clinical predictors that impacted expected mortality was cardiogenic shock.  Cardiogenic shock refers to patients who suffer a heart attack so severe that their entire cardiac function is compromised to the point that the heart is unable to deliver an adequate amount of blood flow to vital organs such as the kidney, liver and brain.  A common approach by surgeons was to place these patients in the cardiac critical care unit or transfer the patient – the patients that survived a week were offered surgery.  The cold calculus makes sense – the expected mortality of the patient continued to be high as the patients were still labeled as cardiogenic shock – but clearly waiting allowed selection of a lower risk group of patients.

I despaired after hearing this about finding published data to support what I had heard, as I frequently find datasets simply aren’t granular enough to represent clinical practice. In this particular case I was rescued by the SHOCK registry that compared patients presenting in cardiogenic shock in NY patients and Non-NY patients.

Figure 5. Differences in treatment of Cardiogenic shock patients in NY and nonNY patients

The results are stunning.  As highlighted in the above table – the time to cardiac surgery in patients presenting with a heart attack and shock in New York State was different by almost 4 days!

The footprint of risk aversion is found even in the published data supportive of public reporting.  Peterson et. al, found declining CABG mortality in NY state with no apparent decrease in access, but troublingly, could not elucidate a mechanism for the decline in mortality.  If the point of profiling hospitals and surgeons as good or bad was to direct more patients to high performing centers, NY state officials found no evidence of migration of patients from high to low mortality hospitals.

Surveys of cardiac surgeons bear out that enmasse,  public reporting has markedly altered practice based on public reporting primarily by denying patients surgery.

Figure 6. Cardiac surgery survey results of public reporting

It used to be that a decision on surgery was between surgeon and patient.  Risks were outlined, and a decision arrived at.  The patient and doctor were in it together. Surgeons operated on high risk patients as long as they felt comfortable the patient and family understood the risks.  This construct exists no more.  Especially in an era where surgeons are employed by health care systems, the surgeon is now beholden to masters that never step into hospital rooms.  Surgeons with high mortality rates that make the institution look bad face serious repercussions, and even worse, put future employability at risk. Shared decision making is a joke – not because decision making isn’t shared but because the shared decision is between surgeon, risk score, and hospital system – the sickest patients don’t have a choice anymore.

Back to Joe

And so it was with Joe. Faced with certain death, he wanted to live, but I could not find a surgeon at my institution to operate on him.  The hyperefficient health care system moved quickly in this case.  The plan from the CCU team was now hospice/palliative care.  I couldn’t stomach it.  I told Joe that I was going to find a surgeon who would give him a shot.  So I called a center that did the most valve surgeries in the city.  This wasn’t the first time in my years in practice that a patient of mine had been turned down by a surgeon at a local institution.  Smaller volume centers are even more susceptible to risk aversion because their smaller volume amplifies the effects of bad outcomes.   The largest center in the city had bailed my patients out before from this predicament.

This time was different.  Unbeknownst to me, the academic nationally renowned busiest center in the city had been taken to task in the just published Pennsylvania public report  because they had been found to have worse than expected mortality.   The expected mortality was 1.2% – 4.1%, and the observed mortality was 4.3%.  Of 345 patients who underwent bypass surgery 15 died – one fewer death would have put the center in the expected range.  To rub salt in the wound, the local paper ran a story on the report and quoted a competing health system’s surgeon as noting the difference could relate to a minimally invasive surgery they did more of.  Not mentioned was the fact that the smaller competing health system routinely sent their sickest, most complex patients to the larger academic center.

So, the answer again was no.  Undeterred, I called Johns Hopkins next.  The cardiac surgeon patiently listened to my story – and inquired why no hospital in the city would operate on him.  I told him about public reporting, and he in turn told me about Maryland’s global payment system.  Maryland hospitals were not paid per admission anymore, they were paid a per capita amount related to the number of patients attributed to them.  The positives are that hospitals are incentivized to set up systems to keep patients out of hospitals.  The downside is that they have a powerful disincentive to take on a complicated high risk out of state patient like Joe.  I was told bluntly that Maryland was not paying for this.

I discussed the case with a prominent cardiothoracic surgeon who said explicitly –

“Politically impossible to do this case… Honestly, the big picture: he is a casualty of the public reporting system we have in the US and Pennsylvania where risk aversion is always with us.  It’s kind of sad.  There are consequences to all the decisions society makes”

Consequences.  Trade-offs.  This is decidedly not what the public hears.   The public hears things like the ‘triple aim’ – improve patient experiences of care, improve the health of populations, and reduce the per capita cost of health care.  You can have your cake.. and eat it too!  But there is a cost to all this, and it is a cost borne by our sickest, most vulnerable patients.

When CMS announced a policy in 2006 that attempted to restrict coverage of weight loss surgery to centers of excellence (COE), a study noted the unintended consequence of trying to make the surgery safer was a reduction in the proportion of minority patients receiving the surgery.  I imagine that had Joe been on the board of trustees of the hospital he would have a different set of options.

Figure 7. Proportion of minority patients offered bariatric surgery

There are so few of these patients relative to the total that they won’t move the needle when it comes to numbers population health devotees care about like life expectancy and overall cardiac mortality.  But the impact of this culture shift extends beyond the smattering of patients affected.

America has long been the envy of the world when it came to innovative surgical techniques.  The landscape for much of American history has consisted of brash physicians willing to push the envelope in dying patients with impossible odds.  Bennie Solis was one such 3 year old dying of an irreversible liver disease when he was operated on by Thomas Starzl in 1963.  Starzl thought he had perfected the technique of transplantation in dogs before attempting the feat – but he was wrong.  Bennie bled to death on the operating table, his damaged liver no longer able to make substances that would clot blood.  Starzl and the surgical team were devastated, but the lessons learned with Bennie’s death increased the chances of success for the patients that followed.  This is true of the history of every new surgical procedure attempted.  Innovation requires risk taking not risk aversion.  It is difficult to imagine a man like Starzl taking on the sickest of the sick patients at Johns Hopkins today.

The sad part is that the age of penury driving this behavior is one where overall health care spending continues to accelerate to the tune of 3 trillion dollars annually.  Our health care overlords may save some dollars on Joe, but won’t blink when spending billions of dollars on health care accountants, data entry clerks, hospital coding specialists, and any number of low yield primary care preventions geared to the worried well.

Some think the solution is simply better risk adjusting, or exclusions for centers performing at the frontiers.  Perhaps.  Or throw the whole system out and focus on the rotten apples among us.  I don’t know.  I do know that however well intentioned the practice of public reporting may be, the consequences may be severe.

I couldn’t find a surgeon who would operate on Joe.  So he died.

He never made it home to play his guitar.

The pictures and the story are presented with the permission of Joe’s wife, Debra.  Ever gracious, she hoped his story would teach us something.

Here’s hoping it will.

Anish Koka is a cardiologist in Philadelphia.  He can be found on twitter @anish_koka