What Board Pass "Improvement Plans" Won't Tell You: Red Flags

11 min read
Residency Improvement Plan: Red Flags vs Real Fixes

Educational disclaimer: This article is for general educational purposes only and is not legal, financial, tax, employment, or contractual advice. Residency program policies, board requirements, reporting rules, and compensation-related arrangements vary by institution and state. For guidance on your specific situation, consult your GME office, specialty board, attorney, accountant, or other qualified professional.

If the plan is about improvement, why does it so often arrive wrapped in silence, euphemisms, and selective disclosure?

Because "improvement plan" is one of those phrases medicine uses when it wants to sound calm while something potentially serious is happening. Not always catastrophic. Not always sinister. But don't fall for the lazy extremes. An improvement plan is not automatically proof a residency program is unsafe. It's also not harmless bureaucratic wallpaper. Both myths are wrong.

At the practical level, these plans show up under different names: GME action plans, ACGME response plans, board pass remediation plans, performance improvement plans, quality initiatives, focused reviews. Same basic function. A program has a problem, somebody notices, and leadership has to document how they'll fix it. The catch? Labels hide severity. A "quality initiative" may be a boring workflow cleanup. Or it may be the prettied-up version of "we had repeated supervision failures and now we're under scrutiny."

I've seen programs minimize a recurring board pass problem as "curricular optimization." I've seen others describe resident safety concerns as "communication opportunities." That's not transparency. That's deodorant.

So here's the framework that actually matters. Don't fixate on the title of the plan. Judge the plan on five things:

  • governance: who owns it and who has power to change anything
  • data integrity: whether the numbers are complete, comparable, and honest
  • trainee protection: whether residents are safer after the change, not just busier
  • transparency: whether the program will tell you what happened without squirming
  • system focus: whether the fix addresses the machine, not just the people trapped in it

That's the real test. Not the branding.

Myth vs Data: "Improvement Plans Mean the Program Is Unsafe" (and Other False Certainties)

Let's kill the first myth cleanly: improvement plan = unsafe. False.

Some plans are triggered by process failures. Incomplete evaluations. Sloppy documentation. Duty-hour monitoring that exists on paper but not in practice. Those matter, but they're not equivalent to "patients are in danger and residents are unsupported." Other plans absolutely do involve high-risk issues: inadequate supervision, missed escalation, persistent board failure trends that reflect educational collapse, or a reporting culture so weak nobody says anything until the place is smoking.

Same label. Very different risk.

Myth two is just as dumb: if it's old, it doesn't matter. Also false.

Age alone tells you almost nothing. Trajectory tells you a lot. A serious issue from three years ago that led to structural reform, new staffing, better supervision, and verified improvement may be less concerning than a "minor" issue that keeps resurfacing every recruitment season in slightly different packaging. Recurring problems are the tell. Programs love to say, "That was addressed." Fine. Show me it stayed addressed.

Myth three: if they publish metrics, they must be honest. Please. Numbers can lie without being technically false.

A program can boast that 95% of faculty completed supervision modules. Great. Did supervision actually improve at 2 a.m. in the ICU when the intern needed backup? A resident survey score can rise because dissenting residents graduated, because the denominator changed, or because people got the message that candor carries consequences. That's not improvement. That's selection and silence.

Here's the evidence-based lens I use:

  • Severity: what is the potential for trainee harm or patient harm?
  • Controllability: is this mainly a systems problem or are they pretending it's just a few "struggling individuals"?
  • Recency/trajectory: is the issue resolved, or is it recurring, drifting, or worsening?

A low-severity administrative cleanup that stays fixed? Manageable. A recurring supervision failure dressed up as "faculty development"? That's a red flag with lipstick.

Red Flag #1: The Plan Doesn't Name Harm, It Names Compliance

Here's a pattern I distrust immediately: the document is full of compliance language and empty on harm.

You'll see phrases like "reinforce expectations," "enhance culture," "improve reporting cadence," "standardize review processes." Sounds polished. Means almost nothing. If a program had a real problem, the plan should say what risk it is trying to reduce. Missed supervision? Delayed escalation? Resident overload? Poor board prep tied to absent didactics and constant service bleed?

If the plan won't name the harm, there are usually two possibilities. One: leadership doesn't understand the problem. Two: they do understand it and don't want to say it plainly.

Watch for these tells:

  • no baseline incident rate or baseline board performance trend
  • no measurable outcome beyond "completion" or "attendance"
  • no timeline tied to actual risk reduction
  • no distinction between process compliance and clinical/educational outcomes

Why does this matter? Because compliance-only fixes are how programs get prettier paperwork while the underlying danger stays put. The form gets filled out. The attending still doesn't answer pages. The service is still understaffed. The resident still learns to keep quiet.

Red Flag #2: Accountability Is Vague (or Always "Somebody Else")

Medicine loves the word "culture." Sometimes appropriately. Often as camouflage.

If an improvement plan says "we are working on a culture of safety" but never identifies who must change staffing, who rewrites supervision policy, who reviews escalations, and who verifies implementation, that's not culture work. That's vapor.

Real accountability has names and authority. Program director. Department chair. Chief residents. Patient safety officer. DIO. Somebody who can actually alter schedules, add backup, change workflows, revise evaluation methods, and force follow-through.

If the owners are invisible, the intervention is performative.

Ask:

  • Who is responsible for each action item?
  • Who verifies the result?
  • What authority do they have?
  • What happens if milestones are missed?

Because if the answer is basically "we're all committed," then nobody is.

Anonymous accountability predicts stagnation. Every time.

Red Flag #3: Metrics Are Unhelpful (or the Denominators Don't Make Sense)

Here's another myth worth smashing: any numbers prove the program is improving. Wrong. Bad metrics are often worse than no metrics because they create false reassurance.

Classic example: a program reports near-perfect completion of educational modules after an intervention. Fine. But if supervision lapses, safety event patterns, or board performance by cohort don't improve, then the module completion number is trivia. Not evidence.

Other metric traps:

  • survey-only improvement with no triangulation from incident data, attrition, or rotation-specific outcomes
  • no severity weighting, so tiny issues and serious ones blur together
  • denominator drift, where fewer reported events are celebrated even though fewer people are reporting or fewer opportunities are captured
  • averaged metrics that hide one disastrous rotation beneath several quiet ones

The good stuff looks different. You want process and outcome measures. Baseline and follow-up. Clear denominators. Data broken down across rotations, sites, and training levels. If PGY-1s improved but seniors are still drowning, that matters. If one hospital site is fine and the night float system is a dumpster fire, that matters too.

I've seen institutions celebrate a drop in safety reports right after introducing a new reporting workflow. Leadership called it progress. It wasn't. The reporting system had become harder to use, and residents stopped bothering. That's not lower risk. That's lower visibility.

If completion shoots up while meaningful outcomes barely move, investigate. Don't applaud.

Red Flag #4: The Plan Targets People, Not Systems (and Trainees Pay the Price)

This is where bad programs reveal themselves. They call it remediation, but what they mean is redistribution of blame.

Instead of fixing workflow, they pressure residents to "be more resilient." Instead of adding supervision, they lecture interns on communication. Instead of staffing appropriately, they create punitive schedule tweaks that increase service burden under the banner of accountability. I've seen residents pulled into mandatory professionalism coaching when the real issue was absent backup and impossible cross-cover volume. Cheap move. Common one too.

System fixes are less glamorous and far more effective:

  • redesigning workflow so escalation is clear and fast
  • guaranteeing attending or senior backup at known bottlenecks
  • tightening handoff structure
  • reviewing incidents for actionability, not just optics
  • protecting reporting pathways from retaliation

Use a simple trainee impact checklist:

  • Did duty-hour or coverage changes actually reduce strain?
  • Is escalation safer and faster?
  • Can residents raise concerns without getting labeled?
  • Did the plan reduce risk, or just move it onto trainees?

If the burden of "improvement" lands mostly on residents, the plan is weak. Period.

System Fixes Beat Scapegoating

How to Ask About Improvement Plans Without Getting Spin: Evidence-Based Questions to Recruiters, Residents, and Faculty

You don't need a hostile tone. You need sharp questions.

Start with these:

  • What problem triggered the plan, specifically?
  • What was the baseline data?
  • What changed in day-to-day supervision?
  • Who owns the intervention?
  • How is success being verified?
  • What timeline was set, and what has already changed?

Then get protective. Ask about the resident experience, not the brochure version.

  • What are the escalation routes when supervision is unavailable?
  • What coverage exists during predictable bottlenecks?
  • What are the faculty-to-resident ratios on the toughest rotations?
  • How are concerns documented?
  • How often do residents receive a closed-loop response after reporting a problem?

My favorite two questions are the ones most programs hate:

  • What would make you change your mind that the plan is working?
  • What metric got worse after the plan started, and what did you do about it?

Those questions force actual thinking. Spin collapses fast when people have to admit uncertainty, setbacks, or course correction.

And triangulate everything. Compare the official explanation with what residents say privately and with what policies actually do. If leadership says supervision improved but residents still describe "hope the attending answers" nights, trust the residents. If the handbook says concerns are confidential but every trainee can identify who got iced out after speaking up, trust the pattern.

Closing Reminder: Improvement Plans Can Be Real, But Only If They Produce Verified, Trainee-Protective Change

Here's the reminder. Don't anchor on the existence of an improvement plan. That's amateur-hour thinking. Anchor on the quality of the fix.

The red-flag triad is simple:

  • vague outcomes
  • weak accountability
  • metrics disconnected from real risk reduction

A good plan names the harm, assigns power, measures what matters, fixes systems, and makes trainees safer. A bad one beautifies compliance while residents absorb the cost.

So ask for the underlying documentation. Ask what changed on the ground. Ask residents what got better and what stayed broken. Improvement is real only when it's verified. Everything else is branding.


Keep reading

View more