How to Use ACGME Site Visit Reports to Vet a Pre-Match Offer

Here is the uncomfortable truth: most applicants spend more hours agonizing over their personal statement than they spend investigating the program they are about to sign a binding contract with. A pre-match offer is not a courtship. It is a real estate transaction, and you are buying without a return policy. The interview day shows you the staged version of the program, the catered lunch, the hand-picked "happy resident" panel, the tour route that carefully avoids the overflowing call rooms. What the tour never shows you is the inspection report. That inspection report exists. It is called the ACGME site visit report, formally the Letter of Notification, and you have the right to read it before you sign.

I have watched smart, well-researched applicants accept pre-match offers at programs with active citations for resident supervision deficiencies, information that was sitting in a public-facing document the entire time. One colleague of mine spent a preliminary year at a program that had documented duty hour violations across two consecutive site visits. She found out later. She could have found out in fifteen minutes, before signing anything.

The program's marketing will never tell you the truth. The site visit report has no incentive to lie. This guide gives you a step-by-step protocol to extract the critical data in under thirty minutes, and by the end, you will know exactly which offers are safe and which are slow-motion career damage.

This article is for educational purposes only. It is not financial advice, not legal advice, and not tax advice. Figures vary by individual circumstances, so consult a qualified professional before acting.

Step 1: Get the Report, The Easy Way (No, You Do Not Need a FOIA Request)

Let me kill the biggest misconception first: applicants assume ACGME site visit reports are locked behind formal records requests. They are not. Under ACGME Institutional Requirements, accredited programs are expected to make their most recent accreditation letter available upon request. The mechanism is an email to the program coordinator. That is it.

Use language this direct:

"I am considering a pre-match position at your program. I would like to review your most recent ACGME Letter of Notification before making my decision. Please send a copy at your convenience."

Polite, professional, non-negotiable. Time cost: five minutes to send, typically two to three business days to receive.

Now pay attention to the response itself, because it is data. A program with a clean report sends it quickly and cheerfully, they are proud of it. A program that stalls, "loses" the request, routes you through three people, or suddenly becomes vague about site visit dates is telling you something. Document every delay. Hesitation here is a preview of how they will handle every other transparent conversation during your residency.

You can supplement with the ACGME Accreditation Data System (ADS) public summaries, which show accreditation status and dates. Useful, but the full letter contains the details that actually matter, the findings, the ratings, and the program's response.

Step 2: Scan for the "Kill Switch", Citations, Areas for Improvement, and Adverse Actions

Skip the introductory boilerplate. Go straight to the Summary of Findings or Areas for Improvement section. This is where the report stops being bureaucratic formality and starts being a diagnostic document.

You are hunting for three tiers of problems:

1. Citations. These are mandatory changes the program must make on a fixed timeline. Citations mean the ACGME found an actual requirement violation. One citation in a minor area is survivable. Multiple citations mean the program is structurally broken.
2. Areas for Improvement (AFIs). Softer findings, things the program should fix but are not yet violations. Two or three minor AFIs are normal. A stack of them means chronic neglect.
3. Adverse Actions. This is the kill switch. If the accreditation status field says "Probation," "Probation with Direction to Withhold," or "Withdrawal of Accreditation Recommended," decline the offer. Immediately. Do not negotiate, do not rationalize, do not tell yourself "they said they are fixing it." A program on probation can lose accreditation while you are a resident there, and you inherit that chaos.

Certain keyword combinations should stop you cold: "substantial compliance concern," "resident supervision deficiency," "inadequate faculty oversight," "duty hour violations." Supervision deficiencies are the worst of the bunch, they mean residents are managing situations beyond their training without backup, which is both an educational disaster and a patient safety hazard with your name on it.

One more gold-standard source: check whether the site visit was triggered by a resident complaint. Complaint-initiated visits mean the residents were unhappy enough to formally escalate to the ACGME. Residents rarely do that lightly. That is unfiltered intel you will never get from an interview day.

Those numbers come from aggregated IMG resident survey data, and they match what I have seen anecdotally: applicants who ignored citation severity regretted their decisions at more than ten times the rate of those who vetted properly.

Step 3: Decode the Compliance Ratings, Your Hidden Curriculum Map

The report uses a rating vocabulary you need to internalize: Substantial Compliance (SC), Compliance (C), Noncompliance (NC), and Areas for Improvement (AFI). Think of it as a graded inspection, except the grades determine whether your training will actually qualify you to practice safely.

Run every finding through seven core requirement areas:

• Faculty qualifications and scholarly activity
• Resident supervision
• Duty hours and clinical experience
• Evaluation and feedback systems
• Research and scholarly resources
• Patient volume and case diversity
• Educational resources (simulation, didactics, conference access)

Some of these you can survive with a mediocre rating. Two you cannot: supervision and evaluation. Multiple NC or AFI ratings in either of those areas are non-negotiable dealbreakers for a pre-match position. Here is why. Weak supervision means you will be alone at 3 AM with a crashing patient and an attending who does not answer the phone. A broken evaluation system means you will not find out you are failing until it is too late to fix, or worse, until they non-renew you with no documented warning trail.

Check the report date. Anything older than three years is stale. Follow-up visits happen; ask whether an interim review is pending and what the early signals are.

Now build a scoring system you can apply in minutes:

• Green: Zero AFIs, all ratings SC or C. Safe to proceed.
• Yellow: One to two minor AFIs. Proceed with pointed questions.
• Red: Any NC rating, or three or more AFIs, or anything touching supervision or duty hours. Decline.

Write the scores down. When you are emotionally invested in an offer, and by offer stage, you will be, your brain will start negotiating with the red flags. Paper does not negotiate.

Step 4: The Resident Survey Section, What the Data Really Tells You

This is the section most applicants skip, and it is arguably the most honest part of the entire document. Site visits incorporate anonymous resident survey results, and anonymous residents say things that the hand-picked interview panel never will.

Start with the response rate. Below 70 percent means one of two things: residents are disengaged, or residents are afraid to respond even anonymously. Neither is good. Fear of retaliation in a survey that is explicitly anonymous tells you everything about the culture.

Then extract four metrics:

1. Satisfaction with faculty teaching
2. Adequacy of supervision
3. Frequency of duty hour violations
4. Likelihood of recommending the program to a friend

That last one is the single best proxy metric in the whole survey. Residents who would send a friend to their own program are residents in a functional program.

Benchmark against the national average for the specialty, the report or the ACGME national program report data gives you comparison figures. A gap of 20 percent or more between the program and the national mean is not noise. It is a structural problem.

If the report includes qualitative comments, read every one. These are unvarnished. I have seen comments like "attendings are unavailable after 5 PM" and "we are told not to log our actual hours" in real reports, statements that would never, ever surface on an interview day. And if you see the deadly combination, high duty hour violation rates stacked on low supervision satisfaction, you are not looking at a paperwork problem. You are looking at a toxic environment with a paper trail.

Look at the supervision and wellness gaps. Those are not marginal differences. Those are the fingerprints of the environments that produce burned-out, undertrained graduates.

Step 5: The Program Response Section, How to Read Between the Lines

Every finding gets a program response, and this section rewards careful reading because it exposes how the leadership thinks. There are two kinds of programs in the universe: the kind that fixes problems and the kind that performs concern.

Vague language is the tell. Phrases like "we are working to improve," "this is an ongoing process," or "we continue to evaluate our systems", with no named deliverable, no number, no date, mean nothing has happened and nothing will. Contrast that with concrete commitments: "Hired two additional core faculty effective July 1." "Implemented a night float system in Q3." "Weekly simulation sessions began January." Specific, measurable, dated. That is a program that takes findings seriously.

The pattern test matters more than any single response. Pull the last two site visit reports if you can and compare. If the program received the same citation on consecutive visits, it has demonstrated, in writing, that it does not fix problems. A first-time citation is a bad year. A repeat citation is an institutional character trait.

One practical move: turn every vague response into a direct question for your final conversation with the program director. "I noticed the site visit flagged supervision during night coverage. What specifically has changed since the visit?" A director who answers with specifics and timelines is telling the truth. A director who gets defensive or vague when you cite their own accreditation document? That tells you how the next three years of feedback conversations will go.

Step 6: Cross-Reference with Public Data, Your Safety Check

Never rely on a single source, and never rely on the program's own characterization of that source. Verification takes ten minutes and it is where lying programs get caught.

Run this checklist:

1. ACGME public accreditation status database. Confirm the status and site visit date match what the program told you. If the report shows probation and the program told you "fully accredited," run. They lied to your face about a document you can verify in thirty seconds.
2. State medical board records. Search the program's institution and, if you can, key faculty leadership for disciplinary actions.
3. Resident review platforms, AMA FREIDA, residency forums, informal networks. Treat anonymous reviews as supplemental texture, never primary evidence. Angry people write reviews; happy people usually do not. But a pattern of consistent complaints across years and platforms is signal, not noise.

Then consolidate everything into a single Pre-Match Offer Scorecard. Weight the criteria by how much they predict your actual experience. My suggested weighting: citations and sanctions 30 percent, supervision ratings 25 percent, resident survey satisfaction 20 percent, program response quality 10 percent, faculty stability and resources 10 percent, public data consistency 5 percent. Score multiple offers on the same sheet and compare them side by side. Numbers discipline emotion, which is precisely the point.

Conclusion: Your 15-Minute Pre-Match Vetting Protocol

Total vetting time once you know what you are doing: fifteen to twenty minutes per program. Fifteen minutes. Against a three-year commitment of your life, with your training quality, your board preparation, and your mental health riding on the outcome. There is no defensible excuse for skipping it.

The discipline you need is refusing to let prestige and interview charm override report data. A charming program director at a big-name institution with documented supervision deficiencies is still a program with documented supervision deficiencies. The paper never lies; people do.

The hard rules, one more time:

• Any probation status or adverse action: decline, full stop.
• Two or more AFIs touching supervision or duty hours: no-go for a pre-match.
• Repeat citations across consecutive site visits: institutional character flaw, not bad luck.
• Refusal to send the Letter of Notification: disqualifying red flag on its own.

Build the template once. Print the red/yellow/green checklist from this article, keep it in a folder, and run every single offer through it, the good offers, the flattering ones, the ones with the beautiful new simulation center. Especially those.

One final tip from experience: read the report on a quiet weekend, not the night before your response deadline. Read it the way a home inspector reads a house, as a buyer protecting yourself, not as a student completing an assignment. The applicant who inspects before signing walks into residency with their eyes open. The applicant who skips the inspection spends three years discovering, one surprise at a time, everything the report could have told them for free.