Skip to main content
ClinicalSim
Back to Insights
7 min read

What a remediation toolkit gives a program, and what it leaves to you

Half of 267 family medicine program directors said a toolkit would help most. In 2023, 62.9% said under a quarter of core faculty had remediation training.

VH

Vinod Havalad, MD

Chief Clinical Partnerships Officer, ClinicalSim

Ask a program director what would make remediation easier and the answer is rarely more theory. It's something to reach for on the afternoon a struggling resident lands on their desk: a template for the plan, a script for the first conversation, a clear answer on who does what. Half of the family medicine program directors in one national survey asked for that, and in September 2023 the ACGME released a free course that fits the description.

The toolkit is the easy half of the request. The harder half is a set of decisions that only a program and its sponsoring institution can make, and no national body has made them on a program's behalf.

What program directors asked for

The CERA survey of family medicine program directors ran in September and October 2017, and 267 of 503 directors responded, a 53 percent response rate (Frazier et al., 2021). Remediation was routine work: 93 percent of responding programs had remediated at least one resident in the previous three years.

Asked which tool would most improve remediation, 50 percent chose an accessible remediation toolkit. Formal remediation recommendations from national family medicine organizations came second at 20 percent, and on-site faculty development and training came third at 19 percent. The barriers the directors named line up with that answer. The two most common, each cited by 22 percent, were a lack of documented evaluations to trigger or guide remediation and a lack of faculty knowledge of and skills with effective remediation strategies.

The authors were blunt about why programs were improvising. "Neither the ACGME, the Association of Family Medicine Residency Directors (AFMRD), nor the Society of Teachers of Family Medicine (STFM) have established formal remediation standards or guidelines," they wrote, and "there are currently no specific guidelines or recommendations on resident remediation in the ACGME Program Requirements" (Frazier et al., 2021).

What a remediation toolkit is

A remediation toolkit is a shared set of methods, templates, and worked cases that a program uses to identify a struggling resident, write a plan, coach toward it, and reassess. The ACGME Remediation Toolkit, released in September 2023, is a free online course of 11 modules in two parts, "A Systematic Approach" and "Case-Based Coaching," with case studies, templates, and CME credit, and it covers remediation of professionalism, communication, clinical reasoning, and organization and efficiency (ACGME, 2023).

What changed after 2017, and what didn't

The toolkit half of the 2017 request now exists, at no cost, from the accreditor. The standards half has barely moved. The ACGME Common Program Requirements that took effect July 1, 2026 contain one numbered requirement on the subject: the program director or a designee, with input from the Clinical Competency Committee, "must develop plans for residents failing to progress, following institutional policies and procedures" (Section 5.1.e). The word "remediation" doesn't appear in any numbered requirement, only in the explanatory background text beside that one and in the FAQs.

So the content of a remediation plan, the process around it, and the point where remediation becomes an adverse action still belong to the program and its sponsoring institution. A course can't settle those, because it doesn't know your institution's due process policy, who sits on your committee, or what your evaluations recorded.

The faculty half of the problem

A second CERA survey on remediation, fielded from September 26 to October 30, 2023, analyzed responses from 271 family medicine programs, a 37.9 percent response rate (Rebedew et al., 2024). Most program directors reported training of their own, with 71.8 percent describing it as moderate to substantial. The faculty around them hadn't caught up. In the same survey, 62.9 percent of program directors said fewer than a quarter of their core faculty had specific remediation training, and only five programs, 1.9 percent, said all of their core faculty had it.

The timing matters for how to read that number. The survey opened a week after the ACGME announced its toolkit, so the faculty figure is a baseline taken at launch, not a verdict on whether the course works. What it does show is the size of the job. A toolkit completed by the program director trains one person, and the 2017 barrier list named faculty knowledge, not director knowledge.

Professionalism stayed the most common reason for remediation in both surveys, at 45.1 percent in 2023 against 38.1 percent in 2017, a difference that did not reach statistical significance (P=.10) (Rebedew et al., 2024). Both studies cover family medicine only and rest on program directors' own reports, so they're the best available description of one specialty rather than a national rate.

Four decisions a toolkit leaves to the program

Published guidance does go further than "write a plan." In 2019, Chou and colleagues set out 26 guidelines on remediation in medical education: 20 dos and don'ts, each graded strong, moderate, or tentative by the evidence behind it, and six open questions (Chou et al., 2019). Read alongside Kalet, Guerrasio, and Chou's twelve tips for building a remediation program (Kalet et al., 2016), four of them describe decisions a program has to make before the first resident needs them. Both papers cover medical education broadly, medical schools included, so treat them as guidance for residency programs rather than residency-specific findings.

Who coaches and who decides

Chou's guideline to "separate the individuals conducting the remediation process from those who determine the outcome of remediation" carries a tentative rating, and Kalet's seventh tip makes the same point: "Separate remediation coaching from summative judgment roles." A small program may not have the faculty to split the roles cleanly, which is the reason to settle it in a written policy before a case arrives rather than in a scramble after.

Which institutional process the plan sits inside

Ensuring due process carries a moderate rating in Chou's guidelines. The 2026 requirements tie the plan to institutional policy (Section 5.1.e) and tie any suspension, dismissal, non-promotion, or non-renewal to the sponsoring institution's grievance and due process procedures (Section 2.6.h). A program that knows where remediation ends and an adverse action begins, and who signs off at each step, can tell the resident in the first meeting.

What evidence starts it

Collecting relevant data from multiple sources across case content is one of the guidelines Chou rates strong. It's also the barrier 22 percent of program directors named in 2017: no documented evaluations to trigger or guide remediation (Frazier et al., 2021). A toolkit can hand a program a better template. It can't backfill observations that nobody wrote down, which is why what the file holds when the committee meets matters more than the form it's written on.

What counts as done

Chou rates "Don't merely give more time, repeat the learner experience, give general or vague advice, or just 'teach to the test' without additional support" as strong, and following up with learners after the presumed end of remediation as moderate. Kalet's eleventh tip asks programs to set clear expectations for success for all parties in a defined time frame. Each of those means deciding in advance what reassessment will look like and who will judge it, the part of a communication remediation plan most likely to be left vague.

What nobody knows yet

The honest limit on all of this sits in Chou's own paper: "We know very little about long-term outcomes of remediation programs" (Chou et al., 2019). Two of its open questions are the best blend and duration of remediation, and which measures predict that a learner will need it. A program writing its own remediation policy is working from graded expert consensus and a small evidence base, and it's better to write the policy knowing that than to assume a toolkit settled it.

Where ClinicalSim fits

ClinicalSim bears on two of the four decisions above: what evidence starts remediation, and what reassessment looks like. ClinicalSim is a voice-based AI patient simulation platform for practicing and measuring clinical communication.

Residents hold spoken conversations with AI patients, and each encounter produces rubric scores with transcript evidence for faculty review. That report is formative evidence for a faculty judgment. It doesn't decide whether a resident has completed remediation, and it doesn't replace the committee, the coach, or the institution's process.

AI patient practice also complements standardized patient encounters rather than replacing them. A trained SP and a human debrief carry things a simulated encounter doesn't, including the SP's own read of how the conversation felt. The case for AI patients is more practice between the encounters a program can staff, which is where faculty hours run out first. The communication remediation page describes the workflow, and the example encounters show recordings, transcripts, and reports so you can judge the output yourself.

The toolkit program directors asked for in 2017 now exists. A policy, a division of roles, and a record were never going to come in a course, and they're still the program's to build.

References

  1. Frazier W, Wilson SA, D'Amico F, Bergus GR. Resident remediation in family medicine residency programs: a CERA survey of program directors. Family Medicine, 53(9), 773-778. 2021. doi:10.22454/FamMed.2021.546572
  2. Rebedew D, Bell T, Waheed A, Azhar E. Family medicine resident remediation compared across two CERA studies. Family Medicine, 56(10), 641-649. 2024. doi:10.22454/FamMed.2024.375189
  3. Chou CL, Kalet A, Costa MJ, Cleland J, Winston K. Guidelines: the dos, don'ts and don't knows of remediation in medical education. Perspectives on Medical Education, 8(6), 322-338. 2019. doi:10.1007/s40037-019-00544-5
  4. Kalet A, Guerrasio J, Chou CL. Twelve tips for developing and maintaining a remediation program in medical education. Medical Teacher, 38(8), 787-792. 2016. doi:10.3109/0142159X.2016.1150983
  5. Accreditation Council for Graduate Medical Education. Enhance the success and development of struggling learners with the ACGME Remediation Toolkit. ACGME Newsroom. 2023.
  6. Accreditation Council for Graduate Medical Education. ACGME Common Program Requirements (Residency), effective July 1, 2026. Accreditation Council for Graduate Medical Education. 2026.