The IM Bootcamp Assessment

Milestones, the CCC, and your ILP:
how you are actually assessed

Every resident is evaluated continuously, discussed semiannually by a committee, and rated on a national developmental framework — and most residents go years without anyone explaining the machinery. This session opens it up: what the Milestones are and are not, what the Clinical Competency Committee is actually required to do, the conversation you should expect every six months, and the individualized learning plan the requirements say you should be building with your faculty — not receiving from them.

Format explainer + discussion Time 45 minutes Leader program director or APD Group whole cohort Competencies practice-based learning · professionalism

Why this session

Assessment anxiety thrives on opacity. The intern who imagines a single bad rotation ending their career, the resident who has never read their own milestone report, the third-year who discovers the learning plan was supposed to be theirs — all are artifacts of machinery nobody explained. The machinery is public, national, and genuinely designed in the resident’s favor; forty-five minutes of explanation converts it from surveillance into a tool.

The Milestones — a developmental map, not a grade

The ACGME Milestones are the national framework for describing a resident’s development — in the ACGME’s own words, “a framework for the assessment of the development of the resident in key dimensions of the elements of physician competency”1 — organized in internal medicine as twenty-one sub-competencies across the six domains: patient care (history, exam, clinical reasoning, inpatient and outpatient management, digital health), medical knowledge, systems-based practice, practice-based learning and improvement, professionalism, and interpersonal and communication skills.

Each sub-competency is described at five developmental levels with behavioral anchors — a trajectory from novice toward expert, not a report card. Three properties matter for your sanity: the levels are developmental, not tied to training year — a new intern is supposed to sit at the early levels, and a low-level rating in July is a starting point, not a deficiency; movement over time is the signal, exactly like the in-training exam’s trajectory logic in the boards session; and the ratings exist to aim your learning — which is why this bootcamp’s diagnostic OSCE is blueprinted against the same domains on day zero, recording observable behaviors your program’s own instruments translate into Milestones over time.

The Clinical Competency Committee — what it must do

The Clinical Competency Committee is not optional and not local custom — the program requirements mandate it, and mandate its duties.2 A CCC must be appointed by the program director and include at minimum three program faculty members. It must review all resident evaluations at least semi-annually, must determine each resident’s progress on the specialty-specific Milestones, and must meet before residents’ semiannual evaluations to advise the program director — who holds final responsibility for evaluation and promotion decisions.

Decode that for the anxious intern: no single evaluation decides anything. The committee’s entire design is aggregation — every rotation evaluation, from every setting, read together by multiple faculty, twice a year — which is precisely what protects a resident from one hard month, one difficult evaluator, or one bad week. The CCC’s milestone determinations are reported through the program to the ACGME as part of how training is tracked nationally; they are a developmental record, and the committee advising your program director is, structurally, a group of people whose job is to notice both your progress and your needs early.

What good assessment looks like — the ACGME’s own standard

The committee is the structure; the ACGME’s Assessment Guidebook is the standard the structure should be judged by.3 Its criteria for a good system of assessment read like a resident’s bill of rights: comprehensive, feasible, purpose-driven, credible to its stakeholders — and, the criterion residents care most about, “transparent and free from bias… decisions are fair and equitable.” Residents should be assessed well and assessed fairly; a program that cannot explain how its assessment works, or whose decisions surprise the people being assessed, is falling short of the accreditor’s own guidance — and a resident who knows the standard can ask for it by name.

The guidebook is equally direct about the how: multisource feedback — 360-degree assessment — “must be a core component of any program of assessment.” That means ratings not just from attendings but from the people who actually watch you work: the nurses, therapists, pharmacists, and social workers beside you on the unit; your peers and the students you teach; ideally patients and families — and your own self-assessment on the same form, because the gap between how you see yourself and how others see you is itself some of the most valuable feedback in training. The guidebook calls this essential for exactly the competencies single-evaluator forms measure worst — professionalism, communication, teamwork, systems practice — and notes its best use is formative: growth fuel, not a stand-alone verdict.

And in an ideal program, the 360 runs at program scale too — assessment as mutual growth, flowing in every direction. The same requirements that mandate your evaluation mandate the reverse: faculty performance is evaluated at least annually, and residents’ confidential input on faculty and program is part of how programs improve.2 Two practical corollaries for the intern: answer the multisource surveys you receive about colleagues honestly and specifically — they are how the nurses’ perspective from the nursing-collaboration session reaches the record — and write your faculty and program evaluations the way you want yours written: behavior, not character; specifics, not vibes. A program where feedback moves in all directions grows everyone in it. That is the point of the machinery.

The semiannual conversation — what you should expect

The requirements set a rhythm you can rely on: evaluations at least at the end of each rotation; then, at minimum every six months, the program director or their designee reviews those evaluations — including your Milestone progress — with you.2 The requirement language goes further than logistics: residents “should be encouraged to reflect upon the evaluation,” using it to reinforce what is going well and address what is not. At least annually, there is also a summative evaluation of your readiness to progress to the next year.

What that means practically: expect the meeting, and arrive as a participant, not an audience. Read your evaluations and your milestone report before you sit down. Bring your own read on the six months — where you have grown, where you are stuck, what you want from the next block — and leave with your learning plan updated. A resident who treats the semiannual as something done with them rather than to them gets measurably more out of the same thirty minutes. And if progress is genuinely off-track, the requirements describe what should happen: a documented, individualized plan built by the program director or a faculty mentor with the resident, under the institution’s due-process protections — structure, not ambush.

Your individualized learning plan — the requirements’ own words

The program requirements put the learning plan in the resident’s hands: “Working together with the faculty members, residents should develop an individualized learning plan.”2 Note the grammar — residents develop it, faculty help. The ILP is the through-line of this bootcamp’s whole assessment spine: the national transition template many programs now use at entry was piloted across dozens of residencies and takes about half an hour,4 the first published analysis of what interns actually write in them is what aimed this curriculum’s refresher series,5 and the day-zero OSCE exists to give yours an evidence base.

The craft of a useful ILP is small and learnable: goals an advisor can act on — “present two patients on rounds daily without notes by October” rather than “get better at presentations” — a short list (two or three goals a cycle, revisited, beats ten abandoned), and a revision rhythm tied to the semiannual conversation, so the plan is a living document rather than an orientation artifact. Write it as if the person reading it wants to help you — because, structurally, that is exactly who reads it.

If you disagree with an evaluation

It happens, and there is a professional path: respond to the content, in writing where your program’s process provides for it, with specifics and evidence rather than heat; raise it in the semiannual review, where the aggregate context lives; and remember the structural protections — the committee reads everything, the program director holds final responsibility, and institutional due-process policies govern any consequential decision.2 The move that never helps is the one the nursing-collaboration session warned about in another context: litigating the evaluator instead of the evaluation. Chart behavior, not character — even here.

Pocket card

Carry this
  • Milestones are a developmental map. Low levels in July are the design, not a deficiency.
  • No single evaluation decides anything — the CCC reads everything, semiannually.
  • Good assessment is fair, transparent, and 360° — and it flows both ways. Write your evaluations like you want yours written.
  • Expect the six-month conversation. Read your report first; arrive as a participant.
  • The ILP is yours: two or three actable goals, revised every cycle.
  • Disagree with content, in writing, through the process — never with the evaluator’s character.

Notes

The requirement language quoted on this page is from the current ACGME internal-medicine program requirements and the Milestones document itself. The evidence base for the bootcamp’s design is in the bootcamp introduction.

Sources

  1. Accreditation Council for Graduate Medical Education. (2020). Internal medicine Milestones (2nd rev.; implementation July 1, 2021). https://www.acgme.org/globalassets/pdfs/milestones/internalmedicinemilestones.pdf
  2. Accreditation Council for Graduate Medical Education. (2026). ACGME program requirements for graduate medical education in internal medicine. https://www.acgme.org/globalassets/pfassets/programrequirements/2026-prs/140_internalmedicine_2026.pdf 1 2 3 4 5
  3. Holmboe, E. S., & Iobst, W. F. (2020). ACGME assessment guidebook. Accreditation Council for Graduate Medical Education. https://www.acgme.org/globalassets/pdfs/milestones/guidebooks/assessmentguidebook.pdf
  4. Pincavage, A. T., Osman, A., Mikhaeil-Demo, Y., et al. (2023). Evaluation of an individualized learning plan template for the transition to residency. Journal of Graduate Medical Education, 15(5), 597–601. https://pubmed.ncbi.nlm.nih.gov/37781434/
  5. Falk, E., et al. (2025). Initial analysis of internal medicine intern UME to GME individualized learning plan content. Journal of General Internal Medicine, 40, 2153–2156. https://pubmed.ncbi.nlm.nih.gov/39747774/

This page is educational material about the accreditation framework as published; program-level implementation — evaluation forms, committee composition, appeal processes — varies and is governed by your program’s and institution’s policies. Requirements change on annual cycles; verify against the current ACGME documents. Last reviewed July 2026.

The IM Bootcamp

See the full curriculum

Open the bootcamp hub