Frequently asked questions
Answers to common questions about how ClinicalSim builds cases, aligns them to competency and communication frameworks, scores encounters, and generates feedback. For the full picture, see our methodology page.
Case development
How does ClinicalSim build a case?
Every case begins with a defined purpose: the communication and clinical skills it should exercise and the competencies it should assess. Content is written to that purpose, with explicit learning objectives and a clinical evidence base drawn from foundational and other applicable literature. Practicing physicians with strong academic backgrounds — including program directors, simulation facilitators, and UME and GME educators — then review each case for accuracy, content, alignment, and fit to its objectives.
How does ClinicalSim confirm a case is ready to release?
Before release, each case is run repeatedly to confirm three things: that the AI character convincingly plays the role the case requires; that scoring and feedback perform as intended; and that what the case asks can be assessed within the limits of voice-based simulation. Refinements are made in coordination with ClinicalSim's clinical and technical leadership.
Standards and framework alignment
What is the difference between a competency framework, a communication framework, and a rubric?
A competency framework is the governing-body standard a case is assessed against — the ACGME Milestones 2.0 in graduate medical education, or the Foundational Competencies in undergraduate medical education. A communication framework is a validated, published model of communication behavior, such as SPIKES or Calgary-Cambridge. A rubric is the scored instrument that turns a framework into rated items, including a program's own internal or external tools. The competency score reflects the learner's developmental level, while communication frameworks capture the specific skills underlying communication technique.
Can more than one communication framework apply to a single case?
Yes. Each communication framework is drawn from a validated library with an approved citation and serves as a floor, not a ceiling — one or more may be applied to a case, each scored independently, and programs may add their own internal or externally validated rubrics. Because these frameworks and rubrics operate at different scopes, from whole-encounter structures to task-specific routines to discrete micro-skills, ClinicalSim selects those best suited to each case's communication task.
Which communication frameworks does ClinicalSim use?
Representative frameworks include SPIKES, the Kalamazoo Essential Elements Communication Checklist (KEECC-A), SEGUE, NURSE, REMAP, SBAR, I-PASS, TeamSTEPPS, CANDOR, and Calgary-Cambridge. Full citations are maintained in the ClinicalSim Frameworks Bibliography; see the full methodology page for representative sources.
Evidence and scoring
How is evidence captured during a simulated encounter?
Each encounter is a voice conversation between the learner and an AI role designed for the case, captured as a timestamped transcript. For every scored competency and framework step, the platform draws one or two verbatim excerpts that demonstrate the behavior, or documents its absence — so each score is traceable to the moment that supports it, rather than serving as an unexplained rating.
How are graduate medical education (GME) cases scored?
GME cases align to the specialty-specific ACGME Milestones 2.0, with milestone text quoted verbatim from each specialty's own document. Scoring reflects whichever subcompetencies the scenario exercises — most often interpersonal and communication skills and professionalism, and systems-based practice or other domains where the encounter warrants — each scored on the Dreyfus scale (1 to 5), read against the milestone's verbatim level descriptors. The result is milestone-placed and ready for Clinical Competency Committee review.
How are undergraduate medical education (UME) cases scored, since there's no five-level milestone scale?
UME cases align to the Foundational Competencies for Undergraduate Medical Education (AAMC, AACOM, and ACGME) and the AAMC Core Entrustable Professional Activities (EPAs) for Entering Residency. Because the Foundational Competencies are not published with the milestones' five-level scale, ClinicalSim does not assign a numeric level for UME; it records whether each competency was demonstrated and scores performance through the applied communication or skill rubric. Entrustment remains a program decision that this evidence informs.
Can ClinicalSim's milestone-aligned scores be used for high-stakes decisions?
No. The ACGME Milestones are formative and were not designed for high-stakes external decisions, and ClinicalSim treats milestone-aligned output accordingly — as evidence that informs program judgment, not as a stand-alone basis for high-stakes decisions.
Feedback
What does a ClinicalSim feedback report include?
Each encounter produces a single feedback report. Verbatim evidence is incorporated into the grading rubrics, justifying the level a learner reached or the specific step assessed. The report offers an overall impression — strengths, priority gaps, and top action items — and targeted recommendations. Depending on the case, it indicates where a learner sits developmentally and gives reviewers transcript-grounded evidence for decisions about progression, remediation, readiness for practice, readiness to perform a particular task, or familiarity with a given subject area.
Does ClinicalSim's methodology extend beyond trainees to faculty?
Yes. The same case-building and assessment methods extend to the conversations faculty are expected to model, including delivering difficult feedback, navigating professionalism concerns, and bedside or small-group teaching.
Accuracy and appropriate use
How does ClinicalSim ensure accuracy?
ClinicalSim is committed to accuracy and to fidelity to the source documents behind every case. Each result is a transparent statement of the evidence in the encounter: it informs the learner and the reviewer, and it never replaces final human judgment.