Calibrate Dx: A Resource To Improve Diagnostic Decisions

As part of the Implementing Diagnostic Excellence Across Systems (IDEAS) project, RAND is recruiting sites with at least four to six clinicians who can commit to using a resource to improve diagnostic safety. (Rural or other small sites may be permitted to enroll as few as two clinicians).

Calibrate Dx is a tool that guides physicians and other clinicians through a structured review of their own selected cases and then a debrief with a trusted colleague. It helps clinicians learn about and improve their diagnostic performance.

Frequently Asked Questions

• What is Calibrate Dx?
• How does Calibrate Dx improve diagnostic safety?
• Why should I (or my organization) participate in IDEAS?
• Who can participate?
• What is the timeline for IDEAS?
• What is needed from sites to participate in IDEAS?
• How will RAND support participating sites?
• How can I learn more?

What is Calibrate Dx?

Calibrate Dx is a resource developed by the Agency for Healthcare Research and Quality (AHRQ) that guides clinicians through a review and reflection on their own diagnostic performance.

How does Calibrate Dx improve diagnostic safety?

"Diagnostic calibration" is defined as alignment between a clinician's diagnostic accuracy and their confidence in that accuracy. To improve diagnostic calibration, clinicians should periodically check on their own diagnostic processes and outcomes. Calibrate Dx guides clinicians through the following steps:

1. Specify the calibration task: Choose an area of practice for which you would like to be better calibrated (e.g., high-risk situations, cases with unexpected trajectories, or diagnosis-specific situations such as conditions that are commonly missed or delayed).
2. Evaluate diagnostic performance: Select three to five of your own cases, review them for learning opportunities, and seek further feedback from a colleague.
3. Plan and apply: Identify improvement strategies for yourself and begin to take appropriate actions.
4. Reflect: Reflect on this calibration exercise over time, evaluate additional areas of interest, and make adjustments as needed.

Calibrate Dx was developed at MedStar in partnership with Baylor College of Medicine and tested in collaboration with clinicians at multiple institutions.

Why should I (or my organization) participate in IDEAS?

• Uncover diagnostic missed opportunities relevant to your practice setting and identify evidence-based ways to improve quality of care for your patients.
• Gain experience measuring and improving diagnostic quality with support from the Institute for Healthcare Improvement (IHI) and other leading healthcare quality organizations.
• Identify improvement strategies that may advance diagnostic quality and safety for patients cared for by other clinicians in your organization.
• Build relationships and trust with colleagues in your organization, who may be able to offer support with future diagnostic challenges.
• Connect with and learn from other participating clinicians and organizations through the project's Learning Collaborative.
• Contribute to the greater good by using and evaluating Calibrate Dx in practice.
• Obtain free continuing education credits through our partner, IHI.
• Engage in activities in support of Maintenance of Certification requirements (applicable to clinicians in certain specialties).
• Receive a modest stipend as a small token of appreciation (for each participating site that completes the project).

Who can participate?

Sites with at least four to six clinicians willing to commit to testing Calibrate Dx, including small and large group practices, departments within clinics or hospitals, and physician or other clinician training programs. (Rural or other small sites may be permitted to enroll as few as two clinicians)

What is the timeline for IDEAS?

Implementation of Calibrate Dx at participating sites is expected to begin August 2025.

What is needed from sites to participate in IDEAS?

• Participate in this 2-year effort, with the first training starting in August 2025.
• Demonstrate executive leadership support and commitment via a letter of support.
• Identify at least four to six highly engaged clinicians (at least two clinicians for rural or other small sites) to perform quarterly reviews of their own cases using the four-step process described above. Sites should commit to providing protected time to complete project tasks (estimated 20 hours per clinician over the course of the project).
• Identify a site champion to coordinate project activities at the site and engage others.
• Affirm that participating clinicians agree to do quarterly surveys to track case review progress, participate in webinars to identify and address implementation challenges, and provide feedback on using the resource.
• Attest to availability of electronic health record data of patients cared for by the participating clinicians for case review (including access to relevant followup data).
• Identify site-specific contacts who can help troubleshoot any barriers related to privacy, security, and confidentiality considerations for patient safety and quality improvement activities. An AHRQ handout provides additional details.

How will RAND support participating sites?

• RAND and its partners will provide training (handouts and webinars) directly to all sites at the beginning of the project before implementation starts. Continuing education (CE) credits will be provided to participants who complete CE-eligible trainings.
• RAND will provide support during implementation that includes resource materials, case review worksheets, and implementation tips. Materials will be provided directly to participating sites and will be available on a secure learning platform.
• RAND will facilitate a Learning Collaborative of participating sites, provide a dedicated email for questions, and offer “office hour” sessions with content experts, including healthcare improvement leaders from IHI.
• RAND will conduct analyses to determine the impact of the intervention and can share this information with your site at the end of the study.

How can I learn more?

Select the button below to ask for more information or to be enrolled in the study. You can also register for a live information webinar or email IDEASproject@rand.org.

Enroll or ask questions