U.S. flag

An official website of the Department of Health and Human Services

SHARE:

FacebookXEmail AHRQPrintShare
Diagnostic Safety and Quality

Current State of Diagnostic Safety: Implications for Research, Practice, and Policy

References

  1. Singh H, Meyer AN, Thomas EJ. The frequency of diagnostic errors in outpatient care: estimations from three large observational studies involving U.S. adult populations. BMJ Qual Saf Sep 2014;23(9):727-731. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4145460/. Accessed November 15, 2023.
  2. Gunderson CG, Bilan VP, Holleck JL, Nickerson P, Cherry BM, Chui P, Bastian LA, Grimshaw AA, Rodwin BA. Prevalence of harmful diagnostic errors in hospitalised adults: a systematic review and meta-analysis. BMJ Qual Saf 2020 Dec;29(12):1008-1018. https://pubmed.ncbi.nlm.nih.gov/32269070/. Accessed November 15, 2023.
  3. Newman-Toker DE, Nassery N, Schaffer AC, Yu-Moe CW, Clemens GD, Wang Z, Zhu Y, Saber Tehrani AS, Fanai M, Hassoon A, Siegal D. Burden of serious harms from diagnostic error in the USA. BMJ Qual Saf 2023 Jul 17;bmjqs-2021-014130. https://pubmed.ncbi.nlm.nih.gov/37460118/. Accessed November 15, 2023.
  4. Medford-Davis L, Park E, Shlamovitz G, Suliburk J, Meyer AN, Singh H. Diagnostic errors related to acute abdominal pain in the emergency department. Emerg Med J 2016;33(4):253-259. https://pubmed.ncbi.nlm.nih.gov/26531859/. Accessed November 15, 2023.
  5. Raffel KE, Kantor MA, Barish P, Esmaili A, Lim H, Xue F, Ranji SR. Prevalence and characterisation of diagnostic error among 7-day all-cause hospital medicine readmissions: a retrospective cohort study. BMJ Qual Saf 2020 Dec;29(12):971-979. https://pubmed.ncbi.nlm.nih.gov/32753409/. Accessed November 15, 2023.
  6. Zwaan L, de Bruijne M, Wagner C, Thijs A, Smits M, van der Wal G, Timmermans DR. Patient record review of the incidence, consequences, and causes of diagnostic adverse events. Arch Intern Med 2010 Jun 28;170(12):1015-1021. https://pubmed.ncbi.nlm.nih.gov/20585065/. Accessed November 15, 2023.
  7. Schiff GD, Hasan O, Kim S, Abrams R, Cosby K, Lambert BL, Elstein AS, Hasler S, Kabongo ML, Krosnjar N, Odwazny R, Wisniewski MF, McNutt RA. Diagnostic error in medicine: analysis of 583 physician-reported errors. Arch Intern Med 2009 Nov 9;169(20):1881-1887. https://pubmed.ncbi.nlm.nih.gov/19901140/. Accessed November 15, 2023.
  8. Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern Med 2005 Jul 11;165(13):1493-1499. https://pubmed.ncbi.nlm.nih.gov/16009864/. Accessed November 15, 2023.
  9. Agency for Healthcare Research and Quality. Updated Review: Diagnostic Errors in the Emergency Department: A Systematic Review. Content last reviewed August 2023. https://effectivehealthcare.ahrq.gov/products/diagnostic-errors-emergency-updated/research. Accessed November 15, 2023.
  10. Singh H, Thomas EJ, Wilson L, Kelly PA, Pietz K, Elkeeb D, Singhal G. Errors of diagnosis in pediatric practice: a multisite survey. Pediatrics 2010 Jul;126(1):70-79. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2921702/. Accessed November 15, 2023.
  11. NORC at the University of Chicago and Institute for Healthcare Improvement/National Patient Safety Foundation Lucian Leape Institute. Americans’ Experiences With Medical Errors and Views on Patient Safety. Cambridge, MA: Institute for Healthcare Improvement and NORC at the University of Chicago; 2017. https://www.ihi.org/resources/publications/americans-experiences-medical-errors-and-views-patient-safety. Accessed November 15, 2023.
  12. Balogh E, Miller B, Ball J. Improving Diagnosis in Health Care. National Academies of Sciences, Engineering, and Medicine. Washington, DC: National Academies Press; 2015. https://pubmed.ncbi.nlm.nih.gov/26803862/. Accessed November 15, 2023.
  13. Gordon and Betty Moore Foundation. Diagnostic Excellence Initiative. 2023. https://www.moore.org/initiative-strategy-detail?initiativeId=diagnostic-excellence. Accessed November 15, 2023.
  14. Agency for Healthcare Research and Quality. Diagnostic Safety and Quality. https://www.ahrq.gov/topics/diagnostic-safety-and-quality.html. Accessed November 15, 2023.
  15. Zwaan L, El-Kareh R, Meyer AND, Hooftman J, Singh H. Advancing diagnostic safety research: results of a systematic research priority setting exercise. J Gen Intern Med 2021 Oct;36(10):2943-2951. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8481519/. Accessed November 15, 2023.
  16. Agency for Healthcare Research and Quality. Patient Safety Network (PSNet). https://psnet.ahrq.gov/. Accessed November 15, 2023.
  17. Agency for Healthcare Research and Quality. AHRQ Grants by State. https://www.ahrq.gov/funding/grant-mgmt/grants-by-state.html. Accessed November 15, 2023.
  18. National Academy of Medicine. NAM Scholars in Dx Ex. https://nam.edu/programs/health-policy-educational-programs-and-fellowships/nam-scholars-in-diagnostic-excellence/. Accessed November 15, 2023.
  19. Society to Improve Diagnosis in Medicine. Foundational Readings. https://www.improvediagnosis.org/foundational-readings/. Accessed November 15, 2023.
  20. Society to Improve Diagnosis in Medicine. Fellowship in Diagnostic Excellence. https://www.improvediagnosis.org/sidmfellowship/. Accessed November 15, 2023.
  21. Graber ML. The incidence of diagnostic error in medicine. BMJ Qual Saf 2013 Oct;22 Suppl 2(Suppl 2):ii21-ii27.  https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3786666/. Accessed November 15, 2023.
  22. Zwaan L, Singh H. The challenges in defining and measuring diagnostic error. Diagnosis (Berl) 2015 Jun;2(2):97-103. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4779119/. Accessed November 15, 2023.
  23. Singh H, Schiff GD, Graber ML, Onakpoya I, Thompson MJ. The global burden of diagnostic errors in primary care. BMJ Qual Saf 2017 Jun;26(6):484-494. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5502242/. Accessed November 15, 2023.
  24. Hussain F, Cooper A, Carson-Stevens A, Donaldson L, Hibbert P, Hughes T, Edwards A. Diagnostic error in the emergency department: learning from national patient safety incident report analysis. BMC Emerg Med 2019 Dec 4;19(1):77. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6894198/. Accessed November 15, 2023.
  25. Singh H, Giardina TD, Meyer AN, Forjuoh SN, Reis MD, Thomas EJ. Types and origins of diagnostic errors in primary care settings. JAMA Intern Med 2013 Mar 25;173(6):418-425. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3690001/. Accessed November 15, 2023.
  26. Singh H, Giardina TD, Forjuoh SN, Reis MD, Kosmach S, Khan MM, Thomas EJ. Electronic health record-based surveillance of diagnostic errors in primary care. BMJ Qual Saf 2012;21(2):93-100. https://pubmed.ncbi.nlm.nih.gov/21997348/. Accessed November 15, 2023.
  27. Cheraghi-Sohi S, Holland F, Singh H, Danczak A, Esmail A, Morris RL, Small N, Williams R, de Wet C, Campbell SM, Reeves D. Incidence, origins, and avoidable harm of missed opportunities in diagnosis: longitudinal patient record review in 21 English general practices. BMJ Qual Saf 2021 Dec;30(12):977-985. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc8606447/. Accessed November 15, 2023.
  28. Warrick C, Patel P, Hyer W, Neale G, Sevdalis N, Inwald D. Diagnostic error in children presenting with acute medical illness to a community hospital. Int J Qual Health Care 2014 Oct;26(5):538-546. https://pubmed.ncbi.nlm.nih.gov/25002692/. Accessed November 15, 2023.
  29. Scott IA, Crock C. Diagnostic error: incidence, impacts, causes and preventive strategies. Med J Aust 2020 Oct;213(7):302-305.e2. https://pubmed.ncbi.nlm.nih.gov/32951211/. Accessed November 15, 2023.
  30. Perrem LM, Fanshawe TR, Sharif F, Plüddemann A, O’Neill MB. A national physician survey of diagnostic error in paediatrics. Eur J Pediatr 2016 Oct;175(10):1387-1392. https://pubmed.ncbi.nlm.nih.gov/27631589/. Accessed November 15, 2023.
  31. Thesleff T, Niskakangas T, Luoto T, Iverson GL, Öhman J, Ronkainen A. Preventable diagnostic errors in fatal cervical spine injuries: a nationwide register-based study from 1987 to 2010. Spine J 2018 Mar;18(3):430-438. https://pubmed.ncbi.nlm.nih.gov/28822822/. Accessed November 15, 2023.
  32. Bhat PN, Costello JM, Aiyagari R, Sharek PJ, Algaze CA, Mazwi ML, Roth SJ, Shin AY. Diagnostic errors in paediatric cardiac intensive care. Cardiol Young 2018 May;28(5):675-682. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc7271069/. Accessed November 15, 2023.
  33. Skinner TR, Scott IA, Martin JH. Diagnostic errors in older patients: a systematic review of incidence and potential causes in seven prevalent diseases. Int J Gen Med 2016 May 20;9:137-146. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc4881921/. Accessed November 15, 2023.
  34. Goyder CR, Jones CH, Heneghan CJ, Thompson MJ. Missed opportunities for diagnosis: lessons learned from diagnostic errors in primary care. Br J Gen Pract 2015 Dec;65(641):e838-e844. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc4655738/. Accessed November 15, 2023.
  35. Bergl PA, Zhou Y. Diagnostic error in the critically ill: a hidden epidemic? Crit Care Clin 2022 Jan;38(1):11-25. https://pubmed.ncbi.nlm.nih.gov/34794625/. Accessed November 15, 2023.
  36. Custer JW, Winters BD, Goode V, Robinson KA, Yang T, Pronovost PJ, Newman-Toker DE. Diagnostic errors in the pediatric and neonatal ICU: a systematic review. Pediatr Crit Care Med 2015 Jan;16(1):29-36. https://pubmed.ncbi.nlm.nih.gov/25329138/. Accessed November 15, 2023.
  37. Cifra CL, Custer JW, Singh H, Fackler JC. Diagnostic errors in pediatric critical care: a systematic review. Pediatr Crit Care Med 2021 Aug 1;22(8):701-712. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc8373621/. Accessed November 15, 2023.
  38. Sawicki JG, Nystrom D, Purtell R, Good B, Chaulk D. Diagnostic error in the pediatric hospital: a narrative review. Hosp Pract (1995). 2021 Oct;49(sup1):437-444. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc9297299/. Accessed November 15, 2023.
  39. Mueller BU, Neuspiel DR, Fisher ERS; Council on Quality Improvement and Patient Safety, Committee on Hospital Care. Principles of pediatric patient safety: reducing harm due to medical care. Pediatrics 2019 Feb;143(2):e20183649. https://pubmed.ncbi.nlm.nih.gov/30670581/. Accessed November 15, 2023.
  40. Carpenter CR, Jotte R, Griffey RT, Schwarz E. A critical appraisal of AHRQ’’s ““diagnostic errors”“ report. Mo Med 2023 Mar-Apr;120(2):114-120. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10121120/. Accessed November 15, 2023.
  41. Bhise V, Meyer AND, Singh H, Wei L, Russo E, Al-Mutairi A, Murphy DR. Errors in diagnosis of spinal epidural abscesses in the era of electronic health records. Am J Med 2017 Aug;130(8):975-981. https://pubmed.ncbi.nlm.nih.gov/28366427/. Accessed November 15, 2023.
  42. Auerbach AD, Astik GJ, O’’Leary KJ, Barish PN, Kantor MA, Raffel KR, Ranji SR, Mueller SK, Burney SN, Galinsky J, Gershanik EF, Goyal A, Chitneni PR, Rastegar S, Esmaili AM, Fenton C, Virapongse A, Ngov LK, Burden M, Keniston A, Patel H, Gupta AB, Rohde J, Marr R, Greysen SR, Fang M, Shah P, Mao F, Kaiksow F, Sterken D, Choi JJ, Contractor J, Karwa A, Chia D, Lee T, Hubbard CC, Maselli J, Dalal AK, Schnipper JL. Prevalence and causes of diagnostic errors in hospitalized patients under investigation for COVID-19. J Gen Intern Med 2023 Jun;38(8):1902-1910. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc10035474/. Accessed November 15, 2023.
  43. Barwise A, Leppin A, Dong Y, Huang C, Pinevich Y, Herasevich S, Soleimani J, Gajic O, Pickering B, Kumbamu A. What contributes to diagnostic error or delay? A qualitative exploration across diverse acute care settings in the United States. J Patient Saf 2021 Jun 1;17(4):239-248. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc8195035/. Accessed November 15, 2023.
  44. Moonen PJ, Mercelina L, Boer W, Fret T. Diagnostic error in the emergency department: follow up of patients with minor trauma in the outpatient clinic. Scand J Trauma Resusc Emerg Med 2017 Feb 14;25(1):13. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc5309992/. Accessed November 15, 2023.
  45. Marshall HS, Milikowski C. Comparison of clinical diagnoses and autopsy findings: six-year retrospective study. Arch Pathol Lab Med 2017 Sep;141(9):1262-1266. https://pubmed.ncbi.nlm.nih.gov/28657772/. Accessed November 15, 2023.
  46. Schwartz A, Weiner SJ, Weaver F, Yudkowsky R, Sharma G, Binns-Calvey A, Preyss B, Jordan N. Uncharted territory: measuring costs of diagnostic errors outside the medical record. BMJ Qual Saf 2012 Nov;21(11):918-924. https://pubmed.ncbi.nlm.nih.gov/22773889/. Accessed November 15, 2023.
  47. Shimkhada R, Solon O, Tamondong-Lachica D, Peabody JW. Misdiagnosis of obstetrical cases and the clinical and cost consequences to patients: a cross-sectional study of urban providers in the Philippines. Glob Health Action 2016 Dec 15;9:32672. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc5161800/. Accessed November 15, 2023.
  48. Giardina TD, Sarkar U, Gourley G, Modi V, Meyer AN, Singh H. Online public reactions to frequency of diagnostic errors in U.S. outpatient care. Diagnosis (Berl) 2016 Mar;3(1):17-22. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc4917213/. Accessed November 15, 2023.
  49. Gupta A, Snyder A, Kachalia A, Flanders S, Saint S, Chopra V. Malpractice claims related to diagnostic errors in the hospital. BMJ Qual Saf 2017 Aug 9;27(1):bmjqs-2017-006774. https://pubmed.ncbi.nlm.nih.gov/28794243/. Accessed November 15, 2023.
  50. Saber Tehrani AS, Lee H, Mathews SC, Shore A, Makary MA, Pronovost PJ, Newman-Toker DE. 25-year summary of U.S. malpractice claims for diagnostic errors 1986-2010: an analysis from the National Practitioner Data Bank. BMJ Qual Saf 2013 Aug;22(8):672-680. https://pubmed.ncbi.nlm.nih.gov/23610443/. Accessed November 15, 2023.
  51. Quinn GR, Ranum D, Song E, Linets M, Keohane C, Riah H, Greenberg P. Missed diagnosis of cardiovascular disease in outpatient general medicine: insights from malpractice claims data. Jt Comm J Qual Patient Saf 2017 Oct;43(10):508-516. https://pubmed.ncbi.nlm.nih.gov/28942775/. Accessed November 15, 2023.
  52. Troxel DB. Diagnostic error identified as the most common allegation in malpractice lawsuits. Mich Med 2015 Jan-Feb;114(1):8. https://pubmed.ncbi.nlm.nih.gov/26489264/. Accessed November 15, 2023.
  53. Newman-Toker DE, Schaffer AC, Yu-Moe CW, Nassery N, Saber Tehrani AS, Clemens GD, Wang Z, Zhu Y, Fanai M, Siegal D. Serious misdiagnosis-related harms in malpractice claims: the ““Big Three”“ - vascular events, infections, and cancers. Diagnosis (Berl) 2019 Aug 27;6(3):227-240. Erratum in: Diagnosis (Berl) 2020 May 16;8(1):127-128. https://pubmed.ncbi.nlm.nih.gov/31535832/. Accessed November 15, 2023.
  54. Watari T, Tokuda Y, Mitsuhashi S, Otuki K, Kono K, Nagai N, Onigata K, Kanda H. Factors and impact of physicians’ diagnostic errors in malpractice claims in Japan. PLoS One 2020 Aug 3;15(8):e0237145. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc7398551/. Accessed November 15, 2023.
  55. Bergl PA, Wijesekera TP, Nassery N, Cosby KS. Controversies in diagnosis: contemporary debates in the diagnostic safety literature. Diagnosis (Berl) 2020 Jan 28;7(1):3-9. https://pubmed.ncbi.nlm.nih.gov/31129651/. Accessed November 15, 2023.
  56. Mahajan P, Mollen C, Alpern ER, Baird-Cox K, Boothman RC, Chamberlain JM, Cosby K, Epstein HM, Gegenheimer-Holmes J, Gerardi M, Giardina TD, Patel VL, Ruddy R, Saleem J, Shaw KN, Sittig DF, Singh H. An operational framework to study diagnostic errors in emergency departments: findings from a consensus panel. J Patient Saf 2021 Dec 1;17(8):570-575. https://pubmed.ncbi.nlm.nih.gov/31790012/. Accessed November 15, 2023.
  57. Giardina TD, Hunte H, Hill MA, Heimlich SL, Singh H, Smith KM. Defining diagnostic error: a scoping review to assess the impact of the National Academies’’ report Improving Diagnosis in Health Care. J Patient Saf 2022 Dec 1;18(8):770-778. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc9698189/. Accessed November 15, 2023.
  58. Foster PN, Klein JR. Defining excellence: next steps for practicing clinicians seeking to prevent diagnostic error. J Community Hosp Intern Med Perspect 2016 Sep 7;6(4):31994. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc5016746/. Accessed November 15, 2023.
  59. Singh H. Editorial: Helping health care organizations to define diagnostic errors as missed opportunities in diagnosis. Jt Comm J Qual Patient Saf 2014 Mar;40(3):99-101. https://pubmed.ncbi.nlm.nih.gov/24730204/. Accessed November 15, 2023.
  60. Agency for Healthcare Research and Quality. Common Formats for Event Reporting - Diagnostic Safety Version 1.0 Event Description. https://www.psoppc.org/psoppc_web/publicpages/commonFormatsDSV1.0. Accessed November 15, 2023.
  61. Singh H, Sittig DF. Advancing the science of measurement of diagnostic errors in healthcare: the Safer Dx framework. BMJ Qual Saf 2015 Feb;24(2):103-110. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4316850/. Accessed November 15, 2023.
  62. Olson APJ, Graber ML, Singh H. Tracking progress in improving diagnosis: a framework for defining undesirable diagnostic events. J Gen Intern Med 2018 Jul;33(7):1187-1191. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc6025685/. Accessed November 15, 2023.
  63. Harada T, Miyagami T, Watari T, Hiyoshi T, Kunitomo K, Tsuji T, Shimizu T. Analysis of diagnostic error cases among Japanese residents using diagnosis error evaluation and research taxonomy. J Gen Fam Med 2021 Jan 4;22(2):96-99. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc7921344/. Accessed November 15, 2023.
  64. Olson APJ, Linzer M, Schiff GD. Measuring and improving diagnostic safety in primary care: addressing the ““twin”“ pandemics of diagnostic error and clinician burnout. J Gen Intern Med 2021 May;36(5):1404-1406. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc7878169/. Accessed November 15, 2023.
  65. Bell SK, Bourgeois F, DesRoches CM, Dong J, Harcourt K, Liu SK, Lowe E, McGaffigan P, Ngo LH, Novack SA, Ralston JD, Salmi L, Schrandt S, Sheridan S, Sokol-Hessner L, Thomas G, Thomas EJ. Filling a gap in safety metrics: development of a patient-centred framework to identify and categorise patient-reported breakdowns related to the diagnostic process in ambulatory care. BMJ Qual Saf 2022 Jul;31(7):526-540. https://pubmed.ncbi.nlm.nih.gov/34656982/. Accessed November 15, 2023.
  66. Morgan DJ, Meyer AND, Korenstein D. Issue Brief 9: Improved Diagnostic Accuracy Through Probability-Based Diagnosis. Rockville, MD: Agency for Healthcare Research and Quality; September 2022. AHRQ Publication No. 22-0026-3-EF. https://www.ahrq.gov/patient-safety/reports/issue-briefs/probabilistic-thinking.html. Accessed November 15, 2023.
  67. Closing the Loop: A Guide to Safer Ambulatory Referrals in the EHR Era. Cambridge, MA: Institute for Healthcare Improvement; 2017. https://www.ihi.org/resources/publications/closing-loop-guide-safer-ambulatory-referrals-ehr-era. Accessed November 15, 2023.
  68. Cifra CL. Understanding Referral Communication, the Diagnostic Process, and Diagnostic Error in Pediatric Critical Care. Grantome. https://www.grantome.com/grant/NIH/K08-HS026965-01A1. Accessed November 15, 2023.
  69. Murphy DR, Satterly T, Rogith D, Sittig DF, Singh H. Barriers and facilitators impacting reliability of the electronic health record-facilitated total testing process. Int J Med Inform 2019 Jul;127:102-108. https://pubmed.ncbi.nlm.nih.gov/31128821/. Accessed November 15, 2023.
  70. Zimolzak AJ, Singh H, Murphy DR, Wei L, Memon SA, Upadhyay DK, Korukonda S, Zubkoff L, Sittig DF. Translating electronic health record-based patient safety algorithms from research to clinical practice at multiple sites. BMJ Health Care Inform 2022 Jul;29(1):e100565. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc9289019/. Accessed November 15, 2023.
  71. Singh H, Bradford A, Goeschel C. Issue Brief 1: Operational Measurement of Diagnostic Safety: State of the Science. Rockville, MD: Agency for Healthcare Research and Quality; April 2020. AHRQ Publication No. 20-0040-1-EF. https://www.ahrq.gov/patient-safety/reports/issue-briefs/state-of-science.html. Accessed November 15, 2023.
  72. Mahajan P, Pai CW, Cosby KS, Mollen CJ, Shaw KN, Chamberlain JM, El-Kareh R, Ruddy RM, Alpern ER, Epstein HM, Giardina TD, Graber ML, Medford-Davis LN, Medlin RP, Upadhyay DK, Parker SJ, Singh H. Identifying trigger concepts to screen emergency department visits for diagnostic errors. Diagnosis (Berl) 2020 Nov 13;8(3):340-346. https://pubmed.ncbi.nlm.nih.gov/33180032/. Accessed November 15, 2023.
  73. Weingart SN, Nelson J, Koethe B, Yaghi O, Dunning S, Feldman A, Kent D, Lipitz-Snyderman A. Association between cancer-specific adverse event triggers and mortality: a validation study. Cancer Med 2020 Jun;9(12):4447-4459. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc7300390/. Accessed November 15, 2023.
  74. Murphy DR, Meyer AN, Sittig DF, Meeks DW, Thomas EJ, Singh H. Application of electronic trigger tools to identify targets for improving diagnostic safety. BMJ Qual Saf 2019 Feb;28(2):151-159. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc6365920/. Accessed November 15, 2023.
  75. Hibbert PD, Molloy CJ, Hooper TD, Wiles LK, Runciman WB, Lachman P, Muething SE, Braithwaite J. The application of the Global Trigger Tool: a systematic review. Int J Qual Health Care 2016 Dec 1;28(6):640-649. https://pubmed.ncbi.nlm.nih.gov/27664822/. Accessed November 15, 2023.
  76. Bhise V, Sittig DF, Vaghani V, Wei L, Baldwin J, Singh H. An electronic trigger based on care escalation to identify preventable adverse events in hospitalised patients. BMJ Qual Saf 2018 Mar;27(3):241-246. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc5867429/. Accessed November 15, 2023.
  77. Al-Mutairi A, Meyer AN, Thomas EJ, Etchegaray JM, Roy KM, Davalos MC, Sheikh S, Singh H. Accuracy of the Safer Dx Instrument to identify diagnostic errors in primary care. J Gen Intern Med 2016 Jun;31(6):602-608. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc4870415/. Accessed November 15, 2023.
  78. Malik MA, Motta-Calderon D, Piniella N, Garber A, Konieczny K, Lam A, Plombon S, Carr K, Yoon C, Griffin J, Lipsitz S, Schnipper JL, Bates DW, Dalal AK. A structured approach to EHR surveillance of diagnostic error in acute care: an exploratory analysis of two institutionally-defined case cohorts. Diagnosis (Berl) 2022 Aug 22;9(4):446-457. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc9651987/. Accessed November 15, 2023.
  79. Davalos MC, Samuels K, Meyer AN, Thammasitboon S, Sur M, Roy K, Al-Mutairi A, Singh H. Finding diagnostic errors in children admitted to the PICU. Pediatr Crit Care Med 2017 Mar;18(3):265-271. https://pubmed.ncbi.nlm.nih.gov/28125548/. Accessed November 15, 2023.
  80. Singh H, Khanna A, Spitzmueller C, Meyer AND. Recommendations for using the Revised Safer Dx Instrument to help measure and improve diagnostic safety. Diagnosis (Berl) 2019 Nov 26;6(4):315-323. https://pubmed.ncbi.nlm.nih.gov/31287795/. Accessed November 15, 2023.
  81. Bradford A, Shahid U, Schiff GD, Graber ML, Marinez A, DiStabile P, Timashenka A, Jalal H, Brady PJ, Singh H. Development and usability testing of the Agency for Healthcare Research and Quality Common Formats to capture diagnostic safety events. J Patient Saf 2022 Sep 1;18(6):521-525. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc9391254/. Accessed November 15, 2023.
  82. Society to Improve Diagnosis in Medicine. Diagnostic Safety Event Reporting. https://www.improvediagnosis.org/publications/improvedx-july-2021/diagnostic-safety-event-reporting/. Accessed November 15, 2023.
  83. Marshall TL, Ipsaro AJ, Le M, Sump C, Darrell H, Mapes KG, Bick J, Ferris SA, Bolser BS, Simmons JM, Hagedorn PA, Brady PW. Increasing physician reporting of diagnostic learning opportunities. Pediatrics 2021 Jan;147(1):e20192400. https://pubmed.ncbi.nlm.nih.gov/33268395/. Accessed November 15, 2023.
  84. Okafor N, Payne VL, Chathampally Y, Miller S, Doshi P, Singh H. Using voluntary reports from physicians to learn from diagnostic errors in emergency medicine. Emerg Med J 2016 Apr;33(4):245-252. https://pubmed.ncbi.nlm.nih.gov/26531860/. Accessed November 15, 2023.
  85. Shen L, Levie A, Singh H, Murray K, Desai S. Harnessing event report data to identify diagnostic error during the COVID-19 pandemic. Jt Comm J Qual Patient Saf2022 Feb;48(2):71-80. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc8553646/. Accessed November 15, 2023.
  86. Gleason KT, Peterson S, Dennison Himmelfarb CR, Villanueva M, Wynn T, Bondal P, Berg D, Jerde W, Newman-Toker D. Feasibility of patient-reported diagnostic errors following emergency department discharge: a pilot study. Diagnosis (Berl) 2020 Oct 5;8(2):187-192. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc8019684/. Accessed November 15, 2023.
  87. Giardina TL. Engaging Patients in Diagnostic Error Reporting. Grantome. https://grantome.com/grant/NIH/K01-HS025474-01A1. Accessed November 15, 2023.
  88. McNiven B, Wu T, Brown AD. Novel telephone-based interactive voice response system for incident reporting. Jt Comm J Qual Patient Saf 2021 Dec;47(12):809-813. https://pubmed.ncbi.nlm.nih.gov/34732307/. Accessed November 15, 2023.
  89. Norman G, Sherbino J, Dore K, Wood T, Young M, Gaissmaier W, Kreuger S, Monteiro S. The etiology of diagnostic errors: a controlled trial of system 1 versus system 2 reasoning. Acad Med 2014 Feb;89(2):277-284. https://pubmed.ncbi.nlm.nih.gov/24362377/. Accessed November 15, 2023.
  90. O’Sullivan ED, Schofield SJ. Cognitive bias in clinical medicine. J R Coll Physicians Edinb. 2018 Sep;48(3):225-232. https://pubmed.ncbi.nlm.nih.gov/30191910/. Accessed November 15, 2023.
  91. Saposnik G, Redelmeier D, Ruff CC, Tobler PN. Cognitive biases associated with medical decisions: a systematic review. BMC Med Inform Decis Mak 2016 Nov 3;16(1):138. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc5093937/. Accessed November 15, 2023.
  92. Norman GR, Monteiro SD, Sherbino J, Ilgen JS, Schmidt HG, Mamede S. The causes of errors in clinical reasoning: cognitive biases, knowledge deficits, and dual process thinking. Acad Med 2017 Jan;92(1):23-30. https://pubmed.ncbi.nlm.nih.gov/27782919/. Accessed November 15, 2023.
  93. Restrepo D, Armstrong KA, Metlay JP. Annals Clinical Decision Making: Avoiding cognitive errors in clinical decision making. Ann Intern Med 2020 Jun 2;172(11):747-751. https://pubmed.ncbi.nlm.nih.gov/32311734/. Accessed November 15, 2023.
  94. Zwaan L, Monteiro S, Sherbino J, Ilgen J, Howey B, Norman G. Is bias in the eye of the beholder? A vignette study to assess recognition of cognitive biases in clinical case workups. BMJ Qual Saf 2017 Feb;26(2):104-110. https://pubmed.ncbi.nlm.nih.gov/26825476/. Accessed November 15, 2023.
  95. Graber ML. Progress understanding diagnosis and diagnostic errors: thoughts at year 10. Diagnosis (Berl) 2020 Aug 27;7(3):151-159. https://pubmed.ncbi.nlm.nih.gov/32628630/. Accessed November 15, 2023.
  96. Torre D, Durning SJ, Rencic J, Lang V, Holmboe E, Daniel M. Widening the lens on teaching and assessing clinical reasoning: from “in the head” to “out in the world.” Diagnosis (Berl) 2020 Aug 27;7(3):181-190. https://pubmed.ncbi.nlm.nih.gov/32142479/. Accessed November 15, 2023.
  97. Merkebu J, Battistone M, McMains K, McOwen K, Witkop C, Konopasky A, Torre D, Holmboe E, Durning SJ. Situativity: a family of social cognitive theories for understanding clinical reasoning and diagnostic error. Diagnosis (Berl) 2020 Aug 27;7(3):169-176. https://pubmed.ncbi.nlm.nih.gov/32924378/. Accessed November 15, 2023.
  98. Cartwright DJ. ICD-9-CM to ICD-10-CM Codes: What? Why? How? Adv Wound Care (New Rochelle) 2013 Dec;2(10):588-592. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc3865615/. Accessed November 15, 2023
  99. Densen P. Challenges and opportunities facing medical education. Trans Am Clin Climatol Assoc 2011;122:48-58. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc3116346/. Accessed November 15, 2023.
  100. Downing NL, Bates DW, Longhurst CA. Physician burnout in the electronic health record era: are we ignoring the real cause? Ann Intern Med 2018 Jul 3;169(1):50-51. https://pubmed.ncbi.nlm.nih.gov/29801050/. Accessed November 15, 2023.
  101. Arndt BG, Beasley JW, Watkinson MD, Temte JL, Tuan WJ, Sinsky CA, Gilchrist VJ. Tethered to the EHR: primary care physician workload assessment using EHR event log data and time-motion observations. Ann Fam Med 2017 Sep;15(5):419-426. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc5593724/. Accessed November 15, 2023.
  102. Moy AJ, Schwartz JM, Chen R, Sadri S, Lucas E, Cato KD, Rossetti SC. Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review. J Am Med Inform Assoc 2021 Apr 23;28(5):998-1008. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc8068426/. Accessed November 15, 2023.
  103. Melnick ER, Harry E, Sinsky CA, Dyrbye LN, Wang H, Trockel MT, West CP, Shanafelt T. Perceived electronic health record usability as a predictor of task load and burnout among U.S. physicians: mediation analysis. J Med Internet Res 2020 Dec 22;22(12):e23382. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc7785404/. Accessed November 15, 2023.
  104. Bhise V, Meyer AND, Menon S, Singhal G, Street RL, Giardina TD, Singh H. Patient perspectives on how physicians communicate diagnostic uncertainty: an experimental vignette study. Int J Qual Health Care 2018 Feb 1;30(1):2-8. https://pubmed.ncbi.nlm.nih.gov/29329438/. Accessed November 15, 2023.
  105. Meyer AND, Giardina TD, Khawaja L, Singh H. Patient and clinician experiences of uncertainty in the diagnostic process: current understanding and future directions. Patient Educ Couns 2021;104(11):2606-2615. https://pubmed.ncbi.nlm.nih.gov/34312032/. Accessed November 15, 2023.
  106. Zwaan L, Hautz WE. Bridging the gap between uncertainty, confidence, and diagnostic accuracy: calibration is key. BMJ Qual Saf 2019 May;28(5):352-355. https://pubmed.ncbi.nlm.nih.gov/30728186/. Accessed November 15, 2023.
  107. Brun C, Zerhouni O, Akinyemi A, Houtin L, Monvoisin R, Pinsault N. Impact of uncertainty intolerance on clinical reasoning: a scoping review of the 21st‐century literature. J Eval Clin Pract 2023;29(3):539-553. https://pubmed.ncbi.nlm.nih.gov/36071694/. Accessed November 15, 2023.
  108. Moulder G, Harris E, Santhosh L. Teaching the science of uncertainty. Diagnosis (Berl) 2022 Sep 12;10(1):13-18. https://pubmed.ncbi.nlm.nih.gov/36087299/. Accessed November 15, 2023.
  109. Simpkin AL, Armstrong KA. Communicating uncertainty: a narrative review and framework for future research. J Gen Intern Med 2019 Nov;34(11):2586-2591. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6848305/. Accessed November 15, 2023.
  110. Bhise V, Rajan SS, Sittig DF, Morgan RO, Chaudhary P, Singh H. Defining and measuring diagnostic uncertainty in medicine: a systematic review. J Gen Intern Med 2018 Jan;33(1):103-115. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5756158/. Accessed November 15, 2023.
  111. Khazen M, Sullivan EE, Arabadjis S, Ramos J, Mirica M, Olson A, Linzer M, Schiff GD. How does work environment relate to diagnostic quality? A prospective, mixed methods study in primary care. BMJ Open 2023 May 5;13(5):e071241. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10163453/. Accessed November 15, 2023.
  112. Gupta A, Harrod M, Quinn M, Manojlovich M, Fowler KE, Singh H, Saint S, Chopra V. Mind the overlap: how system problems contribute to cognitive failure and diagnostic errors. Diagnosis (Berl) 2018 Sep 25;5(3):151-156. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6743477/. Accessed November 15, 2023.
  113. Linzer M, Sullivan EE, Olson APJ, Khazen M, Mirica M, Schiff GD. Improving diagnosis: adding context to cognition. Diagnosis (Berl) 2022 Aug 22;10(1):4-8. https://pubmed.ncbi.nlm.nih.gov/35985033/. Accessed November 15, 2023.
  114. Sinsky CA, Biddison LD, Mallick A, Dopp AL, Perlo J, Lynn L, Smith CD. Organizational evidence-based and promising practices for improving clinician well-being. NAM Perspect 2020 Nov 2;2020:10.31478/202011a. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8916810/. Accessed November 15, 2023.
  115. Hess BJ, Lipner RS, Thompson V, Holmboe ES, Graber ML. Blink or think: can further reflection improve initial diagnostic impressions? Acad Med 2015;90(1):112-118. https://pubmed.ncbi.nlm.nih.gov/25374040/. Accessed November 15, 2023.
  116. Mamede S, Hautz WE, Berendonk C, Hautz SC, Sauter TC, Rotgans J, Zwaan L, Schmidt HG. Think twice: effects on diagnostic accuracy of returning to the case to reflect upon the initial diagnosis. Acad Med 2020 Aug;95(8):1223-1229. https://pubmed.ncbi.nlm.nih.gov/31972673/. Accessed November 15, 2023.
  117. Singh H, Connor DM, Dhaliwal G. Five strategies for clinicians to advance diagnostic excellence. BMJ 2022;376:e068044. https://pubmed.ncbi.nlm.nih.gov/35172968/. Accessed November 15, 2023.
  118. Prakash S, Sladek RM, Schuwirth L. Interventions to improve diagnostic decision making: a systematic review and meta-analysis on reflective strategies. Med Teach 2019;41(5):517-524. https://pubmed.ncbi.nlm.nih.gov/30244625/. Accessed November 15, 2023.
  119. Fernandez Branson C, Williams M, Chan TM, Graber ML, Lane KP, Grieser S, Landis-Lewis Z, Cooke J, Upadhyay DK, Mondoux S, Singh H, Zwaan L, Friedman C, Olson APJ. Improving diagnostic performance through feedback: the Diagnosis Learning Cycle. BMJ Qual Saf 2021 Dec;30(12):1002-1009. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8606468/. Accessed November 15, 2023.
  120. Meyer AND, Singh H. The path to diagnostic excellence includes feedback to calibrate how clinicians think. JAMA 2019;321(8):737-738. https://pubmed.ncbi.nlm.nih.gov/30735239/. Accessed November 15, 2023.
  121. Omron R, Kotwal S, Garibaldi BT, Newman-Toker DE. The diagnostic performance feedback “calibration gap”: why clinical experience alone is not enough to prevent serious diagnostic errors. AEM Educ Train 2018 Sep 17;2(4):339-342. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6194049/. Accessed November 15, 2023.
  122. Carr S. Feedback, on the Learning Curve to Improved Diagnosis. Society to Improve Diagnosis in Medicine. ImproveDx Newsletter 2020 Mar;7(2). https://www.improvediagnosis.org/improvedx-march-2020/feedback-on-the-learning-curve-to-improved-diagnosis/. Accessed November 15, 2023.
  123. Lane KP, Chia C, Lessing JN, Limes J, Mathews B, Schaefer J, Seltz LB, Turner G, Wheeler B, Wooldridge D, Olson AP. Improving resident feedback on diagnostic reasoning after handovers: the LOOP Project. J Hosp Med 2019 Oct 1;14(10):622-625. https://pubmed.ncbi.nlm.nih.gov/31433779/. Accessed November 15, 2023.
  124. Meyer AND, Upadhyay DK, Collins CA, Fitzpatrick MH, Kobylinski M, Bansal AB, Torretti D, Singh H. A program to provide clinicians with feedback on their diagnostic performance in a learning health system. Jt Comm J Qual Patient Saf 2021 Feb;47(2):120-126. https://pubmed.ncbi.nlm.nih.gov/32980255/. Accessed November 15, 2023.
  125. Sloane JF, Donkin C, Newell BR, Singh H, Meyer AND. Managing interruptions to improve diagnostic decision-making: strategies and recommended research agenda. J Gen Intern Med 2023 May;38(6):1526-1531. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10160308/. Accessed November 15, 2023.
  126. Zwaan L, Staal J. Issue Brief 3: Evidence on Use of Clinical Reasoning Checklists for Diagnostic Error Reduction. Rockville, MD: Agency for Healthcare Research and Quality; September 2020. AHRQ Publication No. 20-0040-3-EF. https://www.ahrq.gov/patient-safety/reports/issue-briefs/dxchecklists.html. Accessed November 15, 2023.
  127. O’Sullivan ED, Schofield SJ. A cognitive forcing tool to mitigate cognitive bias - a randomised control trial. BMC Med Educ 2019 Jan 8;19(1):12. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6325867/. Accessed November 15, 2023.
  128. Braun LT, Borrmann KF, Lottspeich C, Heinrich DA, Kiesewetter J, Fischer MR, Schmidmaier R. Guessing right - whether and how medical students give incorrect reasons for their correct diagnoses. GMS J Med Educ 2019 Nov 15;36(6):Doc85. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6905369/. Accessed November 15, 2023.
  129. Trowbridge RL, Dhaliwal G, Cosby KS. Educational agenda for diagnostic error reduction. BMJ Qual Saf 2013 Oct;22 Suppl 2(Suppl 2):ii28-ii32. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3786665/. Accessed November 15, 2023.
  130. Cutrer WB, Sullivan WM, Fleming AE. Educational strategies for improving clinical reasoning. Curr Probl Pediatr Adolesc Health Care 2013 Oct;43(9):248-257. https://pubmed.ncbi.nlm.nih.gov/24070582/. Accessed November 15, 2023.
  131. Sudacka M, Adler M, Durning SJ, Edelbring S, Frankowska A, Hartmann D, Hege I, Huwendiek S, Sobočan M, Thiessen N, Wagner FL, Kononowicz AA. Why is it so difficult to implement a longitudinal clinical reasoning curriculum? A multicenter interview study on the barriers perceived by European health professions educators. BMC Med Educ 2021 Nov 12;21(1):575. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8588939/. Accessed November 15, 2023.
  132. Connor DM, Durning SJ, Rencic JJ. Clinical reasoning as a core competency. Acad Med 2020 Aug;95(8):1166-1171. https://pubmed.ncbi.nlm.nih.gov/31577583/. Accessed November 15, 2023.
  133. Avesar M, Erez A, Essakow J, Young C, Cooper B, Akan D, Klein MJ, Chang TP, Rake A. The effects of rudeness, experience, and perspective-taking on challenging premature closure after pediatric ICU physicians receive hand-off with the wrong diagnosis: a randomized controlled simulation trial. Diagnosis (Berl) 2020 Nov 13;8(3):358-367. https://pubmed.ncbi.nlm.nih.gov/33185570/. Accessed November 15, 2023.
  134. Linzer M, Poplau S, Brown R, Grossman E, Varkey A, Yale S, Williams ES, Hicks L, Wallock J, Kohnhorst D, Barbouche M. Do work condition interventions affect quality and errors in primary care? Results from the Healthy Work Place Study. J Gen Intern Med 2017 Jan;32(1):56-61. Epub 2016 Sep 9. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5215160/. Accessed November 15, 2023.
  135. Sarvananthan P, Lin C, Jorjany T. Rates and reasons for safety incident reporting in the medical imaging department of a large academic health sciences centre. J Med Imaging Radiat Sci 2021 Mar;52(1):86-96. https://pubmed.ncbi.nlm.nih.gov/33358628/. Accessed November 15, 2023.
  136. Williams S, Fiumara K, Kachalia A, Desai S. Closing the loop with ambulatory staff on safety reports. Jt Comm J Qual Patient Saf 2020 Jan;46(1):44-50. https://pubmed.ncbi.nlm.nih.gov/31740344/. Accessed November 15, 2023.
  137. Chopra V, Harrod M, Winter S, Forman J, Quinn M, Krein S, Fowler KE, Singh H, Saint S. Focused ethnography of diagnosis in academic medical centers. J Hosp Med 2018 Oct 1;13(10):668-672. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6697101/. Accessed November 15, 2023.
  138. Campione JR, Mardon RE, McDonald KM. Patient safety culture, health information technology implementation, and medical office problems that could lead to diagnostic error. J Patient Saf 2019 Dec;15(4):267-273. https://pubmed.ncbi.nlm.nih.gov/30138158/. Accessed November 15, 2023.
  139. Reece JC, Neal EFG, Nguyen P, McIntosh JG, Emery JD. Delayed or failure to follow-up abnormal breast cancer screening mammograms in primary care: a systematic review. BMC Cancer 2021 Apr 7;21(1):373. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8028768/. Accessed November 15, 2023
  140. Smith MW, Hughes AM, Brown C, Russo E, Giardina TD, Mehta P, Singh H. Test results management and distributed cognition in electronic health record-enabled primary care. Health Informatics J 2019 Dec;25(4):1549-1562. https://pubmed.ncbi.nlm.nih.gov/29905084/. Accessed November 15, 2023.
  141. Goyal MK, Chamberlain JM, Webb M, Grundmeier RW, Johnson TJ, Lorch SA, Zorc JJ, Alessandrini E, Bajaj L, Cook L, Alpern ER; Pediatric Emergency Care Applied Research Network (PECARN). Racial and ethnic disparities in the delayed diagnosis of appendicitis among children. Acad Emerg Med 2021 Sep;28(9):949-956. https://pubmed.ncbi.nlm.nih.gov/32991770/. Accessed November 15, 2023.
  142. Tsoy E, Kiekhofer RE, Guterman EL, Tee BL, Windon CC, Dorsman KA, Lanata SC, Rabinovici GD, Miller BL, Kind AJH, Possin KL. Assessment of racial/ethnic disparities in timeliness and comprehensiveness of dementia diagnosis in California. JAMA Neurol. 2021 Jun 1;78(6):657-665. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8008426/. Accessed November 15, 2023.
  143. Piccardi C, Detollenaere J, Vanden Bussche P, Willems S. Social disparities in patient safety in primary care: a systematic review. Int J Equity Health 2018 Aug 7;17(1):114. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6081855/. Accessed November 15, 2023.
  144. Oh SS, Galanter J, Thakur N, Pino-Yanes M, Barcelo NE, White MJ, de Bruin DM, Greenblatt RM, Bibbins-Domingo K, Wu AH, Borrell LN, Gunter C, Powe NR, Burchard EG. Diversity in clinical and biomedical research: a promise yet to be fulfilled. PLoS Med 2015 Dec 15;12(12):e1001918. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc4679830/. Accessed November 15, 2023.
  145. Serrano L, Ulschmid C, Szabo A, Roth G, Sokumbi O. Racial disparities of delay in diagnosis and dermatologic care for hidradenitis suppurativa. J Natl Med Assoc 2022 Dec;114(6):613-616. https://pubmed.ncbi.nlm.nih.gov/36511276/. Accessed November 15, 2023.
  146. Li HJ, Song Y, Cho YK. Racial disparities in access to diagnostic laparoscopy for endometriosis: diagnostic delay, ED visits, and pre-operative indications. J Minim Invasive Gynecol 2021;28(11):S134. https://doi.org/10.1016/j.jmig.2021.09.241. . Accessed November 15, 2023.
  147. Rubin-Miller L, Alban C, Artiga S, Sullivan S. Issue Brief: COVID-19 Racial Disparities in Testing, Infection, Hospitalization, and Death: Analysis of Epic Patient Data. KFF; September 16, 2020. https://www.kff.org/report-section/covid-19-racial-disparities-in-testing-infection-hospitalization-and-death-analysis-of-epic-patient-data-issue-brief/. Accessed November 15, 2023.
  148. Miller-Kleinhenz JM, Collin LJ, Seidel R, Reddy A, Nash R, Switchenko JM, McCullough LE. Racial disparities in diagnostic delay among women with breast cancer. J Am Coll Radiol 2021 Oct;18(10):1384-1393. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc8492512/. Accessed November 15, 2023.
  149. Ibrahim SA, Pronovost PJ. Diagnostic errors, health disparities, and artificial intelligence: a combination for health or harm? JAMA Health Forum 2021 Sep 3;2(9):e212430. https://pubmed.ncbi.nlm.nih.gov/36218658/. Accessed November 15, 2023.
  150. Giardina TD, Woodard LD, Singh H. Advancing diagnostic equity through clinician engagement, community partnerships, and connected care. J Gen Intern Med 2023 Apr;38(5):1293-1295. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9815889/. Accessed November 15, 2023.
  151. Aronson J, Burgess D, Phelan SM, Juarez L. Unhealthy interactions: the role of stereotype threat in health disparities. Am J Public Health 2013 Jan;103(1):50-6. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc3518353/. Accessed November 15, 2023.
  152. James SA. The strangest of all encounters: racial and ethnic discrimination in U.S. health care. Cad Saude Publica 2017 May 8;33Suppl 1(Suppl 1):e00104416. https://pubmed.ncbi.nlm.nih.gov/28492707/. Accessed November 15, 2023.
  153. Maina IW, Belton TD, Ginzberg S, Singh A, Johnson TJ. A decade of studying implicit racial/ethnic bias in healthcare providers using the implicit association test. Soc Sci Med 2018 Feb;199:219-229. https://pubmed.ncbi.nlm.nih.gov/28532892/. Accessed November 15, 2023.
  154. Dehon E, Weiss N, Jones J, Faulconer W, Hinton E, Sterling S. A systematic review of the impact of physician implicit racial bias on clinical decision making. Acad Emerg Med 2017 Aug;24(8):895-904. https://pubmed.ncbi.nlm.nih.gov/28472533/. Accessed November 15, 2023.
  155. Drewniak D, Krones T, Wild V. Do attitudes and behavior of health care professionals exacerbate health care disparities among immigrant and ethnic minority groups? An integrative literature review. Int J Nurs Stud 2017 May;70:89-98. https://pubmed.ncbi.nlm.nih.gov/28236689/. Accessed November 15, 2023.
  156. Olbert CM, Nagendra A, Buck B. Meta-analysis of Black vs. White racial disparity in schizophrenia diagnosis in the United States: do structured assessments attenuate racial disparities? J Abnorm Psychol 2018 Jan;127(1):104-115. https://pubmed.ncbi.nlm.nih.gov/29094963/. Accessed November 15, 2023.
  157. Gara MA, Minsky S, Silverstein SM, Miskimen T, Strakowski SM. A naturalistic study of racial disparities in diagnoses at an outpatient behavioral health clinic. Psychiatr Serv 2019 Feb 1;70(2):130-134. https://pubmed.ncbi.nlm.nih.gov/30526340/. Accessed November 15, 2023.
  158. Schwartz EK, Docherty NM, Najolia GM, Cohen AS. Exploring the racial diagnostic bias of schizophrenia using behavioral and clinical-based measures. J Abnorm Psychol 2019 Apr;128(3):263-271. https://pubmed.ncbi.nlm.nih.gov/30762376/. Accessed November 15, 2023.
  159. Mehta PK, Bess C, Elias-Smale S, Vaccarino V, Quyyumi A, Pepine CJ, Bairey Merz CN. Gender in cardiovascular medicine: chest pain and coronary artery disease. Eur Heart J 2019 Dec 14;40(47):3819-3826. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7963141/. Accessed November 15, 2023.
  160. Slomski A. Why do hundreds of U.S. women die annually in childbirth? JAMA 2019 Apr 2;321(13):1239-1241. https://pubmed.ncbi.nlm.nih.gov/30865241/. Accessed November 15, 2023.
  161. Bell SK, Dong J, Ngo L, McGaffigan P, Thomas EJ, Bourgeois F. Diagnostic error experiences of patients and families with limited English-language health literacy or disadvantaged socioeconomic position in a cross-sectional U.S. population-based survey. BMJ Qual Saf 2022 Feb 4:bmjqs-2021-013937. https://pubmed.ncbi.nlm.nih.gov/35121653/. Accessed November 15, 2023.
  162. Skvortsova A, Meeuwis SH, Vos RC, Vos HMM, van Middendorp H, Veldhuijzen DS, Evers AWM. Implicit gender bias in the diagnosis and treatment of type 2 diabetes: a randomized online study. Diabet Med 2023 Aug;40(8):e15087. https://pubmed.ncbi.nlm.nih.gov/36919798/. Accessed November 15, 2023.
  163. Gonzalez CM, Deno ML, Kintzer E, Marantz PR, Lypson ML, McKee MD. Patient perspectives on racial and ethnic implicit bias in clinical encounters: implications for curriculum development. Patient Educ Couns 2018 Sep;101(9):1669-1675. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7065496/. Accessed November 15, 2023.
  164. Cwik JC, Papen F, Lemke JE, Margraf J. An investigation of diagnostic accuracy and confidence associated with diagnostic checklists as well as gender biases in relation to mental disorders. Front Psychol 2016 Nov 22;7:1813. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5118628/. Accessed November 15, 2023.
  165. Burgess DJ, Beach MC, Saha S. Mindfulness practice: a promising approach to reducing the effects of clinician implicit bias on patients. Patient Educ Couns 2017 Feb;100(2):372-376. https://pubmed.ncbi.nlm.nih.gov/27665499/. Accessed November 15, 2023.
  166. Wiegand AA, Dukhanin V, Sheikh T, Zannath F, Jajodia A, Schrandt S, Haskell H, McDonald KM. Human centered design workshops as a meta-solution to diagnostic disparities. Diagnosis (Berl) 2022 Aug 29;9(4):458-467. https://pubmed.ncbi.nlm.nih.gov/36027891/. Accessed November 15, 2023.
  167. King J, Patel V, Jamoom EW, Furukawa MF. Clinical benefits of electronic health record use: national findings. Health Serv Res 2014 Feb;49(1 Pt 2):392-404. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3925409/. Accessed November 15, 2023.
  168. Graber ML, Byrne C, Johnston D. The impact of electronic health records on diagnosis. Diagnosis (Berl) 2017 Nov 27;4(4):211-223. https://pubmed.ncbi.nlm.nih.gov/29536944/. Accessed November 15, 2023.
  169. Krevat SA, Samuel S, Boxley C, Mohan V, Siegal D, Gold JA, Ratwani RM. Identifying electronic health record contributions to diagnostic error in ambulatory settings through legal claims analysis. JAMA Netw Open 2023 Apr 3;6(4):e238399. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10105306/. Accessed November 15, 2023.
  170. Powell L, Sittig DF, Chrouser K, Singh H. Assessment of health information technology-related outpatient diagnostic delays in the U.S. Veterans Affairs health care system: a qualitative study of aggregated root cause analysis data. JAMA Netw Open 2020 Jun 1;3(6):e206752. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7317596/. Accessed November 15, 2023.
  171. Quinn M, Forman J, Harrod M, Winter S, Fowler KE, Krein SL, Gupta A, Saint S, Singh H, Chopra V. Electronic health records, communication, and data sharing: challenges and opportunities for improving the diagnostic process. Diagnosis (Berl) 2019 Aug 27;6(3):241-248. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6691503/. Accessed November 15, 2023.
  172. El-Kareh R, Hasan O, Schiff GD. Use of health information technology to reduce diagnostic errors. BMJ Qual Saf 2013 Oct;22 Suppl 2(Suppl 2):ii40-ii51. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3786650/. Accessed November 15, 2023.
  173. Dixit RA, Boxley CL, Samuel S, Mohan V, Ratwani RM, Gold JA. Electronic health record use issues and diagnostic error: a scoping review and framework. J Patient Saf 2023 Jan 1;19(1):e25-e30. https://pubmed.ncbi.nlm.nih.gov/36538341/. Accessed November 15, 2023.
  174. Shaver J. The state of telehealth before and after the COVID-19 pandemic. Prim Care 2022 Dec;49(4):517-530. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9035352/. Accessed November 15, 2023.
  175. Weiner JP, Bandeian S, Hatef E, Lans D, Liu A, Lemke KW. In-person and telehealth ambulatory contacts and costs in a large U.S. insured cohort before and during the COVID-19 pandemic. JAMA Netw Open 2021 Mar 1;4(3):e212618. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7988360/. Accessed November 15, 2023.
  176. Mars M. Telemedicine and advances in urban and rural healthcare delivery in Africa. Prog Cardiovasc Dis 2013 Nov-Dec;56(3):326-335. https://pubmed.ncbi.nlm.nih.gov/24267440/. Accessed November 15, 2023.
  177. Quadflieg LTM, Beckers SK, Bergrath S, Brockert AK, Schröder H, Sommer A, Brokmann JC, Rossaint R, Felzen M. Comparing the diagnostic concordance of tele-EMS and on-site-EMS physicians in emergency medical services: a retrospective cohort study. Sci Rep 2020 Oct 22;10(1):17982. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7581718/. Accessed November 15, 2023.
  178. Brokmann JC, Rossaint R, Bergrath S, Valentin B, Beckers SK, Hirsch F, Jeschke S, Czaplik M. Potential and effectiveness of a telemedical rescue assistance system. Prospective observational study on implementation in emergency medicine. Anaesthesist 2015 Jun;64(6):438-445. German. https://pubmed.ncbi.nlm.nih.gov/26036316/. Accessed November 15, 2023.
  179. McCleery J, Laverty J, Quinn TJ. Diagnostic test accuracy of telehealth assessment for dementia and mild cognitive impairment. Cochrane Database Syst Rev 2021 Jul 20;7(7):CD013786. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8406800/. Accessed November 15, 2023.
  180. Siew L, Hsiao A, McCarthy P, Agarwal A, Lee E, Chen L. Reliability of telemedicine in the assessment of seriously ill children. Pediatrics 2016 Mar;137(3):e20150712. https://pubmed.ncbi.nlm.nih.gov/26908666/. Accessed November 15, 2023.
  181. Uscher-Pines L, Mulcahy A, Cowling D, Hunter G, Burns R, Mehrotra A. Access and quality of care in direct-to-consumer telemedicine. Telemed J E Health 2016 Apr;22(4):282-7. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4968275/. Accessed November 15, 2023.
  182. Grazioli S, Crippa A, Rosi E, Candelieri A, Ceccarelli SB, Mauri M, Manzoni M, Mauri V, Trabattoni S, Molteni M, Colombo P, Nobile M. Exploring telediagnostic procedures in child neuropsychiatry: addressing ADHD diagnosis and autism symptoms through supervised machine learning. Eur Child Adolesc Psychiatry 2023 Jan 25:1–11. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9875192/. Accessed November 15, 2023.
  183. Chima S, Martinez-Gutierrez J, Hunter B, Manski-Nankervis JA, Emery J. Optimization of a quality improvement tool for cancer diagnosis in primary care: qualitative study. JMIR Form Res 2022 Aug 4;6(8):e39277. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9389376/. Accessed November 15, 2023.
  184. Romero-Aroca P, Verges R, Maarof N, Vallas-Mateu A, Latorre A, Moreno-Ribas A, Sagarra-Alamo R, Basora-Gallisa J, Cristiano J, Baget-Bernaldiz M. Real-world outcomes of a clinical decision support system for diabetic retinopathy in Spain. BMJ Open Ophthalmol 2022 Mar 28;7(1):e000974. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8961111/. Accessed November 15, 2023.
  185. Miyachi Y, Ishii O, Torigoe K. Design, implementation, and evaluation of the computer-aided clinical decision support system based on learning-to-rank: collaboration between physicians and machine learning in the differential diagnosis process. BMC Med Inform Decis Mak 2023 Feb 2;23(1):26. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9896739/. Accessed November 15, 2023.
  186. Bien N, Rajpurkar P, Ball RL, Irvin J, Park A, Jones E, Bereket M, Patel BN, Yeom KW, Shpanskaya K, Halabi S, Zucker E, Fanton G, Amanatullah DF, Beaulieu CF, Riley GM, Stewart RJ, Blankenberg FG, Larson DB, Jones RH, Langlotz CP, Ng AY, Lungren MP. Deep-learning-assisted diagnosis for knee magnetic resonance imaging: development and retrospective validation of MRNet. PLoS Med 2018 Nov 27;15(11):e1002699. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6258509/. Accessed November 15, 2023.
  187. Shimizu T, Nemoto T, Tokuda Y. Effectiveness of a clinical knowledge support system for reducing diagnostic errors in outpatient care in Japan: a retrospective study. Int J Med Inform 2018 Jan;109:1-4. https://pubmed.ncbi.nlm.nih.gov/29195700/. Accessed November 15, 2023.
  188. Kulkarni PA, Singh H. Artificial intelligence in clinical diagnosis: opportunities, challenges, and hype. JAMA 2023 Jul 25;330(4):317-318. https://pubmed.ncbi.nlm.nih.gov/37410477/. Accessed November 15, 2023.
  189. Liu X, Faes L, Kale AU, Wagner SK, Fu DJ, Bruynseels A, Mahendiran T, Moraes G, Shamdas M, Kern C, Ledsam JR, Schmid MK, Balaskas K, Topol EJ, Bachmann LM, Keane PA, Denniston AK. A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. Lancet Digit Health 2019 Oct;1(6):e271-e297. https://pubmed.ncbi.nlm.nih.gov/33323251/. Accessed November 15, 2023.
  190. Semigran HL, Levine DM, Nundy S, Mehrotra A. Comparison of physician and computer diagnostic accuracy. JAMA Intern Med 2016 Dec 1;176(12):1860-1861. https://pubmed.ncbi.nlm.nih.gov/27723877/. Accessed November 15, 2023.
  191. Carr S. Patients gain control of personal health information with the 21st Century Cures Act and OpenNotes. Society to Improve Diagnosis in Medicine. ImproveDx Newsletter 2020 Nov;7(6). https://www.improvediagnosis.org/publications/improvedx-newsletter/improvedx-november-2020/patients-gain-control-of-personal-health-information-with-the-21st-century-cures-act-and-opennotes/. Accessed November 15, 2023.
  192. Giardina TD, Korukonda S, Shahid U, Vaghani V, Upadhyay DK, Burke GF, Singh H. Use of patient complaints to identify diagnosis-related safety concerns: a mixed-method evaluation. BMJ Qual Saf 2021 Dec;30(12):996-1001. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8552507/. Accessed November 15, 2023.
  193. McDonald KM, Bryce CL, Graber ML. The patient is in: patient involvement strategies for diagnostic error mitigation. BMJ Qual Saf 2013 Oct;22 Suppl 2(Suppl 2):ii33-ii39. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3786634/. Accessed November 15, 2023.
  194. Garibaldi BT, Zaman J, Artandi MK, Elder AT, Russell SW. Reinvigorating the clinical examination for the 21st century. Pol Arch Intern Med 2019 Dec 23;129(12):907-912. https://pubmed.ncbi.nlm.nih.gov/31777402/. Accessed November 15, 2023.
  195. Liberman AL, Skillings J, Greenberg P, Newman-Toker DE, Siegal D. Breakdowns in the initial patient-provider encounter are a frequent source of diagnostic error among ischemic stroke cases included in a large medical malpractice claims database. Diagnosis (Berl) 2020 Jan 28;7(1):37-43. https://pubmed.ncbi.nlm.nih.gov/31535831/. Accessed November 15, 2023.
  196. Howard M, Fleming ML, Parker E. Patients do not always complain when they are dissatisfied: implications for service quality and patient safety. J Patient Saf 2013 Dec;9(4):224-31. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6438369/. Accessed November 15, 2023.
  197. Schnock KO, Garber A, Fraser H, Carnie M, Schnipper JL, Dalal AK, Bates DW, Rozenblum R. Providers’ and patients’ perspectives on diagnostic errors in the acute care setting. Jt Comm J Qual Patient Saf 2023 Feb;49(2):89-97. https://pubmed.ncbi.nlm.nih.gov/36585316/. Accessed November 15, 2023.
  198. Sacco AY, Self QR, Worswick EL, Couperus CJ, Kolli SS, Muñoz SA, Carney JK, Repp AB. Patients’ perspectives of diagnostic error: a qualitative study. J Patient Saf 2021 Dec 1;17(8):e1759-e1764. https://pubmed.ncbi.nlm.nih.gov/32168272/. Accessed November 15, 2023.
  199. Meyer AND, Giardina TD, Spitzmueller C, Shahid U, Scott TMT, Singh H. Patient perspectives on the usefulness of an artificial intelligence-assisted symptom checker: cross-sectional survey study. J Med Internet Res 2020 Jan 30;22(1):e14679. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7055765/. Accessed November 15, 2023.
  200. Danforth KN, Hahn EE, Slezak JM, Chen LH, Li BH, Munoz-Plaza CE, Luong TQ, Harrison TN, Mittman BS, Sim JJ, Singh H, Kanter MH. Follow-up of abnormal estimated GFR results within a large integrated health care delivery system: a mixed-methods study. Am J Kidney Dis 2019 Nov;74(5):589-600. https://pubmed.ncbi.nlm.nih.gov/31324445/. Accessed November 15, 2023.
  201. Sheridan S, Merryweather P, Rusz D. What if? Transforming diagnostic research by leveraging a diagnostic process map to engage patients in learning from errors. NAM Perspect 2020 Feb 18;2020:10.31478/202002a. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8406596/. Accessed November 15, 2023.
  202. Khazen M, Mirica M, Carlile N, Groisser A, Schiff GD. Developing a framework and electronic tool for communicating diagnostic uncertainty in primary care: a qualitative study. JAMA Netw Open 2023 Mar 1;6(3):e232218. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9999246/. Accessed November 15, 2023.
  203. Berwick DM. Diagnostic excellence through the lens of patient-centeredness. JAMA 2021 Dec 7;326(21):2127-2128. https://pubmed.ncbi.nlm.nih.gov/34792525/. Accessed November 15, 2023.
  204. Peterson A, Cruse D, Naci L, Weijer C, Owen AM. Risk, diagnostic error, and the clinical science of consciousness. Neuroimage Clin 2015 Feb 20;7:588-597. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4375779/. Accessed November 15, 2023.
  205. Graedon T, Graedon J. Let patients help with diagnosis. Diagnosis (Berl) 2014 Jan 1;1(1):49-51. https://pubmed.ncbi.nlm.nih.gov/29539987/. Accessed November 15, 2023.
  206. Agency for Healthcare Research and Quality. Toolkit for Engaging Patients To Improve Diagnostic Safety. Content last reviewed July 2022.. https://www.ahrq.gov/patient-safety/settings/ambulatory/tools/diagnostic-safety/toolkit.html. Accessed November 15, 2023.
  207. Agency for Healthcare Research and Quality. Health Information Technology for Engaging Patients in Diagnostic Decision Making in Emergency Departments: Future Directions and Research Priorities. Content last reviewed February 2021. https://www.ahrq.gov/patient-safety/reports/issue-briefs/healthit-ed-6.html. Accessed November 15, 2023.
  208. Agency for Healthcare Research and Quality. Guide to Patient and Family Engagement: Summary and Discussion. Content last reviewed July 2018. https://www.ahrq.gov/research/findings/final-reports/ptfamilyscan/ptfamily4.html. Accessed November 15, 2023.
  209. Department of Health and Human Services. 21st Century Cures Act: Interoperability, Information Blocking, and the ONC Health IT Certification Program. Federal Register 2020 May 1;85(85):25642. https://www.govinfo.gov/content/pkg/FR-2020-05-01/pdf/2020-07419.pdf. Accessed November 15, 2023.
  210. Bell SK, Dong ZJ, Desroches CM, Hart N, Liu S, Mahon B, Ngo LH, Thomas EJ, Bourgeois F. Partnering with patients and families living with chronic conditions to coproduce diagnostic safety through OurDX: a previsit online engagement tool. J Am Med Inform Assoc 2023 Mar 16;30(4):692-702. https://pubmed.ncbi.nlm.nih.gov/36692204/. Accessed November 15, 2023.
  211. Baldwin JL, Singh H, Sittig DF, Giardina TD. Patient portals and health apps: pitfalls, promises, and what one might learn from the other. Healthc (Amst) 2017 Sep;5(3):81-85. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8386919/. Accessed November 15, 2023.
  212. Wattanapisit A, Teo CH, Wattanapisit S, Teoh E, Woo WJ, Ng CJ. Can mobile health apps replace GPs? A scoping review of comparisons between mobile apps and GP tasks. BMC Med Inform Decis Mak 2020 Jan 6;20(1):5. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6945711/. Accessed November 15, 2023.
  213. Millenson ML, Baldwin JL, Zipperer L, Singh H. Beyond Dr. Google: the evidence on consumer-facing digital tools for diagnosis. Diagnosis (Berl) 2018 Sep 25;5(3):95-105. https://pubmed.ncbi.nlm.nih.gov/30032130/. Accessed November 15, 2023.
  214. Meyer AND, Thompson PJ, Khanna A, Desai S, Mathews BK, Yousef E, Kusnoor AV, Singh H. Evaluating a mobile application for improving clinical laboratory test ordering and diagnosis. J Am Med Inform Assoc 2018 Jul 1;25(7):841-847. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6947660/. Accessed November 15, 2023.
  215. Schmieding ML, Kopka M, Schmidt K, Schulz-Niethammer S, Balzer F, Feufel MA. Triage accuracy of symptom checker apps: 5-year follow-up evaluation. J Med Internet Res 2022 May 10;24(5):e31810. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9131144/. Accessed November 15, 2023.
  216. Callen JL, Westbrook JI, Georgiou A, Li J. Failure to follow-up test results for ambulatory patients: a systematic review. J Gen Intern Med 2012 Oct;27(10):1334-1348. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3445672/. Accessed November 15, 2023.
  217. Hysong SJ, Sawhney MK, Wilson L, Sittig DF, Esquivel A, Singh S, Singh H. Understanding the management of electronic test result notifications in the outpatient setting. BMC Med Inform Decis Mak 2011 Apr 12;11:22. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3100236/. Accessed November 15, 2023.
  218. Casalino LP, Dunham D, Chin MH, Bielang R, Kistner EO, Karrison TG, Ong MK, Sarkar U, McLaughlin MA, Meltzer DO. Frequency of failure to inform patients of clinically significant outpatient test results. Arch Intern Med 2009 Jun 22;169(12):1123-1129. Erratum in: Arch Intern Med 2009 Sep 28;169(17):1626. https://pubmed.ncbi.nlm.nih.gov/19546413/. Accessed November 15, 2023.
  219. Bellini C, Guerranti R, Cinci F, Milletti E, Scapellato C. Defining and managing the preanalytical phase with FMECA: automation and/or “human” control. Hum Factors 2020 Feb;62(1):20-36. https://pubmed.ncbi.nlm.nih.gov/31525072/. Accessed November 15, 2023.
  220. Lubin IM, Astles JR, Shahangian S, Madison B, Parry R, Schmidt RL, Rubinstein ML. Bringing the clinical laboratory into the strategy to advance diagnostic excellence. Diagnosis (Berl) 2021 Jan 6;8(3):281-294. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8255320/. Accessed November 15, 2023.
  221. Heher YK, Chen Y, VanderLaan PA. Pre-analytic error: a significant patient safety risk. Cancer Cytopathol 2018 Aug;126 Suppl 8:738-744. https://pubmed.ncbi.nlm.nih.gov/30156766/. Accessed November 15, 2023.
  222. Fatemi Y, Bergl PA. Diagnostic stewardship: appropriate testing and judicious treatments. Crit Care Clin 2022 Jan;38(1):69-87. https://pubmed.ncbi.nlm.nih.gov/34794632/. Accessed November 15, 2023.
  223. Ngo A, Gandhi P, Miller WG. Frequency that laboratory tests influence medical decisions. J Appl Lab Med 2017 Jan 1;1(4):410-414. https://pubmed.ncbi.nlm.nih.gov/33636802/. Accessed November 15, 2023.
  224. Zimolzak AJ, Shahid U, Giardina TD, Memon SA, Mushtaq U, Zubkoff L, Murphy DR, Bradford A, Singh H. Why test results are still getting “lost” to follow-up: a qualitative study of implementation gaps. J Gen Intern Med 2022 Jan;37(1):137-144. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8739406/. Accessed November 15, 2023.
  225. Thomas J, Dahm MR, Li J, Georgiou A. Can patients contribute to enhancing the safety and effectiveness of test-result follow-up? Qualitative outcomes from a health consumer workshop. Health Expect 2021 Apr;24(2):222-233. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8077113/. Accessed November 15, 2023.
  226. Sittig DF, Singh H. Improving test result follow-up through electronic health records requires more than just an alert. J Gen Intern Med 2012 Oct;27(10):1235-7. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3445682/. Accessed November 15, 2023.
  227. Wright B, Lennox A, Graber ML, Bragge P. Closing the loop on test results to reduce communication failures: a rapid review of evidence, practice and patient perspectives. BMC Health Serv Res 2020 Sep 23;20(1):897. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7510293/. Accessed November 15, 2023.
  228. Singh H, Spitzmueller C, Petersen NJ, Sawhney MK, Sittig DF. Information overload and missed test results in electronic health record-based settings. JAMA Intern Med 2013 Apr 22;173(8):702-704. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3822526/. Accessed November 15, 2023.
  229. van Balveren JA, Verboeket-van de Venne WPHG, Erdem-Eraslan L, de Graaf AJ, Loot AE, Musson REA, Oosterhuis WP, Schuijt MP, van der Sijs H, Verheul RJ, de Wolf HK, Kusters R, Hoedemakers RMJ; Dutch Society for Clinical Chemistry and Laboratory Medicine, task group “SMILE”: Signalling Medication Interactions and Laboratory test Expert system. Diagnostic error as a result of drug-laboratory test interactions. Diagnosis (Berl) 2019 Mar 26;6(1):69-71. https://pubmed.ncbi.nlm.nih.gov/30753158/. Accessed November 15, 2023.
  230. Georgiou A, Li J, Thomas J, Dahm MR, Westbrook JI. The impact of health information technology on the management and follow-up of test results - a systematic review. J Am Med Inform Assoc 2019 Jul 1;26(7):678-688. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6562156/. Accessed November 15, 2023.
  231. Whitehead NS, Williams L, Meleth S, Kennedy S, Epner P, Singh H, Wooldridge K, Dalal AK, Walz SE, Lorey T, Graber ML. Interventions to improve follow-up of laboratory test results pending at discharge: a systematic review. J Hosp Med 2018 Sep;13(9):631-636. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9491200/. Accessed November 15, 2023.
  232. Peck M, Moffat D, Latham B, Badrick T. Review of diagnostic error in anatomical pathology and the role and value of second opinions in error prevention. J Clin Pathol 2018 Nov;71(11):995-1000. https://pubmed.ncbi.nlm.nih.gov/30068638/. Accessed November 15, 2023.
  233. Kadom N, Doherty G, Solomon A, Close M, Friedman S, Gregson D, Rostad BS, Moses JM, Norbash A. Safety-net academic hospital experience in following up noncritical yet potentially significant radiologist recommendations. AJR Am J Roentgenol 2017 Nov;209(5):982-986. https://pubmed.ncbi.nlm.nih.gov/28777651/. Accessed November 15, 2023.
  234. Dave N, Bui S, Morgan C, Hickey S, Paul CL. Interventions targeted at reducing diagnostic error: systematic review. BMJ Qual Saf 2022 Apr;31(4):297-307. https://pubmed.ncbi.nlm.nih.gov/34408064/. Accessed November 15, 2023.
  235. Abimanyi-Ochom J, Bohingamu Mudiyanselage S, Catchpool M, Firipis M, Wanni Arachchige Dona S, Watts JJ. Strategies to reduce diagnostic errors: a systematic review. BMC Med Inform Decis Mak 2019 Aug 30;19(1):174. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6716834/. Accessed November 15, 2023.
  236. Agency for Healthcare Research and Quality. Making Healthcare Safer III: A Critical Analysis of Existing and Emerging Patient Safety Practices. Content last reviewed April 2020. https://www.ahrq.gov/research/findings/making-healthcare-safer/mhs3/index.html. Accessed November 15, 2023.
  237. Royce CS, Hayes MM, Schwartzstein RM. Teaching critical thinking: a case for instruction in cognitive biases to reduce diagnostic errors and improve patient safety. Acad Med 2019 Feb;94(2):187-194. https://pubmed.ncbi.nlm.nih.gov/30398993/. Accessed November 15, 2023.
  238. Garibaldi BT, Kugler J, Goyal A, Ozdalga E, Niessen T, Liu G, Manesh R, Desai S, Elder A. The physical examination, including point of care technology, is an important part of the diagnostic process and should be included in educational interventions to improve clinical reasoning. Diagnosis (Berl) 2019 Aug 27;6(3):299-300. https://pubmed.ncbi.nlm.nih.gov/30375346/. Accessed November 15, 2023.
  239. Radhakrishnan NS, Singh H, Southwick FS. Teaching novice clinicians how to reduce diagnostic waste and errors by applying the Toyota Production System. Diagnosis (Berl) 2019 Jun 26;6(2):179-185. https://pubmed.ncbi.nlm.nih.gov/30875320/. Accessed November 15, 2023.
  240. Harris M, Rhoads SJ, Rooker JS, Kelly MA, Lefler L, Lubin S, Martel IL, Beverly CJ. Using virtual site visits in the clinical evaluation of nurse practitioner students: student and faculty perspectives. Nurse Educ 2020 Jan/Feb;45(1):17-20. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7329243/. Accessed November 15, 2023.
  241. Ruedinger E, Olson M, Yee J, Borman-Shoap E, Olson APJ. Education for the next frontier in patient safety: a longitudinal resident curriculum on diagnostic error. Am J Med Qual 2017 Nov/Dec;32(6):625-631. https://pubmed.ncbi.nlm.nih.gov/27903769/. Accessed November 15, 2023.
  242. Reilly JB, Ogdie AR, Von Feldt JM, Myers JS. Teaching about how doctors think: a longitudinal curriculum in cognitive bias and diagnostic error for residents. BMJ Qual Saf 2013 Dec;22(12):1044-1050. https://pubmed.ncbi.nlm.nih.gov/23955466/. Accessed November 15, 2023.
  243. Olson A, Rencic J, Cosby K, Rusz D, Papa F, Croskerry P, Zierler B, Harkless G, Giuliano MA, Schoenbaum S, Colford C, Cahill M, Gerstner L, Grice GR, Graber ML. Competencies for improving diagnosis: an interprofessional framework for education and training in health care. Diagnosis (Berl) 2019 Nov 26;6(4):335-341. https://pubmed.ncbi.nlm.nih.gov/31271549/. Accessed November 15, 2023.
  244. Ely JW, Graber ML, Croskerry P. Checklists to reduce diagnostic errors. Acad Med 2011 Mar;86(3):307-313. https://pubmed.ncbi.nlm.nih.gov/21248608/. Accessed November 15, 2023.
  245. Graber ML, Sorensen AV, Biswas J, Modi V, Wackett A, Johnson S, Lenfestey N, Meyer AN, Singh H. Developing checklists to prevent diagnostic error in emergency room settings. Diagnosis (Berl) 2014 Sep;1(3):223-231. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4799784/. Accessed November 15, 2023.
  246. Kämmer JE, Schauber SK, Hautz SC, Stroben F, Hautz WE. Differential diagnosis checklists reduce diagnostic error differentially: a randomised experiment. Med Educ 2021 Oct;55(10):1172-1182. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9290564/. Accessed November 15, 2023.
  247. Sibbald M, Sherbino J, Ilgen JS, Zwaan L, Blissett S, Monteiro S, Norman G. Correction to: Debiasing versus knowledge retrieval checklists to reduce diagnostic error in ECG interpretation. Adv Health Sci Educ Theory Pract 2019 Aug;24(3):441-442. Erratum for: Adv Health Sci Educ Theory Pract 2019 Aug;24(3):427-440. Epub 2019 Jan 29. https://pubmed.ncbi.nlm.nih.gov/30915640/. Accessed November 15, 2023.
  248. Staal J, Zegers R, Caljouw-Vos J, Mamede S, Zwaan L. Impact of diagnostic checklists on the interpretation of normal and abnormal electrocardiograms. Diagnosis (Berl) May 1 2023;10(2):121-129. https://pubmed.ncbi.nlm.nih.gov/36490202/. Accessed November 15, 2023.
  249. Chima S, Reece JC, Milley K, Milton S, McIntosh JG, Emery JD. Decision support tools to improve cancer diagnostic decision making in primary care: a systematic review. Br J Gen Pract Dec 2019;69(689):e809-e818. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6863677/. Accessed November 15, 2023.
  250. Kostopoulou O, Porat T, Corrigan D, Mahmoud S, Delaney BC. Diagnostic accuracy of GPs when using an early-intervention decision support system: a high-fidelity simulation. Br J Gen Pract 2017 Mar;67(656):e201-e208. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5325662/. Accessed November 15, 2023.
  251. Nurek M, Kostopoulou O, Delaney BC, Esmail A. Reducing diagnostic errors in primary care. A systematic meta-review of computerized diagnostic decision support systems by the LINNEAUS collaboration on patient safety in primary care. Eur J Gen Pract Sep 2015;21 Suppl(sup1):8-13. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4828626/. Accessed November 15, 2023.
  252. Kawamura R, Harada Y, Sugimoto S, Nagase Y, Katsukura S, Shimizu T. Incidence of diagnostic errors among unexpectedly hospitalized patients using an automated medical history-taking system with a differential diagnosis generator: retrospective observational study. JMIR Med Inform Jan 27 2022;10(1):e35225. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8832260/. Accessed November 15, 2023.
  253. Carayon P, Hoonakker P, Hundt AS, Salwei M, Wiegmann D, Brown RL, Kleinschmidt P, Novak C, Pulia M, Wang Y, Wirkus E, Patterson B. Application of human factors to improve usability of clinical decision support for diagnostic decision-making: a scenario-based simulation study. BMJ Qual Saf 2020 Apr;29(4):329-340. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7490974/. Accessed November 15, 2023.
  254. Sibbald M, Abdulla B, Keuhl A, Norman G, Monteiro S, Sherbino J. Electronic diagnostic support in emergency physician triage: qualitative study with thematic analysis of interviews. JMIR Hum Factors 2022 Sep 30;9(3):e39234. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9568817/. Accessed November 15, 2023.
  255. Barnett ML, Boddupalli D, Nundy S, Bates DW. Comparative accuracy of diagnosis by collective intelligence of multiple physicians vs individual physicians. JAMA Netw Open 2019 Mar 1;2(3):e190096. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6484633/. Accessed November 15, 2023.
  256. Pinnock R, Ritchie D, Gallagher S, Henning MA, Webster CS. The efficacy of mindful practice in improving diagnosis in healthcare: a systematic review and evidence synthesis. Adv Health Sci Educ Theory Pract Aug 2021;26(3):785-809. https://pubmed.ncbi.nlm.nih.gov/33389234/. Accessed November 15, 2023.
  257. Lambe KA, Hevey D, Kelly BD. Guided reflection interventions show no effect on diagnostic accuracy in medical students. Front Psychol 2018;9:2297. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6265413/. Accessed November 15, 2023.
  258. Mohan D, Elmer J, Arnold RM, Forsythe RM, Fischhoff B, Rak K, Barnes JL, White DB. Testing the feasibility, acceptability, and preliminary effect of a novel deliberate practice intervention to reduce diagnostic error in trauma triage: a study protocol for a randomized pilot trial. Pilot Feasibility Stud 2022 Dec 12;8(1):253. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9743730/. Accessed November 15, 2023.
  259. Kasick RT, Melvin JE, Perera ST, Perry MF, Black JD, Bode RS, Groner JI, Kersey KE, Klamer BG, Bai S, McClead RE. A diagnostic time-out to improve differential diagnosis in pediatric abdominal pain. Diagnosis (Berl) 2019 Nov 2;8(2):209-217. https://pubmed.ncbi.nlm.nih.gov/31677376/. Accessed November 15, 2023.
  260. Agency for Healthcare Research and Quality. CUSP Toolkit: Patient and Family Engagement. Content last reviewed September 2013. https://www.ahrq.gov/hai/cusp/modules/patient-family-engagement/sl-pat-fam.html. Accessed November 15, 2023.
  261. Agency for Healthcare Research and Quality. Issue Brief 12, Vol. 1: Patient Experience as a Source for Understanding the Origins, Impact, and Remediation of Diagnostic Errors. Content last reviewed July 2023. https://www.ahrq.gov/patient-safety/reports/issue-briefs/dxsafety-patients-source-understanding-dx-error-vol1.html. Accessed November 15, 2023.
  262. Agency for Healthcare Research and Quality. TeamSTEPPS Diagnosis Improvement Course. Content last reviewed June 2023. https://www.ahrq.gov/teamstepps-program/diagnosis-improvement/index.html. Accessed November 15, 2023.
  263. Hüner B, Derksen C, Schmiedhofer M, Lippke S, Riedmüller S, Janni W, Reister F, Scholz C. Reducing preventable adverse events in obstetrics by improving interprofessional communication skills - results of an intervention study. BMC Pregnancy Childbirth 2023 Jan 23;23(1):55. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9869321/. Accessed November 15, 2023.
  264. Verna R, Velazquez AB, Laposata M. Reducing diagnostic errors worldwide through diagnostic management teams. Ann Lab Med Mar 2019;39(2):121-124. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6240519/. Accessed November 15, 2023.
  265. Pacheco E, Sohn AJ, Wells C, Sharp LK, Madrid S, Lee TA, Chen YF, Yawn BP, Garcia D, Shim K, Quesada N, Joo MJ. Design of the Reducing Diagnostic Error to Improve Patient Safety (REDEfINE) in COPD and asthma study: a cluster randomized comparative effectiveness trial. Contemp Clin Trials 2022 Dec;123:106971. https://pubmed.ncbi.nlm.nih.gov/36280032/. Accessed November 15, 2023.
  266. Bundy DG, Singh H, Stein RE, Brady TM, Lehmann CU, Heo M, O’Donnell HC, Rice-Conboy E, Rinke ML. The design and conduct of Project RedDE: a cluster-randomized trial to reduce diagnostic errors in pediatric primary care. Clin Trials 2019 Apr;16(2):154-164. https://pubmed.ncbi.nlm.nih.gov/30720339/. Accessed November 15, 2023.
  267. Khoo EM, Sararaks S, Lee WK, Liew SM, Cheong AT, Abdul Samad A, Maskon K, Hamid MA. Reducing medical errors in primary care using a pragmatic complex intervention. Asia Pac J Public Health 2015 Sep;27(6):670-677. https://pubmed.ncbi.nlm.nih.gov/25563351/. Accessed November 15, 2023.
  268. Giardina TD, Shahid U, Mushtaq U, Upadhyay DK, Marinez A, Singh H. Creating a learning health system for improving diagnostic safety: pragmatic insights from U.S. health care organizations. J Gen Intern Med 2022 Nov;37(15):3965-3972. https://pubmed.ncbi.nlm.nih.gov/35650467/. Accessed November 15, 2023.
  269. Yousef EA, Sutcliffe KM, McDonald KM, Newman-Toker DE. Crossing academic boundaries for diagnostic safety: 10 complex challenges and potential solutions from clinical perspectives and high-reliability organizing principles. Hum Factors 2022 Feb;64(1):6-20. https://pubmed.ncbi.nlm.nih.gov/33657891/. Accessed November 15, 2023.
  270. Singh H, Upadhyay DK, Torretti D. Developing health care organizations that pursue learning and exploration of diagnostic excellence: an action plan. Acad Med Aug 2020;95(8):1172-1178. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7402609/. Accessed November 15, 2023.
  271. Newman-Toker DE, Austin JM, Derk J, Danforth M, Graber ML. Are health care provider organizations ready to tackle diagnostic error? A survey of Leapfrog-participating hospitals. Diagnosis (Berl) Jun 27 2017;4(2):73-78. https://pubmed.ncbi.nlm.nih.gov/29536922/. Accessed November 15, 2023.
  272. Searns JB, Williams MC, MacBrayne CE, Wirtz AL, Leonard JE, Boguniewicz J, Parker SK, Grubenhoff JA. Handshake antimicrobial stewardship as a model to recognize and prevent diagnostic errors. Diagnosis (Berl) 2020 Oct 28;8(3):347-352. https://pubmed.ncbi.nlm.nih.gov/33112779/. Accessed November 15, 2023.
  273. Mathews BK, Fredrickson M, Sebasky M, Seymann G, Ramamoorthy S, Vilke G, Sloane C, Thorson E, El-Kareh R. Structured case reviews for organizational learning about diagnostic vulnerabilities: initial experiences from two medical centers. Diagnosis (Berl) 2020 Jan 28;7(1):27-35. https://pubmed.ncbi.nlm.nih.gov/31444963/. Accessed November 15, 2023.
  274. Perry MF, Melvin JE, Kasick RT, Kersey KE, Scherzer DJ, Kamboj MK, Gajarski RJ, Noritz GH, Bode RS, Novak KJ, Bennett BL, Hill ID, Hoffman JM, McClead RE. The Diagnostic Error Index: a quality improvement initiative to identify and measure diagnostic errors. J Pediatr 2021 May;232:257-263. https://pubmed.ncbi.nlm.nih.gov/33301784/. Accessed November 15, 2023.
  275. McDonald KM, Su G, Lisker S, Patterson ES, Sarkar U. Implementation science for ambulatory care safety: a novel method to develop context-sensitive interventions to reduce quality gaps in monitoring high-risk patients. Implement Sci Jun 24 2017;12(1):79. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5483297/. Accessed November 15, 2023.
  276. Huang GC, Kriegel G, Wheaton C, Sternberg S, Sands K, Richards J, Johnston K, Aronson M. Implementation of diagnostic pauses in the ambulatory setting. BMJ Qual Saf 2018 Jun;27(6):492-497. https://pubmed.ncbi.nlm.nih.gov/29306903/. Accessed November 15, 2023.
  277. The Leapfrog Group. Recognizing Excellence in Diagnosis: Recommended Practices for Hospitals. 2022. https://www.leapfroggroup.org/recognizing-excellence-diagnosis-recommended-practices-hospitals. Accessed November 15, 2023.
  278. Berenson R, Singh H. Payment innovations to improve diagnostic accuracy and reduce diagnostic error. Health Aff (Millwood) 2018 Nov;37(11):1828-1835. https://pubmed.ncbi.nlm.nih.gov/30395510/. Accessed November 15, 2023.
  279. Ali KJ, Goeschel CA, DeLia DM, Blackall LM, Singh H. The PRIDx framework to engage payers in reducing diagnostic errors in healthcare. Diagnosis (Berl) 2023 Oct 5. https://pubmed.ncbi.nlm.nih.gov/37795579/. Accessed October 31, 2023.

 

Page last reviewed January 2024
Page originally created December 2023

Internet Citation: References. Content last reviewed January 2024. Agency for Healthcare Research and Quality, Rockville, MD.
https://www.ahrq.gov/diagnostic-safety/resources/issue-briefs/dxsafety-current-state-references.html

Click to copy citation