U.S. flag

An official website of the Department of Health and Human Services

SHARE:

FacebookXEmail AHRQPrintShare
Diagnostic Safety and Quality

Cognitive Load Theory and Its Impact on Diagnostic Accuracy

References

  1. Balogh E, Miller BT, Ball J. Improving Diagnosis in Health Care. Washington, DC: National Academies Press; 2015. https://nap.nationalacademies.org/catalog/21794/improving-diagnosis-in-health-care. Accessed April 10, 2024.
  2. Kohn LT, Corrigan J, Donaldson MS. To Err Is Human: Building a Safer Health System. Washington, DC: National Academies Press; 2000. https://nap.nationalacademies.org/catalog/9728/to-err-is-human-building-a-safer-health-system. Accessed April 10, 2024.
  3. Newman-Toker DE, Nassery N, Schaffer AC, Yu-Moe CW, Clemens GD, Wang Z, Zhu Y, Saber Tehrani AS, Fanai M, Hassoon A, Siegal D. Burden of serious harms from diagnostic error in the USA. BMJ Qual Saf 2024;33(2):109-20. doi: 10.1136/bmjqs-2021-014130. Accessed April 10, 2024.
  4. Auerbach A, Hubbard C, Ranji S, Raffel K, Valdes G, Boscardin J, Dalal AK, Harris A, Flynn E, Schnipper JL. Diagnostic errors in hospitalized adults who died or were transferred to intensive care. JAMA Intern Med 2024;184(2):164-73. doi: 10.1001/jamainternmed.2023.7347. Accessed April 10, 2024.
  5. Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern Med 2005;165(13):1493-9. doi: 10.1001/archinte.165.13.1493. Accessed April 10, 2024.
  6. Hooftman J, Dijkstra AC, Suurmeijer I, van der Bij A, Paap E, Zwaan L. Common contributing factors of diagnostic error: a retrospective analysis of 109 serious adverse event reports from Dutch hospitals. BMJ Qual Saf 2023. Epub ahead of print. doi: 10.1136/bmjqs-2022-015876. Accessed April 10, 2024.
  7. Charlin B, Lubarsky S, Millette B, Crevier F, Audétat M-C, Charbonneau A, Caire Fon N, Hoff L, Bourdy C. Clinical reasoning processes: unravelling complexity through graphical representation. Med Educ 2012;46(5):454-63. doi: 10.1111/j.1365-2923.2012.04242.x. Accessed April 10, 2024
  8. Henriksen K, Kaplan H. Hindsight bias, outcome knowledge and adaptive learning. Qual Saf Health Care 2003;12:46-50. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1765779/. Accessed April 10, 2024.
  9. Merkebu J, Battistone M, McMains K, McOwen K, Witkop C, Konopasky A, Torre D, Holmboe E, Durning SJ. Situativity: a family of social cognitive theories for understanding clinical reasoning and diagnostic error. Diagnosis (Berl) 2020;7(3):169-76. doi: 10.1515/dx-2019-0100. Accessed April 10, 2024
  10. Young JQ, Van Merrienboer J, Durning S, Ten Cate O. Cognitive load theory: implications for medical education: AMEE Guide No 86. Med Teach 2014;36(5):371-84. doi: 10.3109/0142159X.2014.889290. Accessed April 10, 2024.
  11. Sewell JL, Santhosh L, O’Sullivan PS. How do attending physicians describe cognitive overload among their workplace learners? Med Educ 2020;54(12):1129-36. doi: 10.1111/medu.14289. Accessed April 10, 2024.
  12. Westbrook JI, Raban MZ, Walter SR, Douglas H.. Task errors by emergency physicians are associated with interruptions, multitasking, fatigue and working memory capacity: a prospective, direct observation study. BMJ Qual Saf 2018;27(8):655. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6204927/. Accessed April 10, 2024.
  13. Harris E, Santhosh L. Dual process theory and cognitive load: how intensivists make diagnoses. Crit Care Clin 2022;38(1):27-36. doi: 10.1016/j.ccc.2021.07.001. Accessed April 10, 2024.
  14. Sweller J, van Merriënboer JJG, Paas F. Cognitive architecture and instructional design. Educ Psychol Rev 1998;10(3):251-96. doi: 10.1023/A:1022193728205. Accessed April 10, 2024.
  15. Sweller J. Measuring cognitive load. Perspect Med Educ 2018;7(1):1-2. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5807263/.  Accessed April 10, 2024.
  16. Hanham J, Castro-Alonso JC, Chen O. Integrating cognitive load theory with other theories, within and beyond educational psychology. Br J Educ Psychol 2023;93 Suppl 2:239-50. doi: 10.1111/bjep.12612. Accessed April 10, 2024.
  17. Zlotnik G, Vansintjan A. Memory: an extended definition. Front Psychol 2019;10:2523. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6853990/. Accessed April 10, 2024.
  18. Cowan N. The magical mystery four: how is working memory capacity limited, and why? Curr Dir Psychol Sci 2010;19(1):51-7. doi:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2864034/. Accessed April 10, 2024.
  19. Mancinetti M, Guttormsen S, Berendonk C. Cognitive load in internal medicine: what every clinical teacher should know about cognitive load theory. Eur J Intern Med 2019;60:4-8. doi: 10.1016/j.ejim.2018.08.013. Accessed April 10, 2024.
  20. Kirsh D. A few thoughts on cognitive overload. Intellectica 2000;30(1):19-51. doi: 10.3406/intel.2000.1592.
  21. Ahmed A, Chandra S, Herasevich V, Gajic O, Pickering BW. The effect of two different electronic health record user interfaces on intensive care provider task load, errors of cognition, and performance. Crit Care Med 2011;39(7):1626-34. doi: 10.1097/CCM.0b013e31821858a0. Accessed April 10, 2024.
  22. Sloane JF, Donkin C, Newell BR, Singh H, Meyer AND. Managing interruptions to improve diagnostic decision-making: strategies and recommended research agenda. J Gen Intern Med 2023;38(6):1526-31. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10160308/. Accessed April 10, 2024.
  23. Berg LM, Källberg AS, Göransson KE, Östergren J, Florin J, Ehrenberg A.. Interruptions in emergency department work: an observational and interview study. BMJ Qual Saf 2013;22(8):656. doi: 10.1136/bmjqs-2013-001967. Accessed April 10, 2024.
  24. Grundgeiger T, Sanderson P, MacDougall HG, Venkatesh B. Interruption management in the intensive care unit: predicting resumption times and assessing distributed support. J Exp Psychol 2010;16(4):317-34. doi: 10.1037/a0021912. Accessed April 10, 2024.
  25. Westbrook JI, Raban MZ, Walter SR, Douglas H. Task errors by emergency physicians are associated with interruptions, multitasking, fatigue and working memory capacity: a prospective, direct observation study. BMJ Qual Saf 2018;27(8):655-63. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6204927/. Accessed April 10, 2024.
  26. Laxmisan A, Hakimzada F, Sayan OR, Green RA, Zhang J, Patel VL. The multitasking clinician: decision-making and cognitive demand during and after team handoffs in emergency care. Int J Med Inform 2007;76(11):801-11. doi: 10.1016/j.ijmedinf.2006.09.019. Accessed April 10, 2024.
  27. Balint BJ, Steenburg SD, Lin H, Shen C, Steele JL, Gunderman RB. Do telephone call interruptions have an impact on radiology resident diagnostic accuracy? Acad Radiol 2014;21(12):1623-8. doi: 10.1016/j.acra.2014.08.001. Accessed April 10, 2024.
  28. Sendelbach S, Funk M. Alarm fatigue: a patient safety concern. AACN Adv Crit Care 2013;24(4):378-86. doi: 10.1097/NCI.0b013e3182a903f9. Accessed April 10, 2024.
  29. Cobus V, Heuten W. To beep or not to beep? Evaluating modalities for multimodal ICU alarms. Multimodal Technol Interact 2019;3(1):15. doi: 10.3390/mti3010015. Accessed April 10, 2024.
  30. Troyer L, Brady W. Barriers to effective EMS to emergency department information transfer at patient handover: a systematic review. Am J Emerg Med 2020;38(7):1494-503. doi: 10.1016/j.ajem.2020.04.036. Accessed April 10, 2024.
  31. Ghassemi M, Oakden-Rayner L, Beam AL. The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit Health 2021;3(11):e745-e750. doi: 10.1016/S2589-7500(21)00208-9. Accessed April 10, 2024.
  32. Franssila H, Okkonen J, Savolainen R. Developing measures for information ergonomics in knowledge work. Ergonomics 2016;59(3):435-48. doi: 10.1080/00140139.2015.1073795. Accessed April 10, 2024.
  33. Thompson V. Chapter two: what intuitions are... and are not. In: Ross BH, ed. The Psychology of Learning and Motivation, Vol 60. San Diego, CA: Academic Press; 2014. pp. 35-75. Accessed April 10, 2024.
  34. Pelaccia T, Tardif J, Triby E, Charlin B. An analysis of clinical reasoning through a recent and comprehensive approach: the dual-process theory. Med Educ Online 2011;16. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3060310/. Accessed April 10, 2024.
  35. Sherbino J, Dore KL, Wood TJ, Young ME, Gaissmaier W, Kreuger S, Norman GR. The relationship between response time and diagnostic accuracy. Acad Med 2012;87(6):785-91. doi: 10.1097/ACM.0b013e318253acbd. Accessed April 10, 2024.
  36. Ilgen JS, Bowen JL, McIntyre LA, Banh KV, Barnes D, Coates WC, Druck J, Fix ML, Rimple D, Yarris LM, Eva KW. Comparing diagnostic performance and the utility of clinical vignette-based assessment under testing conditions designed to encourage either automatic or analytic thought. Acad Med 2013;88(10):1545-51. doi: 10.1097/ACM.0b013e3182a31c1e. Accessed April 10, 2024.
  37. Norman G, Sherbino J, Dore K, Wood T, Young M, Gaissmaier W, Kreuger S, Monteiro S. The etiology of diagnostic errors: a controlled trial of system 1 versus system 2 reasoning. Acad Med 2014;89(2):277-84. doi: 10.1097/ACM.0000000000000105. Accessed April 10, 2024.
  38. Norman G. Dual processing and diagnostic errors. Adv Health Sci Educ Theory Pract 2009;14:37-49. doi: 10.1007/s10459-009-9179-x. Accessed April 10, 2024.
  39. Burgess DJ. Are providers more likely to contribute to healthcare disparities under high levels of cognitive load? How features of the healthcare setting may lead to biases in medical decision making. Med Decis Making 2010;30(2):246-57. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3988900/. Accessed April 10, 2024.
  40. Brünken R, Seufert T, Paas F. Measuring cognitive load. In: Plass JL, Brünken R, Moreno R, eds. Cognitive Load Theory. Cambridge, UK: Cambridge University Press; 2010. pp. 181-202.
  41. Hart SG, Staveland LE. Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock PA, Meshkati N, eds. Advances in Psychology, Vol 52. Amsterdam, The Netherlands: Elsevier; 1988. pp. 139-83.
  42. Mansikka H, Virtanen K, Harris D. Comparison of NASA-TLX scale, modified Cooper-Harper scale and mean inter-beat interval as measures of pilot mental workload during simulated flight tasks. Ergonomics 2019;62(2):246-54. doi: 10.1080/00140139.2018.1471159. Accessed April 10, 2024.
  43. Tubbs-Cooley HL, Mara CA, Carle AC, Gurses AP. The NASA Task Load Index as a measure of overall workload among neonatal, paediatric, and adult intensive care nurses. Intensive Crit Care Nurs 2018;46:64-9. doi: 10.1016/j.iccn.2018.01.004. Accessed April 10, 2024.
  44. Hart SG. NASA-Task Load Index (NASA-TLX) 20 years later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 2006;50(9):904-8. doi: 10.1177/154193120605000909. Accessed April 10, 2024.
  45. Braarud PØ. Investigating the validity of subjective workload rating (NASA-TLX) and subjective situation awareness rating (SART) for cognitively complex human–machine work. Int J Ind Ergon 2021;86(14). doi: 10.1016/j.ergon.2021.103233. Accessed April 10, 2024.
  46. Reid GB, Nygren TE. The subjective workload assessment technique: a scaling procedure for measuring mental workload. In: Hancock PA, Meshkati N, eds. Advances in Psychology, Vol 52. Amsterdam, The Netherlands: Elsevier; 1988. pp. 185-218.
  47. Paas F. Training strategies for attaining transfer of problem-solving skill in statistics: a cognitive-load approach. J Educ Psychol 1992;84(4):429-34. doi: 10.1037/0022-0663.84.4.429. Accessed April 10, 2024.
  48. He M, Guo J, Zeng S. Cognitive load measurement and impact analysis on performance in dual-task situations. Proceedings of the 2nd World Symposium on Software Engineering; Chengdu, China: Association for Computing Machinery; 2020. pp. 303-7.
  49. Tubbs-Cooley HL, Mara CA, Carle AC, Mark BA, Pickler RH. Association of nurse workload with missed nursing care in the neonatal intensive care unit. JAMA Pediatr 2019;173(1):44-51. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6583427/. Accessed April 10, 2024.
  50. Yurko YY, Scerbo MW, Prabhu AS, Acker CE, Stefanidis D. Higher mental workload is associated with poorer laparoscopic performance as measured by the NASA-TLX tool. Simul Healthc 2010;5(5):267-71. doi: 10.1097/SIH.0b013e3181e3f329. Accessed April 10, 2024.
  51. Weinger MB, Reddy SB, Slagle JM. Multiple measures of anesthesia workload during teaching and nonteaching cases. Anesth Analg 2004;98(5):1419-25. doi: 10.1213/01.ane.0000106838.66901.d2. Accessed April 10, 2024.
  52. Rojas D, Haji F, Shewaga R, Kapralos B, Dubrowski A. The impact of secondary-task type on the sensitivity of reaction-time based measurement of cognitive load for novices learning surgical skills using simulation. Stud Health Technol Inform 2014;196:353-9. doi: 10.3233/978-1-61499-375-9-353. Accessed April 10, 2024.
  53. Bowie CR, Harvey PD. Administration and interpretation of the Trail Making Test. Nat Protoc 2006;1(5):2277-81. doi: 10.1038/nprot.2006.390. Accessed April 10, 2024.
  54. Jones G, Macken B. Questioning short-term memory and its measurement: why digit span measures long-term associative learning. Cognition 2015;144:1-13. doi: 10.1016/j.cognition.2015.07.009. Accessed April 10, 2024.
  55. Kalanthroff E, Avnit A, Henik A, Davelaar EJ, Usher M. Stroop proactive control and task conflict are modulated by concurrent working memory load. Psychon Bull Rev 2015;22(3):869-75. doi: 10.3758/s13423-014-0735-x. Accessed April 10, 2024.
  56. Coulacoglou C, Saklofske DH. Chapter 5 - Executive function, theory of mind, and adaptive behavior. In: Coulacoglou C, Saklofske DH, eds. Psychometrics and Psychological Assessment. San Diego: Academic Press; 2017. pp. 91-130.
  57. Aldekhyl S, Cavalcanti RB, Naismith LM. Cognitive load predicts point-of-care ultrasound simulator performance. Perspect Med Educ 2018;7(1):23-32. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5807260/. Accessed April 10, 2024.
  58. Chang YS, Wu YH, Hsu CY, Tang SH, Yang LL, Su SF. Impairment of perceptual and motor abilities at the end of a night shift is greater in nurses working fast rotating shifts. Sleep Med 2011;12(9):866-9. doi: 10.1016/j.sleep.2011.03.018. Accessed April 10, 2024.
  59. Krejtz K, Duchowski AT, Niedzielska A, Biele C, Krejtz I. Eye tracking cognitive load using pupil diameter and microsaccades with fixed gaze. PLoS One 2018;13(9):e0203629-e. https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0203629. Accessed April 10, 2024.
  60. Szulewski A, Roth N, Howes D. The use of task-evoked pupillary response as an objective measure of cognitive load in novices and trained physicians: a new tool for the assessment of expertise. Acad Med 2015;90(7):981-7. doi: 10.1097/ACM.0000000000000677. Accessed April 10, 2024.
  61. Solhjoo S, Haigney MC, McBee E, van Merrienboer JJG, Schuwirth L, Artino AR, Battista A, Ratcliffe T, Lee HD, Durning SJ. Heart rate and heart rate variability correlate with clinical reasoning performance and self-reported measures of cognitive load. Sci Rep 2019;9(1):14668.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6789096/. Accessed April 10, 2024.
  62. Honavar SG. Electronic medical records - the good, the bad and the ugly. Indian J Ophthalmol 2020;68(3):417-8. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7043175/. Accessed April 10, 2024.
  63. National Academies of Sciences, Engineering, and Medicine; Committee on Systems Approaches to Improve Patient Care by Supporting Clinician Well-Being. Taking Action Against Clinician Burnout: a Systems Approach to Professional Well-Being. Washington, DC: National Academies Press; 2019. https://nap.nationalacademies.org/catalog/25521/taking-action-against-clinician-burnout-a-systems-approach-to-professional. Accessed April 11, 2024.
  64. Singh H, Spitzmueller C, Petersen NJ, Sawhney MK, Sittig DF. Information overload and missed test results in EHR-based settings. JAMA Intern Med 2013;173(8):702-4. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3822526/. Accessed April 11, 2024.
  65. Adler-Milstein J, Adelman JS, Tai-Seale M, Patel VL, Dymek C. EHR audit logs: a new goldmine for health services research? J Biomed Inform 2020;101:103343. doi: 10.1016/j.jbi.2019.103343. Accessed April 11, 2024.
  66. Adelman JS, Kalkut GE, Schechter CB, Weiss JM, Berger MA, Reissman SH, Cohen HW, Lorenzen SJ, Burack DA, Southern WN. Understanding and preventing wrong-patient electronic orders: a randomized controlled trial. J Am Med Inform Assoc 2013;20(2):305-10. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3638184/. Accessed April 11, 2024.
  67. Kannampallil TG, Denton CA, Shapiro JS, Patel VL. Efficiency of emergency physicians: insights from an observational study using EHR log files. Appl Clin Inform 2018;9(1):99-104. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5802998/. Accessed April 11, 2024.
  68. Kannampallil T, Adler-Milstein J. Using electronic health record audit log data for research: insights from early efforts. J Am Med Inform Assoc 2022;30(1):167-71. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9748594/. Accessed April 11, 2024.
  69. Saitwal H, Feng X, Walji M, Patel V, Zhang J. Assessing performance of an electronic health record (EHR) using cognitive task analysis. Int J Med Inform 2010;79(7):501-6. doi: 10.1016/j.ijmedinf.2010.04.001. Accessed April 11, 2024.
  70. Al Ghalayini M, Antoun J, Moacdieh NM. Too much or too little? Investigating the usability of high and low data displays of the same electronic medical record. J Health Inform 2020;26(1):88-103. doi: 10.1177/1460458218813725. Accessed April 11, 2024.
  71. Pfaff MS, Eris O, Weir C, Anganes A, Crotty T, Rahman M, Ward M, Nebeker JR. Analysis of the cognitive demands of electronic health record use. J Biomed Inform 2021;113:103633. doi: 10.1016/j.jbi.2020.103633. Accessed April 11, 2024.
Page last reviewed May 2024
Page originally created May 2024

Internet Citation: References. Content last reviewed May 2024. Agency for Healthcare Research and Quality, Rockville, MD.
https://www.ahrq.gov/diagnostic-safety/resources/issue-briefs/dxsafety-cognitive-load-references.html

Click to copy citation