EvidenceNOW Publications

Topics:

• Primary Care Landscape
• Practice Facilitation
• Practice Capacity for Quality Improvement
• Improving the ABCS of Heart Health
• Research Design and Methods
• Other Topics

Primary Care Landscape

Characteristics of Zero-Burnout Primary Care Practices

Common characteristics of zero-burnout primary care practices were revealed in a new study by ESCALATES, the national evaluator for this EvidenceNOW initiative. Compared with high-burnout primary care practices, zero-burnout practices reported using more quality improvement strategies, were more likely to be solo and clinician owned, and less likely to have participated in accountable care organizations or other demonstration projects. Zero-burnout practices also had higher levels of psychological safety and adaptive reserve, a measure of practice capacity for learning and development. The study, which surveyed 715 small-to-medium-size primary care practices, concluded that enhancing organization and practice culture, including promoting leadership development and fostering practice agency, may aid efforts to prevent primary care burnout.

Edwards ST, Marino M, Solberg LI, et al. Cultural and structural features of zero-burnout primary care practices. Health Affairs, June 2021, 40(6). https://www.healthaffairs.org/doi/full/10.1377/hlthaff.2020.02391

Burnout among Primary Care Providers and Staff: Evaluating the Association with Practice Adaptive Reserve and Individual Behaviors

The Virginia Cooperative examined the association between organizational capacity for change and individual behavioral response to change and burnout among healthcare professionals. Findings revealed that as practices’ capacity to change increased, burnout in healthcare professionals decreased. Similarly, as healthcare professionals showed improved response toward change, burnout decreased. Among administrative staff, there was a significant association between practices that had a high capacity for change, a positive response to change, and lower burnout. Increased hours of work per week was associated with higher odds of burnout across healthcare professionals. The authors concluded that building organizational capacity for change, supporting providers and staff during major change, and consideration of individual workload may reduce levels of burnout.

Goldberg DG, Soylu TG, Kitsantas P, et al. Burnout among primary care providers and staff: Evaluating the association with practice adaptive reserve and individual behaviors. J Gen Intern Med. 2021 Jan 8; 10.1007/s11606-020-06367-z. https://pubmed.ncbi.nlm.nih.gov/33420562

Medicare Access and CHIP Reauthorization Act in Small to Medium-Sized Primary Care Practices

The Virginia Cooperative examined primary care practices’ perceptions of quality incentives under the Medicare Access and CHIP Reauthorization Act (MACRA). Findings revealed that independent practices were more aware and knowledgeable of MACRA than hospital-owned practices, preparation for MACRA differed by practice ownership, and practices had mixed views about the impact of MACRA on practice finances, workflow, and patient care. The authors also found that practices that were part of accountable care organizations were more likely to take proactive approaches to MACRA, and that independent practices face ongoing challenges, including limited resources and EHR system incompatibilities with quality measures required under MACRA. The authors concluded that policymakers should assess the unintended consequences of payment reform policies on independent practices and provide support in transitioning to a new payment system.

Soylu TG, Goldberg DG, Cuellar AE, et al. Medicare Access and CHIP Reauthorization Act in small to medium-sized primary care practices. The Journal of the American Board of Family Medicine, Nov-Dec 2020, 33 (6) 942-952. https://doi.org/10.3122/jabfm.2020.06.200142

Qualitative Evaluation of a Cardiovascular Quality Improvement Programme Reveals Sizable Data Inaccuracies in Small Primary Care Practices

The Midwest Cooperative reflected on lessons learned from EvidenceNOW using interviews from practice leaders and practice facilitators from practices that experienced the largest and smallest gains in quality scores. The cooperative found that the largest changes in heart health (ABCS) care delivery scores likely reflected improvements in documentation due to coaching or fixes to electronic health record (EHR) data “glitches” rather than changes in care. The authors concluded that small practices continue to struggle with EHRs, and some small practices continue to operate with limited or incorrect performance data.

McHugh M, Brown T, Liss DT, et al. Qualitative evaluation of a cardiovascular quality improvement programme reveals sizable data inaccuracies in small primary care practices. BMJ Open Quality 2019;8:e000702. https://bmjopenquality.bmj.com/content/8/4/e000702

Challenges to Electronic Clinical Quality Measurement Using Third-Party Platforms in Primary Care Practices: The Healthy Hearts in the Heartland Experience

The Midwest Cooperative examined the challenges of using third-party platforms to extract data from electronic health records (EHRs) for electronic clinical quality measures (eCQM) in small to medium-sized primary care practices. Researchers connected 116 practices with seven different EHRs to popHealth, an open source eCQM platform. They identified the following challenges with eCQM data for data extraction: (1) Lack of coded eCQM data; (2) Incorrectly categorized eCQM data; (3) Isosemantic data (data within the incorrect context); (4) Coding that could not be directly evaluated; (5) Errors in date assignment and labeled as historical values; and (6) Inadequate data to assign the correct code. The researchers concluded that enhancements are needed to EHR systems that can promote effective eCQM implementation.

Ahmad FS, Rasmussen LV, Persell SD, et al. Challenges to electronic clinical quality measurement using third-party platforms in primary care practices: the healthy hearts in the heartland experience. JAMIA Open Volume 2, Issue 4, 2019 Dec. https://doi.org/10.1093/jamiaopen/ooz038

Using Electronic Health Records to Measure Quality Improvement Efforts: Findings from a Large Practice Facilitation Initiative

The Midwest Cooperative describes primary care practices’ ability to obtain measures with reporting periods aligning with a large quality improvement (QI) initiative. Three quality measures were collected quarterly over one year: aspirin for ischemic vascular disease; blood pressure control for hypertension; and smoking screening/cessation from 107 practices. More than half of practices were able to obtain all measures with rolling 12-month reporting periods, but smaller practices were less likely to be able to do so. Barriers to data collection included practices lacking optional electronic health record (EHR) features, and EHRs’ inability to produce reporting periods across two calendar years. The researchers concluded that: 1) EHR vendors’ compliance with Federal reporting requirements is not necessarily sufficient to support real-world QI work, and 2) improvements are needed in the flexibility and usability of EHRs’ quality measurement functions, particularly for smaller practices.

Liss DT, Peprah YA, Brown T, et al. Using electronic health records to measure quality improvement efforts: findings from a large practice facilitation initiative. Jt Comm J Qual Patient Saf 2020 Jan; 46(1):11‐17. https://www.ncbi.nlm.nih.gov/31704159

Indicators of Workplace Burnout Among Physicians, Advanced Practice Clinicians, and Staff in Small to Medium-Sized Primary Care Practices

The Virginia Cooperative examined whether individual behaviors and attitudes, such as anxiety and withdrawal from work, in response to disruptive change, influence workplace burnout at small and medium-sized practices. Findings revealed that healthcare professional groups have high levels of anxiety. Primary care physicians reported higher rates of burnout than other healthcare professionals such as advanced practice clinicians, clinical support staff, and administrative staff. The authors concluded that programs should focus on strengthening the work environment to improve organizational capacity for change and address high levels of anxiety experienced by healthcare professionals.

Golberg G, Soylu TG, Grady VM, et al. Indicators of workplace burnout among physicians, advanced practice clinicians, and staff in small to medium-sized primary care practices. JABFM 2020 May 19; 33 (3) 378-385. https://www.jabfm.org/content/33/3/378

Correlates of Burnout in Small Independent Primary Care Practices in an Urban Setting

The New York Cooperative conducted a cross-sectional analysis of provider burnout by using data collected from 235 providers practicing in 174 small independent primary care practices in New York City. The rate of provider-reported burnout was 13.5 percent, which was relatively low compared with previous surveys that focused primarily on larger practices. Higher adaptive reserve scores were associated with lower odds of burnout (odds ratio, 0.12; 95% CI; 0.02-0.85; P=0.34). The researchers conclude that the independence and autonomy providers have in these small practices may provide some protection against symptoms of burnout. In addition, the relationship between adaptive reserve and lower rates of burnout point toward potential interventions for reducing burnout that include strengthening primary care practices’ learning and development capacity.

Blechter B, Jiang N, Cleland C, et al. Correlates of burnout in small independent primary care practices in an urban setting. JABFM 2018 Aug;31:4. https://pubmed.ncbi.nlm.nih.gov/29986978/.

Burnout among Physicians, Advanced Practice Clinicians, and Staff in Smaller Primary Care Practices

Researchers from the EvidenceNOW national evaluation team analyzed survey data from a sample of 10,284 physicians, advanced practice clinicians (APCs), and staff of 1380 smaller primary care practices participating in EvidenceNOW to examine the association between physician-, APC- and staff-reported burnout and specific structural, organizational, and contextual characteristics of smaller primary care practices. Burnout was reported by 20.4% of respondents overall. In a multivariable analysis, burnout was slightly more common among physicians and APCs than staff. Other multivariable correlates of burnout included non-solo practice; health system affiliation vs. physician/APC-owned practice; and Federally Qualified Health Center status vs. physician/APC-owned practice. Neither the proportion of patients on Medicare or Medicaid, nor practice-level patient volume were significantly associated with burnout. Practice size was not associated with burnout for APCs, and participation in an accountable care organization was associated with burnout for clinical and non-clinical staff. The authors conclude that burnout is prevalent among physicians, APCs, and staff in smaller primary care practices, and practice-level autonomy may be a critical determinant of burnout.

Edwards ST, Marino M, Balasubramanian B, et al, Burnout among physicians, advanced practice clinicians, and staff in smaller primary care practices. J Gen Intern Med 2018; 33(12):2138-46. PMID:30276654; https://www.ncbi.nlm.nih.gov/pubmed/30276654

The Influence of a Place-Based Foundation and a Public University in Growing a Rural Health Workforce

The Southwest Cooperative worked with the University of New Mexico’s Office of Community Health, which hired local Health Extension Rural Officers (HEROs) in different regions of the State to link community health needs with university resources. Multi-party agreements involved the JF Maddox foundation, a local community college, local community hospitals, and the University to work together to recruit, support, and retain local health care professionals in an impoverished, rural area of the State. These partnerships significantly increased recruitment of key health care professionals, developed a more cohesive medical community, established a school-based clinic, and provided support for other community challenges. The University has since exported this model to other rural communities in the State.

Reid R, Rising E, Kaufman A, et al. The influence of place-based foundation and a public university in growing a rural health workforce. J Comm Hlth 2019; 44:292-296. Available at: https://doi.org/10.1007/s10900-018-0585-y

Use of Quality Improvement Strategies Among Small- to Medium-Size U.S. Primary Care Practices

The EvidenceNOW National Evaluation Team assessed the use of quality improvement strategies by small- to medium-sized primary care practices before participating in EvidenceNOW. Practices that participated in accountable care organizations, produced reports from electronic health records (EHRs), produced quality reports, or discussed clinical quality data in meetings use quality improvement (QI) strategies to a greater degree than other practices. Additionally, they found lower use of QI strategies among health-system owned practices and those experiencing a disruptive event.

Balasubramanian BA, Marino M, Cohen DJ, et al. (2018). Use of quality improvement strategies among small- to medium-size US primary care practices. Ann Fam Med 2018;16(Suppl 1):S35-S43. http://www.annfammed.org/content/16/Suppl_1/S35.

Primary Care Practices’ Abilities and Challenges Using Electronic Health Record Data for Quality Improvement

An analysis of the challenges primary care practices face in generating and using data reports from their electronic health records (EHRs) to conduct quality improvement activities. The EvidenceNOW National Evaluation Team found that meaningful-use participation was associated with the ability to generate reports on clinical quality measures, but the reports did not necessarily support quality improvement initiatives. Practices reported numerous challenges in generating adequate reports, including functionality limitations, differences between clinical guidelines and measures available in EHR-generated reports, and questionable data quality. Findings from this large study of smaller primary care practices demonstrate that the promise of using EHRs for quality improvement remains largely unfulfilled.

Cohen, DJ et al. (2018). Health Affairs 37(4). https://www.healthaffairs.org/doi/full/10.1377/hlthaff.2017.1254.

Effect of Practice Ownership on Work Environment, Learning Culture, Psychological Safety, and Burnout

The Virginia Cooperative examines effects of practice ownership on self-reported work environment, culture of learning, psychological safety, and burnout at small- and medium-size primary care practices. Hospital ownership was associated with more positive perceptions of practice work environment, psychological safety, and lower staff burnout, though the effect was largely driven by clinic staff rather than clinicians.

Cuellar A, Krist AH, Nichols LM, Kuzel AJ. (2018). Association between primary care practice ownership, work environment, learning culture, and burnout. Ann Fam Med 2018;16(Suppl 1):S44-S51. http://www.annfammed.org/content/16/Suppl_1/S44.

Organizational Leadership and Adaptive Reserve in Blood Pressure Control: The Heart Health NOW Study

The North Carolina Cooperative examines small primary care practices’ performance on blood pressure control goals before practices’ participation in EvidenceNOW and the relationship to organizational quality improvement (QI) characteristics. Adaptive reserve and leadership capability in QI were not associated with achieving the target blood pressure goal.

Henderson KH, DeWalt DA, Halladay J, et al. (2018). Organizational leadership and adaptive reserve in blood pressure control: The Heart Health NOW Study. Ann Fam Med 2018;16(Suppl 1):S29-S34. http://www.annfammed.org/content/16/Suppl_1/S29.

EvidenceNOW: Balancing Primary Care Implementation and Implementation Research

AHRQ describes the research design decisions made for the EvidenceNOW initiative, including the focus on small- and medium-sized practices, the specific intervention and research strategies, the evaluation, and use of learning communities. The article also addresses the trade-offs between research goals and real-world implementation of quality improvement strategies.

Meyers D, Miller T, Genevro J, et al. (2018). EvidenceNOW: Balancing primary care implementation and implementation research. Ann Fam Med 2018;16(Suppl 1):S5-S11. http://www.annfammed.org/content/16/Suppl_1/S5.

The Alarming Rate of Major Disruptive Events in Primary Care Practices in Oklahoma

The Oklahoma Cooperative explores major disruptive events in small- to medium-sized primary care practices in Oklahoma, such as practice relocation, changes in ownership and key staff, and implementation of new systems—events that can affect quality and continuity of care. During the practices’ first year participating in EvidenceNOW, nearly one in two practices experienced at least one major disruptive event.

Mold JW, Walsh M, Chou A, Homco J. (2018). The alarming rate of major disruptive events in primary care practices in Oklahoma. Ann Fam Med 2018;16(Suppl 1):S52-S57. http://www.annfammed.org/content/16/Suppl_1/S52.

Quality of Cardiovascular Disease Care in Small Urban Practices

This paper by the New York City Cooperative captures the performance of small, urban primary care practices on the four EvidenceNOW heart health care (ABCS) measures before the practices participated in EvidenceNOW. At these practices, performance on goals for the ABCS of heart health varied. Researchers also found that solo clinician primary care practices were more likely to meet the aspirin and cholesterol goal than practices with more than one clinician.

Shelley D, Blechter B, Siman N, et al. (2018). Quality of cardiovascular disease care in small urban practices. Ann Fam Med 2018;16(Suppl 1):S21-S28. http://www.annfammed.org/content/16/Suppl_1/S21.

AHRQ’s EvidenceNOW: A Snapshot of Participating Primary Care Practices

An infographic showing diversity among primary care practices participating in EvidenceNOW across characteristics such as practice size, location, ownership, and patient characteristics.

Agency for Healthcare Research and Quality. (September 2017). Available at: http://www.ahrq.gov/evidencenow/research-results/results/infographics/snapshot.html.

Return to Topics

Practice Facilitation

Is More Better? The Impact of Implementing More Interventions for Hypertension Control in a Practice Facilitation Study for Small-and Medium-sized Practices

The Midwest Cooperative examined the impact of implementing more interventions for blood pressure control in small- and medium-sized practices. Practices were assigned to high or low "implementer groups” based on the number of blood pressure interventions they implemented with the support of a practice facilitator. Results showed that practices in the high-implementer group had greater improvements in the average percentage of hypertensive patients whose most recent blood pressure reading was below 140/90, compared to practices in the low-implementer group. The high-implementer group also had greater reductions in average blood pressure measurement among hypertensive patients. These findings show that implementing additional interventions had a positive association with measures of blood pressure control.

Ross SM, Wang A, Anthony L, et al. Is more better? The impact of implementing more interventions for hypertension control in a practice facilitation study for small- and medium-sized practices. Journal of Human Hypertension. March 22, 2023. https://doi.org/10.1038/s41371-023-00813-1.

How Type of Practice Ownership Affects Participation with Quality Improvement External Facilitation: Findings from EvidenceNOW

The EvidenceNOW National Evaluation team examined how primary care practice ownership influenced participation in external facilitation. Findings showed that differences by ownership were not significant, but federally qualified health centers (FQHCs) had significantly less participation in practice facilitation than clinician-owned practices. Findings also suggested that health systems and FQHCs had less autonomy and greater organizational complexity than clinician-owned practices, which influenced facilitation participation patterns. These findings highlight the importance of tailoring facilitation approaches based on practice ownership characteristics in future quality improvement initiatives.

Perry C, Lindner S, Hall J, et al. How Type of Practice Ownership Affects Participation with Quality Improvement External Facilitation: Findings from EvidenceNOW. J Gen Intern Med. January 3, 2022. https://doi.org/10.1007/s11606-021-07204-7

Does Coaching Matter? Examining the Impact of Specific Practice Facilitation Strategies on Implementation of Quality Improvement Interventions in The Healthy Hearts in the Heartland Study

The Midwest Cooperative examined the relationship between specific strategies used by practice facilitators and successful practice-level implementation of quality improvement (QI) interventions. The 226 participating practices were split into four groups based on the number of project management and coaching strategies performed. Findings showed the average number of interventions used by practices increased across groups. There was no association between the number of strategies performed by practice facilitators and number of QI interventions implemented. Groups did not differ significantly by practice size, association with a healthcare network, or practice type, but did differ in practice location and number and duration of facilitator visits. The authors concluded that practices that engage in more coaching-based strategies with practice facilitators are more likely to implement QI interventions, and practices’ openness to these strategies was not dependent on basic practice demographics.

Walunas TL, Jiacheng Y, Jennifer B, et al. Does coaching matter? Examining the impact of specific practice facilitation strategies on implementation of quality improvement interventions in the Healthy Hearts in the Heartland study. Implementation Science. March 2021, 16, 33. https://doi.org/10.1186/s13012-021-01100-8

A Controlled Trial of Dissemination and Implementation of a Cardiovascular Risk Reduction Strategy in Small Primary Care Practices

The North Carolina Cooperative assessed the effect of interventions combining practice facilitation and risk-stratified, population-based tools on cardiovascular risk reduction in high-risk patients. Results revealed that the interventions led to a substantial reduction in cardiovascular risk in high-risk patients. Characteristics associated with greater levels of risk reduction included being male, Black, 65 or older, and having an income of $40,000 or lower. The authors concluded that practice facilitation with population-based tools can effectively promote implementation of evidence-based guidelines to reduce cardiovascular risk among patients in small, rural practices.

Cykert S, Keyserling TC, Pignone M, et al. A controlled trial of dissemination and implementation of a cardiovascular risk reduction strategy in small primary care practices. Health Services Research, 2020 October 13. https://doi. org/10.1111/1475-6773.13571

A Practice Facilitation-Guided Intervention in Primary Care Settings to Reduce Cardiovascular Disease Risk: A Cost Analysis

The New York Cooperative estimated the cost of practice facilitation for guideline adoption in small, private primary care practices. The analysis included categories for start-up costs, intervention costs, and practice staff costs. The total combined 1-year intervention cost across all participating practices ranged from $7,900,000 to $10,200,000, with program and practice salaries comprising $6,600,000–$8,400,000 of the total. Start-up costs were a small proportion of the total 1-year costs. Quarter 1 costs were the most expensive at $20,400–$26,700 per practice, and quarter 4 costs were the least expensive at about $10,000. The majority of staff costs (75-84%) were from practice staff time. The authors concluded that the practice facilitation strategy costs primary care practices approximately $10,000 per quarter for program and practice costs, once implemented and running at highest efficiency.

Gold, HT, Siman N, Cuthel AM, et al. A practice facilitation-guided intervention in primary care settings to reduce cardiovascular disease risk: a cost analysis. Implementation Science Communications, Feb 2021, 2 (15). https://doi.org/10.1186/s43058-021-00116-x.

Measuring Implementation Strategy Fidelity in HealthyHearts NYC: A Complex Intervention Using Practice Facilitation in Primary Care

The New York City Cooperative assessed the fidelity of practice facilitation as an implementation strategy. Fidelity was measured using data from a web-based tracking system using four categories: intervention frequency, duration, content, and coverage. Results revealed that almost all of the 257 participating practices received at least 13 practice facilitation visits. Facilitators spent an average of 26 hours at each site conducting on-site facilitation. Most practices completed a set of standardized activities designed to facilitate adoption of the ABCS of heart health care and were educated on all Chronic Care Model strategies. Most practices also received the full intervention.

Berry CA, Nguyen AM, Cuthel AM, et al. Measuring implementation strategy fidelity in HealthyHearts NYC: A complex intervention using practice facilitation in primary care. American Journal of Medical Quality, 2020 September 23. https://doi.org/10.1177/1062860620959450

Using a Customer Relationship Management System to Manage a Quality Improvement Intervention

The New York City Cooperative evaluated the impact of practice facilitation on implementation of the Million Hearts guidelines for cardiovascular disease prevention and treatment. A customizable customer relationship management system (CRMS) was implemented to support the quality improvement intervention that included 257 participating practices. Features of the CRMS were customized to optimize program management, practice facilitation tracking and supervision, and data collection for performance feedback to practices and for research. The authors concluded that CRMS can effectively track practice facilitation activities with the detail needed to optimize implementation and provides a data source for both research and practice.

Pham-Singer H, Onakomaiya M, Cuthel A, et al. Using a customer relationship management system to manage a quality improvement intervention. American Journal of Medical Quality. 2020 September 13. https://doi.org/10.1177/1062860620953214

Identifying Practice Facilitation Delays and Barriers in Primary Care Quality Improvement

The Midwest Cooperative analyzed practice-specific delays and barriers to practice facilitation during EvidenceNOW. Results revealed that most facilitation activities occurred at regular tempos, but nearly all practices experienced at least one delay. Practices with more delays had lower quality improvement intervention completion rates and were more likely to encounter barriers such as lack of time and staff, lack of staff engagement, technical issues, and staff turnover.

Ye J, Zhang R, Bannon JE, et al. Identifying practice facilitation delays and barriers in primary care quality improvement. Journal of the American Board of Family Medicine, September 2020, 33 (5), 655-664. https://doi.org/10.3122/jabfm.2020.05.200058

A Cross-Cutting Workforce Solution for Implementing Community-Clinical Linkage Models

This editorial proposes that small, independently owned practices should strategically employ practice facilitators to integrate community health workers (CHWs) into their primary care teams to support the effective implementation of community–clinical linkage models. The authors concluded that the strong evidence that CHWs are effective and that practice facilitation can optimize implementation of evidence-based care models should inform decisions about future funding of practice facilitation to support CHW integration in small, independently owned practices.

Islam N, Rogers ES, Schoenthaler A, et al. A cross-cutting workforce solution for implementing community-clinical linkage models. Am J Public Health. 2020 July; 110(S2): S191-S193. http://doi.org/10.2105/AJPH.2020.305692

How Practice Facilitation Strategies Differ by Practice Context

The New York City Cooperative looked at how practice facilitation strategies are tailored to different primary care contexts, using interviews with practice facilitators working in small independent practices (SIPs) or Federally Qualified Health Centers (FQHCs). Interviews revealed four facilitation strategies used: 1) Remain flexible to align with practice and organizational priorities; 2) Build relationships; 3) Provide value through information technology expertise; and 4) Build capacity and create efficiencies. Facilitators in SIPs and FQHCs described using the same strategies, often in combination, but tailored to their specific practice environments. The authors concluded that facilitators require multidisciplinary skills to support sustainable practice improvement in different healthcare delivery settings.

Nguyen AM, Cuthel A., Padgett DK, et al. How practice facilitation strategies differ by practice context. J Gen Intern Med 35, 824–831 (2020). https://doi.org/10.1007/s11606-019-05350-7

Effects of 2 Forms of Practice Facilitation on Cardiovascular Prevention in Primary Care

The Healthy Hearts in the Heartland Cooperative compared practice facilitation implementing point-of-care (POC) quality improvement (QI) strategies alone versus facilitation implementing point-of-care plus population management (POC+PM) strategies on preventive cardiovascular care. The authors randomized 226 small and mid-sized primary care practices who worked with facilitators on QI for 12 months to implement POC or POC+PM strategies. The researchers measured the proportion of eligible patients in a practice meeting “ABCS” measures: (aspirin for eligible patients, blood pressure control, Cholesterol control, Smoking cessation counseling), as well as the Change Process Capability Questionnaire at baseline, 12 months, and 18 months. The mean proportion of patients meeting each performance measure was slightly (.04 to .05) greater at 12 months, with improvements sustained at 18 months. At 12 months, baseline-adjusted differences for the POC+PM arm versus POC was: Aspirin 0.02 (−0.02 to 0.05), Blood pressure −0.01 (−0.04 to 0.03), Cholesterol 0.03 (0.00–0.07), and Smoking 0.02 (−0.02 to 0.06); P>0.05 for all. The Change Process Capability Questionnaire improved slightly, mean change 0.30 (0.09–0.51), but did not significantly differ across arms. The authors conclude that facilitator-led QI promoting population management approaches plus POC improvement strategies was not clearly superior to POC strategies alone.

Persell S, Liss D, Walunas T, et al. Effects of 2 forms of practice facilitation on cardiovascular prevention in primary care. Medical Care 2020; 58(4): 344-351. Available at: https://doi.org/10.1097/MLR.0000000000001260.

Cardiovascular Disease Guideline Adherence: An RCT Using Practice Facilitation

This study by the Healthy Hearts New York City Cooperative examined whether practice facilitation (PF) is effective in increasing the proportion of patients meeting the Million Hearts ABCS outcomes: (A) aspirin when indicated, (B) blood pressure control, (C) cholesterol management, and (S) smoking screening and cessation intervention. Researchers randomized 257 small independent primary care practices in New York City into 1 of 4 waves that determined when they would start receiving the 1-year PF intervention. The intervention consisted of practice facilitators conducting at least 13 practice visits over 1 year, focused on capacity building and implementing system and workflow changes to meet the cardiovascular disease care guidelines. Data were extracted for 13 quarters between January 1, 2015 and March 31, 2018, which encompassed the control, intervention, and follow-up periods for all waves, and analyzed in 2019. PF was associated with improvements in the 2 smoking-related outcomes only, the smoking composite (screening for tobacco use and counseling) and smokers counseled. The follow-up smoking measure improved compared with the control period (incidence rate ratio=1.152, 95% CI=1.072, 1.238, p<0.001) and the intervention period (incidence rate ratio=1.060, 95% CI=1.013, 1.109, p=0.007). Smokers counseled also improved when comparing the intervention period with control period (incidence rate ratio=1.121, 95% CI=1.037, 1.211, p=0.002). The researchers conclude that increasing the impact of PF programs that target multiple risk factors may require a longer, more intense intervention and greater attention to external policy and practice contextual factors that may hinder the facilitation process and practice improvement goals.

Shelley DR, Gepts T, Siman N, et al. Cardiovascular disease guideline adherence: An RCT using practice facilitation. Am J Prev Med 2020; Feb 14. Available at: https://www.ncbi.nlm.nih.gov/pubmed/32067871

Dedicated Workforce Required to Support Large-Scale Practice Improvement

EvidenceNOW funded seven Cooperatives, each working with over 200 primary care practices, advised by practice facilitators, to rapidly disseminate and implement improvements in cardiovascular preventive care: aspirin in high-risk individuals, blood pressure control, cholesterol management, and smoking cessation. This study by the EvidenceNOW national evaluation team identified the organizational elements and infrastructures Cooperatives used to support practice facilitators by reviewing facilitator logs, online diary data, semi-structured interviews with facilitators, and field notes from facilitator observations. Results revealed that each Cooperative partnered with 2 to 16 organizations, piecing together 16 to 35 facilitators, often from other quality improvement projects. Quality assurance strategies by Cooperatives included establishing initial and ongoing training, processes to support facilitators, and monitoring to assure consistency and quality. Cooperatives developed facilitator toolkits, implemented initiative-specific training, and developed processes for peer-to-peer learning and support. The evaluation team found that supporting a large-scale facilitation workforce requires creating an infrastructure, including initial training, and ongoing support and monitoring, often borrowing from other ongoing initiatives. Few regions have facilitation organizations at this scale. The researchers conclude that a dedicated workforce is required to support large-scale practice improvement and would be more efficient and effective than this fragmented approach to quality improvement.

Sweeney SM, Hemler JR, Baron AN, et al. Dedicated workforce required to support large-scale practice improvement J Am Bd Fam Med 2020; 33 (2): 230-239. DOI: https://doi.org/10.3122/jabfm.2020.02.190261

Disseminating, Implementing, and Evaluating Patient-Centered Outcomes to Improve Cardiovascular Care Using a Stepped-Wedge Design: Healthy Hearts for Oklahoma

This paper describes how the Healthy Hearts for Oklahoma Cooperative partnered with public health agencies and communities to construct a sustainable Oklahoma Primary Care Healthcare Improvement Collaborative (OPHIC) to support dissemination and implementation (D&I) of quality improvement (QI) methods to promote implementation of ABCS (aspirin therapy, blood pressure control, cholesterol management, and smoking cessation) measures and provide QI support to primary care practices (PCPs) to better manage patients at risk for cardiovascular disease events. A total of 263 small PCPs across Oklahoma received the bundled QI intervention to improve ABCS performance. A stepped-wedge design was used to evaluate D&I of QI support. Changes in ABCS measures will be estimated as a function of various components of the QI support and capacity and readiness of PCPs to change. Notes from academic detailing and practice facilitation sessions will be analyzed to help interpret findings on ABCS performance. Lessons learned from this project will guide future strategies for D&I of evidence-based practices in PCPs. The authors conclude that trained practice facilitators will continue to serve as critical resource to assist small, rural PCPs in adapting to the ever-changing health environment and continue to deliver quality care to their communities.

Chou AF, Homco JB, Nagykaldi Z, et al. Disseminating, implementing, and evaluating patient-centered outcomes to improve cardiovascular care using a stepped-wedge design: healthy hearts for Oklahoma. BMC Health Serv Res. 2018 Jun 4;18(1):404. doi: 10.1186/s12913-018-3189-4; https://www.ncbi.nlm.nih.gov/pubmed/29866120

Practice Facilitator Strategies for Addressing Electronic Health Record Data Challenges for Quality Improvement: EvidenceNOW

The EvidenceNOW national evaluation team analyzed qualitative data from online diaries, site visit field notes, and interviews to discover how practice facilitators worked with practices on electronic health record (EHR) data challenges to obtain and use data for quality improvement (QI). They examined data from about 1500 small- to medium-sized primary care practices and 136 facilitators in EvidenceNOW. They found that facilitators faced practice-level EHR data challenges, such as a lack of clinical performance data, partial or incomplete clinical performance data, and inaccurate clinical performance data. Facilitators responded to these challenges, respectively, by using other data sources or tools to fill in for missing data, approximating performance reports and generating patient lists, and teaching practices how to document care and confirm performance measures. In addition, facilitators helped practices communicate with EHR vendors or health systems in requesting data they needed. Overall, facilitators tailored strategies to fit the individual practice and helped build data skills and trust. The authors conclude that support is necessary to help practices, particularly those with EHR data challenges, build their capacity for conducting data-driven QI, which is required to participate in practice transformation and performance-based payment programs.

Hemler JR, Hall JD, Cholan RA, et al. Practice facilitator strategies for addressing electronic health record data challenges for quality improvement: EvidenceNOW. JABFM 2018;31(3):398-409. PubMed PMID: 29743223; https://www.ncbi.nlm.nih.gov/pubmed/29743223

Facilitating Practice Transformation in Frontline Health Care

This editorial by EvidenceNOW grantees notes that many featured papers in this supplement on primary care transformation are the early products of nearly $800 million invested by AHRQ and other Federal health agencies to test facilitation of transformation in thousands of practices across the United States. It notes that most small practices lack the time, energy, and resources for quality improvement and lack examples from which they can learn. Farmers were in this position a century ago when the U.S. Department of Agriculture Cooperative Extension Program revolutionized farming in the United States. Agricultural experts worked with farmers to test and disseminate innovative agricultural practices that farming is still benefitting from today. AHRQ has developed a similar extension model using practice facilitators and other consultants and resources to transform primary care, which is described in several supplement articles by EvidenceNOW researchers in this supplement.

Phillips Jr, RL, Cohen DJ, Kaufman A, et al. (2019).Facilitating practice transformation in frontline health care. Ann Fam Med 2019; 17 (Suppl 1):S2-S5. http://www.annfammed.org/content/17/Suppl_1/S2.full

Clinician Perspectives on the Benefits of Practice Facilitation for Small Primary Care Practices

The Healthy Hearts New York City Cooperative interviewed 19 small independent primary care practices (SIPs) about how the benefits of practice facilitation (PF) differed based on the availability of internal staff for quality improvement. Providers perceived three central PF benefits: creating awareness of quality gaps; connecting practices to information, resources, and strategies to improve care; and optimizing the EHR for quality improvement goals. SIPS with more than three office staff felt PF provided benefits primarily through teaching, while SIPs with three or fewer staff felt that PF also provided hands-on support.

Rogers ES, Cuthel AM, Berry CA, et al. Clinician perspectives on the benefits of practice facilitation for small primary care practices. Ann Fam Med 2019; 17 (Suppl 1):S17-S23. http://www.annfammed.org/content/17/Suppl_1/S17.full

A Randomized Trial of External Practice Support to Improve Cardiovascular Risk Factors in Primary Care

The Northwest Cooperative compared the effectiveness of adding enhanced external support to practice facilitation (PF) on primary care practices’ performance on cardiovascular clinical quality measures. In this randomized trial, Practices received either PF alone or enhanced practice support that included: PF with shared learning opportunities, PF with educational outreach visits, or PF with both shared learning opportunities and educational outreach visits. The researchers found no significant differences in clinical quality measure improvements between practices receiving only PF and those receiving enhanced support. However, they found that practices that received both shared learning opportunities and educational outreach were two times more likely to achieve a blood pressure performance goal of 70 percent compared to those receiving PF alone.

Parchman ML, Anderson ML, Dorr DA, et al. A randomized trial of external practice support to improve cardiovascular risk factors in primary care. Ann Fam Med 2019; 17 (Suppl 1):S40-S49. http://www.annfammed.org/content/17/Suppl_1/S40.full

Practice Facilitators’ and Leaders’ Perspectives on a Facilitated Quality Improvement Program

A qualitative look by the Midwest Cooperative at methods for improving quality improvement approaches, using detailed interviews from primary care practice leaders and the practice facilitators assigned to those practices. Interviews indicated that targeted practice facilitator-supported efforts may be easier to implement in primary care than larger, more extensive quality improvement projects.

McHugh M, Brown T, Liss DT, Walunas T, Persell S. (2018). Practice facilitators' and leaders' perspectives on a facilitated quality improvement program. Ann Fam Med 2018;16(Suppl 1):S65-S71. http://www.annfammed.org/content/16/Suppl_1/S65.

A Framework to Guide Practice Facilitators in Building Capacity

A discussion from the North Carolina Cooperative of a new framework for practice facilitators to apply the most appropriate mechanism for providing information to primary care practices, with a goal of building practices’ capacity to sustain improvement in their care delivery.

Baker N, Lefebvre A, Sevin C. (August 2017). J Family Med Community Health 4(6):1126. Available at: https://www.jscimedcentral.com/FamilyMedicine/familymedicine-4-1126.pdf.

Return to Topics

Practice Capacity for Quality Improvement

Practice Transformation Support and Patient Engagement to Improve Cardiovascular Care: From EvidenceNOW Southwest (ENSW) 

The EvidenceNOW Southwest Cooperative compared primary care practices receiving standard practice support (practice facilitation, practice assessment with feedback, health information technology assistance, and collaborative learning sessions) with practices receiving standard support plus patient engagement support. Primary outcomes were cardiovascular clinical quality measures collected at baseline, 9 months, and 15 months.A total of 211 practices completed baseline surveys. There were no differences by study arm (odds ratio [95% confidence interval]) for aspirin use (1.03 [0.99, 1.06]), blood pressure (0.98 [0.95, 1.01]), cholesterol (0.96 [0.92, 1.00]), and smoking (1.01 [0.96, 1.07]). However, over time there were significant improvements in aspirin use (1.04 [1.01, 1.07]), cholesterol (1.05 [1.03, 1.08]), and smoking (1.03 [1.01, 1.06]), but not blood pressure (1.01 [0.998, 1.03]) in the practices that received standard support plus patient engagement support. Improvement in enrolled practices was greater than external comparison practices across all 4 measures (all P < .05). The authors conclude that practice transformation support can help practices with improving quality of care. In addition, patient engagement in practice transformation can further enhance practices' implementation of aspects of new models of care. 

Dickinson WP, Nease DP, Rhyne RL, et al. The Journal of the American Board of Family Medicine September 2020, 33 (5) 675-686; DOI: https://doi.org/10.3122/jabfm.2020.05.190395

Primary Care Practices’ Implementation of Patient-Team Partnership: Findings from EvidenceNOW Southwest

The Southwest Cooperative examined the relationships between patient-team partnership activities and practice characteristics. The authors found that patient-team partnership implementation in small primary care practices was moderate. Practices with greater patient-team partnership were using patient registries and clinical cardiovascular disease management guidelines, were designated medically underserved areas, and had multiple medical specialties. The authors concluded that practices can improve efforts to partner with patients to assess social needs, gather meaningful input on practice improvement and patient experience, and offer resource connections.

Hall T, Knierim KE, Nease DE, et al. Primary Care Practices' Implementation of Patient-Team Partnership: Findings from EvidenceNOW Southwest. The Journal of the American Board of Family Medicine. July 2019. https://doi.org/10.3122/jabfm.2019.04.180361

A Cross-Sectional Analysis of Primary Care Practice Characteristics and Healthcare Professionals’ Behavioral Responses to Change

The Virginia Cooperative examined the relationship between healthcare professionals’ behavioral responses to change and practice characteristics. The authors analyzed survey responses of healthcare professionals from 154 primary care practices in Virginia. Findings indicated that professionals had a significantly lower capacity for change if they worked in larger practices compared to solo practices and at hospital-owned practices compared to independent practices. Additionally, being part of an accountable care organization was associated with significantly lower anxiety.

Grady VM, Soylu, TG, Goldberg DG, et al. A Cross-Sectional Analysis of Primary Care Practice Characteristics and Healthcare Professionals' Behavioral Responses to Change. Inquiry: a journal of medical care organization, provision and financing; vol. 58 (2021). February 27, 2021. https://doi.org/10.1177/0046958021996518

Place Matters: Closing the Gap on Rural Primary Care Quality Improvement Capacity - The Healthy Hearts Northwest Study

The Northwest Cooperative compared external practice facilitation support responses among rural independent and health system primary care practices and urban practices. Rural independent practices had the lowest quality improvement capacity at the start and made the largest gain in establishing a regular quality improvement process. Rural independent practices also made large improvements in meeting the blood pressure control clinical quality measures and smoking cessation metrics. The authors concluded that investing practice facilitation and quality improvement strategies in rural independent practices, where the need is high and resources are low, is beneficial.

Fagnan LJ, Ramsey K, Dickinson C, et al. Closing the Gap on Rural Primary Care Quality Improvement Capacity–the Healthy Hearts Northwest Study. J Am Board Fam Med. July-August 2021. https://doi.org/10.3122/jabfm.2021.04.210011

Improving Quality Improvement Capacity and Clinical Performance in Small Primary Care Practices

The Northwest Cooperative examined whether implementing evidence-based strategies to build improvement capacity in small primary care practices was associated with changes in performance on clinical quality measures (CQMs) for cardiovascular disease. Findings showed significant improvements in both quality improvement capacity and cardiovascular risk factor performance measures (aspirin use, blood pressure, tobacco screening/cessation).

Coleman K, Krakauer C, Anderson M, et al. Improving Quality Improvement Capacity and Clinical Performance in Small Primary Care Practices. The Annals of Family Medicine. November 2021, 19 (6): 499-506. https://doi.org/10.1370/afm.2733 

Attributes of High-Performing Small Practices in a Guideline Implementation: A Multiple-Case Study

The New York Cooperative identified characteristics of small practices that indicated they would perform well in practice facilitation-led quality improvement interventions. The authors found three characteristics that resulted in high performance: advanced use of electronic health records, dedicated resources and commitment to quality improvement, and an actively engaged lead clinician and office manager. The authors concluded that tools to assess readiness to change, specifically for small primary care practices, may help practice facilitators better translate quality improvement intervention implementation to practices’ context.

Nguyen AM, Cuthel AM, Rogers ES, et al. Attributes of high-performing small practices in a guideline implementation: A multiple-case study. Journal of Primary Care & Community Health. 2020 Dec 25. https://doi.org/10.1177/2150132720984411

Barriers to Implementing Cardiovascular Risk Calculation in Primary Care: Alignment With the Consolidated Framework for Implementation Research

The Northwest Cooperative examined the barriers to implementing cardiovascular disease risk calculation, which can inform and guide preventive strategies and treatment decisions. The authors found that the most common barriers to using cardiovascular disease risk calculators were time constraints, not having the necessary access or information, minimal or no buy-in from clinicians or staff, patient fear or dislike of taking medications, and lack of documented clinic workflow for using a calculator. The authors concluded that future cardiovascular disease prevention and implementation research should consider tailoring interventions to address the common barriers to implementing cardiovascular disease risk calculation.

Tuzzio L, O’Meara ES, Holden E, et al. Barriers to implementing cardiovascular risk calculation in primary care: Alignment with the consolidated framework for implementation research. American Journal of Preventive Medicine. 2020 December 2. https://pubmed.ncbi.nlm.nih.gov/33279368/

Engagement of Small to Medium-Sized Primary Care Practices in Quality Improvement Efforts

The Virginia Cooperative examined the association between practice readiness, practice characteristics, and engagement in quality improvement efforts. Findings revealed leadership engagement and clinician engagement were associated with practices’ readiness to change. Hospital-owned practices were associated with a lower level of clinician engagement compared to independent practices. The findings suggest that quality improvement plans should involve clinicians and leaders early in the process to foster commitment, establish practice readiness, and sustain improvement efforts.

Soylu TG, Cuellar AE, Goldberg DG, et al. Engagement of small to medium sized primary care practices in quality improvement efforts. The Journal of the American Board of Family Medicine, Jan 2021, 34 (1) 40-48. https://doi.org/10.3122/jabfm.

Practice Transformation Support and Patient Engagement to Improve Cardiovascular Care: From EvidenceNOW Southwest (ENSW)

The Southwest Cooperative examined how primary care practices can improve cardiovascular care through adoption of evidence-based guidelines. The Cooperative compared two practice transformation support interventions: standard practice support and standard support plus patient engagement support. These interventions were compared to an external group of practices that received no support. Results revealed no difference between the two interventions. However, participating practices saw greater improvement compared to the external comparison group, including improvement in team-based care, patient-team partnership, and population management in the enhanced intervention group. The authors concluded that practice transformation support can assist practices with improving quality of care, and patient engagement can further enhance practices' implementation of new models of care.

Dickinson WP, Nease DE, Rhyne RL, et al. Practice transformation support and patient engagement to improve cardiovascular care: From EvidenceNOW Southwest (ENSW). The Journal of the American Board of Family Medicine, September 2020, 33 (5), 675-686. https://doi.org/10.3122/jabfm.2020.05.190395

Readiness and Implementation of Quality Improvement Strategies Among Small- and Medium-Sized Primary Care Practices: An Observational Study

The Virginia Cooperative examined how readiness and practice characteristics affect quality improvement (QI) strategy implementation. Results revealed that QI strategy implementation increased at 12 months compared to 3 months. There was no statistically significant association between readiness and QI strategy implementation. However, independent practice implementation was significantly higher than hospital-owned practices at 3 months for aspirin, blood pressure control, cholesterol management, smoking cessation, and care coordination, and at 12 months for care coordination. The authors concluded that QI strategy implementation varies by practice ownership, and practice readiness may require more structural and organizational changes before starting a QI effort.

Soylu TG, Cuellar AE, Goldberg DG, et al. Readiness and implementation of quality improvement strategies among small- and medium-sized primary care practices: An observational study. J Gen Intern Med, 2020 August 10. https://doi.org/10.1007/s11606-020-05978-w

Exemplary Practices in Cardiovascular Care: Results on Clinical Quality Measures from the EvidenceNOW Southwest Cooperative

The Southwest Cooperative identified practice characteristics associated with high performance on four cardiovascular disease clinical quality measures (CQMs). Quarterly CQM reports were obtained from 178 practices; among these practices, 39 were high performers. These practices were more likely to be a Federally Qualified Health Center, have an underserved designation, and have a higher percentage of Medicaid patients. Additionally, these practices reported greater use of cardiovascular disease registries, standing orders or electronic health record prompts, were more likely to have medical home recognition, and reported greater implementation of building blocks of high-performing primary care. Practices with high improvement showed greater improvement implementing team-based care and population management. The authors concluded that multiple strategies were associated with delivering high-quality cardiovascular care over time.

Fernald DH, Mullen R, Hall T, et al. Exemplary practices in cardiovascular care: Results on clinical quality measures from the EvidenceNOW Southwest Cooperative. J Gen Intern Med, 2020 August 17. https://doi.org/10.1007/s11606-020-06094-5

Practice Level Factors Associated with Enhanced Engagement with Practice Facilitators; Findings from The Heart Health Now Study

The North Carolina Cooperative explored if there are practice characteristics and practice facilitator factors associated with greater levels of engagement between the facilitators and the practices they served. Half of the 136 participating practices were clinician-owned, 27% were Federally Qualified Health Centers, and approximately 40% were in medically underserved areas. The researchers found greater engagement with facilitators was associated with practices that have leaders who support quality improvement implementation and practices located in medically underserved areas.

Halladay JR, Weiner BJ, Kim J, et al. Practice level factors associated with enhanced engagement with practice facilitators; findings from the heart health now study. BMC Health Serv Res 20,695;2020 July 28. https://doi.org/10.1186/s12913-020-05552-4

The Ability of Practices to Report Clinical Quality Measures: More Evidence of the Size Paradox?

The Northwest Cooperative examined whether primary care practices with and without support from a larger organization differ in their ability to produce timely reports on cardiovascular disease quality measures. Researchers used data from 205 practices from a baseline practice survey and clinical quality measure (eCQM) data from electronic health records. Findings revealed that practices without central quality improvement (QI) support had higher rates of eCQM submission at 30 days and 60 days than practices with central QI support. Practices with central QI support took longer to submit data compared with practices without centralized support. The authors concluded that the ability of smaller practices without centralized QI support to report their eCQMs more quickly may have implications for their ability to improve these measures.

Parchman ML, Anderson ML, Penfold RB, et al. The ability of practices to report clinical quality measures: More evidence of the size paradox? JABFM 2020 July; 33(4), 620-625. https://www.jabfm.org/content/33/4/620/tab-article-info

Contrasting Perspectives of Practice Leaders and Practice Facilitators May Be Common in Quality Improvement Initiatives

The Midwest Cooperative interviewed practice leaders and practice facilitators to identify contrasting perspectives on quality improvement (QI) implementation issues and factors that contribute to them. Contrasting perspectives were related to the easiest or hardest QI interventions and practices’ success implementing the interventions. Employee turnover was often reported by practice leaders and facilitators with contrasting perspectives. The authors concluded that those who are planning QI initiatives using practice facilitation should take steps to minimize contrasting perspectives by addressing turnover challenges and encouraging opportunities to share perspectives.

McHugh M, Brown T, Walunas TL, et al. Contrasting perspectives of practice leaders and practice facilitators may be common in quality improvement initiatives. J Healthc Qual 2020 May;42(3):e32‐e38. https://www.ncbi.nlm.nih.gov/31634207

The Role of Organizational Learning and Resilience for Change in Building Quality Improvement Capacity in Primary Care

The Northwest Cooperative examined the association of adaptive reserve (AR) and development of primary care practices’ capacity for quality improvement (QI). The cooperative randomized 142 primary care practices and evaluated them at baseline and 12 months. AR was measured using a staff survey, and QI capacity was measured using the QI capacity assessment (QICA). Findings revealed that baseline AR was positively associated with both baseline and follow-up QI capacity, but there was no association between change in AR and change in the QICA. The researchers concluded that AR may be necessary for practices to increase their QI capacity, and developing AR may be a valuable step before undertaking QI-related growth.

Schuttner L, Coleman K, Ralston J, et al. The role of organizational learning and resilience for change in building quality improvement capacity in primary care. Health Care Manage Rev, 2020 April 3. https://www.ncbi.nlm.nih.gov/32251020

What Do We Know and Need to Know About Transforming Primary Care?

This commentary by a member of the national evaluation team for AHRQ’s EvidenceNOW initiative identifies some of what we know, and still need to know, in order to guide and support primary care transformation. He notes that it requires both internal culture change and a supportive external environment, including aligned financial incentives. He points out that while external facilitation will likely help, transformation is even more dependent on active support from visionary internal leadership and an infrastructure for managing change. But without access to accurate, timely and repeatable measurement data, even a practice with all the other pieces in place will find it hard to identify and improve priority areas. Clinicians and other personnel, plus patients must be engaged in the changes to ensure that they are made in a way that also serves their needs. Finally, it is very unlikely that one size will fit all practice settings, either in approach to change or in what changes each practice chooses to make. More information is needed for many questions, which he raises here in the hope that others will provide evidence-based answers.

Solberg LI. What do we know and need to know about transforming primary care? Family Practice, August 2017; 34(4): 371-372. PMID: 28475721 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5808872/

Effects of Practice Turnover on Primary Care Quality Improvement Implementation

The EvidenceNOW national evaluation team examined qualitative data from practice staff and external practice facilitators participating in EvidenceNOW, a large-scale quality improvement (QI) initiative, to understand the relationship between practice turnover and QI efforts. They found that turnover can limit practices' ability to engage in QI activities in various ways. For example, when a staff member leaves, remaining staff often must take on additional responsibilities. What’s more, QI momentum slows as new staff are trained or existing staff are reengaged. Turnover also alters staff dynamics and can create barriers to constructive working relationships and team building. When key practice members leave, they can take with them institutional memory about QI purpose, processes, and long-term vision. The authors conclude that understanding how staff turnover affects QI may help practices, and those helping them with QI, manage the disruptive effects of turnover.

Baron A HJ, Sweeney S, Woodson T, et al. Effects of practice turnover on primary care quality improvement implementation. Am J Med Qual 2019 Apr; 29. PMID:31030525 https://www.ncbi.nlm.nih.gov/pubmed/31030525

Does Ownership Make a Difference in Primary Care Practice?

The EvidenceNOW national evaluation team used electronic health record and survey data from September 2015 to April 2017 to assess differences in structural characteristics, quality improvement (QI) processes, and cardiovascular preventive care by ownership type among 989 small to medium primary care practices. The team compared physician-owned practices, health system or medical group practices, and Federally Qualified Health Centers (FQHC) by using 15 survey-based practice characteristic measures, 9 survey-based QI process measures, and 4 electronic health record-based cardiovascular disease prevention quality measures, namely, aspirin prescription, blood pressure control, cholesterol management, and smoking cessation support (ABCS). ABCS performance was similar across ownership type, with the exception of smoking cessation support (51.0% for physician-owned practices vs 67.3% for health system practices and 69.3% for FQHCs). Primary care practice ownership was associated with differences in QI process measures, with FQHCs reporting the highest use of QI strategies followed by health system practices. ABCS were mostly unrelated to ownership, suggesting a complex path between QI strategies and outcomes.

Liindner S, Solberg LJ, Miller WL, et al. Does ownership make a difference in primary care practice? JABFM 2019 May; 32(3):398-407. PMID:31068404 https://www.ncbi.nlm.nih.gov/pubmed/31068404

The Capacity of Primary Care for Improving Evidence-Based Care: Early Findings from AHRQ’s EvidenceNOW

This paper introduces the journal supplement on AHRQ’s EvidenceNOW initiative to improve primary care. The supplement consists of 8 original research articles representing all 7 EvidenceNOW regional cooperatives and the national evaluation team. The authors note that at the outset of the program, the cooperatives and national evaluation team harmonized a number of metrics, especially for the ABCS (aspirin prescribing , blood pressure control, cholesterol management, and smoking cessation), and practice capacity for quality improvement. In addition, each cooperative, as part of its own robust evaluation plan, has been collecting some unique metrics specific to its own study aims. The supplement also includes an overview and rationale for the initiative from AHRQ and two commentaries from nationally recognized experts in the field of primary care research and practice transformation. The authors of this introduction to the supplement note that although the articles report early findings that represent a range of topics and empirical approaches, together they expand our understanding of the current performance and capacity of primary care for improving evidence-based care and how to provide external quality improvement support to primary care practices.

Shoemaker SJ, McNellis RJ, and DeWalt DA. The capacity of primary cfare for improving evidence-based care: Early findings from AHRQ’s EvidenceNOW. Ann Fam Med 2018; 16(Suppl 1):S2-S-4. PMID: 29632218 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5891306/

Assessing Quality Improvement Capacity in Primary Care Practices

Healthy Hearts Northwest developed a Quality Improvement Capacity Assessment (QICA) survey that identified seven domains of QI capacity, such as embedding clinical evidence into daily work and using data to improve clinical performance measures. As part of the study intervention, each of the 209 participating practices met with a practice facilitator (PF) to discuss their survey responses and calculate a QICA score. The researchers examined the association between the QICA scores, practice characteristics, their prior experience with managing practice change, and performance on clinical quality measures for three cardiovascular (CVD) risk factors. The QICA score was associated with prior experience managing change and moderately associated with two of three CVD risk factors. Rural practices and those with 2 to 5 clinicians had lower QICA scores. The authors conclude that the QICA is useful for assessing QI capacity within a practice and may serve as a guide for both PFs and practices to improve QI capacity and clinical performance.

Parchman ML, Anderson ML, Coleman K, et al. Assessing quality improvement capacity in primary care practices. BMC Family Practice 2019; 20:103. Available at: https://doi.org/10.1186/s12875-019-1000-1

AHRQ’s EvidenceNOW: Helping Small Primary Care Practices Build Capacity for Quality Improvement

An infographic highlighting participating EvidenceNOW practices’ capacity at baseline to implement new evidence into practice. Capacity refers to the attitudes, skills, structures, and processes that enable a primary care practice to improve systematically.

Agency for Healthcare Research and Quality. (January 2018). Available at: http://www.ahrq.gov/sites/default/files/wysiwyg/evidencenow/evaluation/evidence-now-improving-capacity.pdf.

A Framework to Guide Practice Facilitators in Building Capacity

A discussion from the North Carolina Cooperative of a new framework for practice facilitators to apply the most appropriate mechanism for providing information to primary care practices, with a goal of building practices’ capacity to sustain improvement in their care delivery.

Baker N, Lefebvre A, Sevin C. (August 2017). Journal of Family Medicine and Community Health 4(6):1126. Available at: https://www.jscimedcentral.com/FamilyMedicine/familymedicine-4-1126.pdf.

Return to Topics

Improving the ABCS of Heart Health

Estimating the Cardiovascular Disease Risk Reduction of a Quality Improvement Initiative in Primary Care: Findings from EvidenceNOW

Researchers from the EvidenceNOW national evaluation team examined reductions in 10-year atherosclerotic cardiovascular disease (ASCVD) risk for patients who participated in EvidenceNOW. The average 10-year ASCVD risk of patients before EvidenceNOW interventions was 10.11%. After EvidenceNOW interventions, 10-year ASCVD risk for these patients lowered to 10.03%. This risk reduction would prevent 3,169 ASCVD events over 10 years and avoid $150 million in 90-day direct medical costs. The researchers concluded that small preventive care improvements and associated reductions in ASCVD risk can lead to meaningful life-saving benefits at the population level.

Lindner SR, Balasubramanian B, Marino M, et al. Estimating the Cardiovascular Disease Risk Reduction of a Quality Improvement Initiative in Primary Care: Findings from EvidenceNOW. The Journal of the American Board of Family Medicine. May 2023, 36 (3) 462-476. http://www.jabfm.org/content/36/3/462.abstract.

Improving the ABCS of Heart Health

A Heart Healthy Intervention Improved Tobacco Screening Rates and Cessation Support in Primary Care Practices

The North Carolina Cooperative examined whether an evidence-based cardiovascular disease risk reduction intervention would improve rates of tobacco cessation screening and counseling in small primary care practices. Results revealed that over time, there were significant improvements in practices’ tobacco screening and cessation support rates. Practice factors associated with improvement included being in an academic health center or faculty practice, having more clinicians, and having a lower percentage of White patients.

Kowitt SD, Goldstein AO, Cykert S. A Heart Healthy Intervention Improved Tobacco Screening Rates and Cessation Support in Primary Care Practices. Journal of Prevention. March 17, 2022. https://doi.org/10.1007/s10935-022-00672-5

The Impact of Practice Facilitation and Seasonal Variation on Blood Pressure Control in Small Independent Practices

The New York City Cooperative examined the effect of practice facilitation and seasonal variation on blood pressure in small independent practices. The authors found that practice facilitation had no effect on blood pressure control. The authors concluded that many small independent practices already met or exceeded national estimates of blood pressure control before the intervention.

Gepts T, Siman N, Cleland C, et al. The Impact of Practice Facilitation and Seasonal Variation on Blood Pressure Control in Small Independent Practices. Journal of the American Heart Association. November 5, 2018. https://www.ahajournals.org/doi/10.1161/circ.138.suppl_1.14816

The Impact of Practice Facilitation on Adherence to Cardiovascular Disease Prevention Guidelines

The New York City Cooperative examined the effectiveness of practice facilitation on the adoption of the Million Hearts cardiovascular disease evidence-based guidelines. The authors developed a unique measure that broke down the smoking measure quantifying the amount of tobacco users who received cessation counseling or medications (“smokers counseled”). The authors found that implementation of the intervention led to an increase in the proportion of smokers counseled.

Siman N, Cleland C, Berry C, et al. The Impact of Practice Facilitation on Adherence to Cardiovascular Disease Prevention Guidelines. Journal of the American Heart Association. November 5, 2018. https://www.ahajournals.org/doi/10.1161/circ.138.suppl_1.14745

Improving Smoking and Blood Pressure Outcomes: The Interplay Between Operational Changes and Local Context

This study identified conditions and operational changes linked to improvements in smoking and blood pressure outcomes. The authors found that in clinician-owned practices, implementing a process to routinely screen, counsel, and connect patients to smoking cessation resources, or implementing a documentation change or referral to a resource led to improvements in smoking outcomes with a moderate level of facilitation support. Blood pressure outcomes improved among solo practices after medical assistants were trained to take accurate blood pressure readings. Blood pressure outcomes improved in larger clinician-owned practices when practices took a second blood pressure reading when the first was elevated, and when staff documented this information in electronic health records. Blood pressure outcomes improved among larger health- and hospital-owned practices when they implemented 50 hours or more of facilitation. The authors concluded that there was no "magic bullet" for improving smoking or blood pressure outcomes. Multiple combinations of operational changes led to improvements, but only in specific contexts of practice size and ownership, or amount of external facilitation.

Cohen DJ, Sweeney SM, Miller WL, et al. Improving Smoking and Blood Pressure Outcomes: The Interplay Between Operational Changes and Local Context. Ann Fam Med. June 2021. https://doi.org/10.1370/afm.2668

Cardiovascular Disease Preventive Services Among Smaller Primary Care Practices

This study identified the percentage of practices that met the Million Hearts target for the ABCS of heart health (aspirin use, blood pressure control, and smoking cessation support) and the practice characteristics associated with better performance. Results showed that 54% of practices met the Million Hearts goal for smoking cessation, 52% met the goal for aspirin, and 32% met the goal for blood pressure. Practice characteristics that affected performance included ownership (hospital/health system–owned practices had higher aspirin performance than clinician-owned practices), rurality (rural practices had lower performance than urban practices), and disruptions (practices that experienced more than one major disruption showed lower aspirin performance).

Marino M, Solberg L, Springer R, et al. Cardiovascular Disease Preventive Services Among Smaller Primary Care Practices. American Journal of Preventive Medicine. https://doi.org/10.1016/j.amepre.2021.10.011

A Cohort Analysis of Statin Treatment Patterns Among Small-Sized Primary Care Practices

The Midwest Cooperative examined patient- and practice-level factors associated with lack of statin treatment. The authors found no record of moderate- to high-intensity statin prescription among 43% of participating patients. Younger age, female sex, and lower low-density lipoprotein cholesterol were associated with a lack of appropriate statin intensity. Patients insured by Medicaid and practices with only family medicine-trained physicians were associated with lower appropriate statin intensity. Additionally, lack of appropriate statin intensity was higher in independent practices than in Federally Qualified Health Centers. These findings highlight the importance of tailoring quality improvement approaches to different practice settings.

Yu J, Wang AA, Zimmerman LP, et al. A Cohort Analysis of Statin Treatment Patterns Among Small-Sized Primary Care Practices. J Gen Intern Med. January 8, 2022. https://doi.org/10.1007/s11606-021-07191-9

Implementation of Community-Based Resource Referrals for Cardiovascular Disease Self-Management

The Midwest Cooperative describes how primary care practices implemented CommunityRx-H3, a community resource referral system that used practice facilitators to support cardiovascular disease prevention quality improvement. Findings revealed that staff members felt largely positive connecting patients to community resources. Factors that facilitated CommunityRx-H3 implementation included clinician "champions," engaged practice managers, and a practice culture that valued community resources. Factors that made implementation more difficult included practices not willing to integrate the intervention into existing workflows, limited staff capacity to complete the resource inventory, and unavailability or cost of materials needed to print the resource referral list.

Abramsohn E, DePumpo M, Boyd K, et al. Implementation of community-based resource referrals for cardiovascular disease self-management. The Annals of Family Medicine. 2020 Nov; 18(6), 486-495. https://doi.org/10.1370/afm.2583

Validity of Medical Record Abstraction and Electronic Health Record-Generated Reports to Assess Performance on Cardiovascular Quality Measures in Primary Care

The Oklahoma Cooperative examined whether medical record abstraction and electronic health record (EHR)–generated reports are valid methods to determine performance scores for common cardiovascular care. Results revealed that medical record abstraction resulted in higher performance scores compared with EHR–generated reports. In some cases, misclassification-adjusted performance scores were more similar to EHR–generated performance scores. The findings suggest that meeting a performance target may depend on the method used to estimate performance, which has implications for quality improvement efforts and value-based payment models.

Homco J, Carabin H, Nagykaldi Z, et al. Validity of medical record abstraction and electronic health record–generated reports to assess performance on cardiovascular quality measures in primary care. JAMA Netw Open 2020; 3(7). http://doi.org/10.1001/jamanetworkopen.2020.9411

AHRQ’s EvidenceNOW: Setting the Target for Improving Heart Health in America

An infographic summarizing participating primary care practices’ performance delivering heart health services to their patients at baseline (as of January 2017).

Agency for Healthcare Research and Quality. (February 2017). Available at: http://www.ahrq.gov/evidencenow/research-results/results/infographics/baseline.html.

Implementation of Systematic Community Resource Referrals at Small Primary Care Practices to Promote Cardiovascular Disease Self-Management

The Midwest Cooperative describes the implementation of a community resource referral system in small clinical practices to reduce cardiovascular disease (CVD) risk. Practices completed an inventory of local CVD-related resources, which was then used to create a list of printed resources for patients. Half of the participating practices completed the inventory. The cooperative found that it was feasible to create practice-specific resources, but digital distribution was not feasible due to inconsistent use of electronic health record (EHR) systems, workflow variation, and lacking data-sharing infrastructure. The researchers concluded that successful implementation of quality improvement strategies to systematize community resource referral solutions is feasible at small practices, but more research is needed to understand what motivates small practices to participate in implementation of these solutions.

Makelarski JA, DePumpo M, Boyd K, et al. Implementation of systematic community resource referrals at small primary care practices to promote cardiovascular disease self-management. J Healthc Qual, 2019 Nov 20. https://www.ncbi.nlm.nih.gov/31764248

Return to Topics

Research Design and Methods

Identifying Contextual Factors and Strategies for Practice Facilitation in Primary Care Quality Improvement Using an Informatics-Driven Model: Framework Development and Mixed Methods Case Study

The Midwest Cooperative designed and developed a framework that identifies contextual factors, challenges, and strategies that impact practice facilitation, implementation of quality improvement interventions, and clinical measure performance. Results revealed that practice leaders, staff, and practice facilitators influenced the success of the quality improvement program, but these participants faced different challenges and used different strategies. Barriers included patients’ social determinants of health, a lack of staff and time, and disorganized facilitation resources. Factors that made the program possible included practice culture, staff buy-in, implementation of effective practice facilitation strategies, practices’ capacity for change, and shared complementary resources from similar, ongoing programs.

Ye J, Woods D, Bannon J, et al. Identifying Contextual Factors and Strategies for Practice Facilitation in Primary Care Quality Improvement Using an Informatics-Driven Model: Framework Development and Mixed Methods Case Study. JMIR Human Factors 2022;9(2):e32174. https://humanfactors.jmir.org/2022/2/e32174

Accounting for Blood Pressure Seasonality Alters Evaluation of Practice-Level Blood Pressure Control Intervention

The New York City Cooperative examined methods to address seasonal variation in blood pressure. In this randomized stepped-wedge design, interventions consisted of 13 visits from practice facilitators trained in improving blood pressure control. To determine the interventions’ effects, two models were used—one that did not account for seasonality and one that did. The researchers found that accounting for seasonality did affect outcomes related to blood pressure control. The cooperative concluded that studies evaluating blood pressure control should compare outcome measures across similar seasons, and the length of the measurement period should account for seasonal effects.

Gepts T, Nguyen AM, Cleland C, Wu W, Pham-Singer H, Shelley D. Accounting for blood pressure seasonality alters evaluation of practice-level blood pressure control intervention. Am J Hypertens 2020 March 13;33(3):220‐222. https://www.ncbi.nlm.nih.gov/31711219

A Qualitative Analysis of Implementing EvidenceNOW to Improve Cardiovascular Care

Using in-depth interviews, the Virginia Cooperative found that strengths of EvidenceNOW implementation in the region included diverse team member skills and areas of expertise, a well-received kick-off event, and a comprehensive set of practice improvement resources. Implementation challenges included recruiting primary care practices, varying types and capabilities of electronic health records, and working with practices at different transformation stages. The authors concluded that future large-scale primary care practice improvement efforts may benefit from a narrower focus on either clinical intervention or practice transformation and/or required organizational structures and processes before clinical intervention efforts start.

Goldberg DG, Haghighat S, Kavalloor S, et al. A qualitative analysis of implementing EvidenceNOW to improve cardiovascular care. JABFM 2019 September; 32 (5) 705-714. https://www.jabfm.org/content/32/5/705

A Taxonomy for External Support for Practice Transformation

The lead investigators of the EvidenceNOW initiative developed a taxonomy for external support for practice change that could be used by external groups, researchers, and healthcare leaders. The authors developed descriptions of key domains that comprehensively characterize external support interventions. The taxonomy included one domain to specify the conceptual model(s) on which an intervention is built and another to specify the types of support strategies used. Another five domains provided specifics about the dose/mode of that support, the types of change process and care process changes that are encouraged, and the degree to which the strategies are prescriptive and standardized. A model was also created to illustrate how the domains fit together and how they would respond to practice needs and reactions. This taxonomy should facilitate communication and collaboration between primary care quality improvement work, practice change research, and implementation science.

Solberg LI, Kuzel A, Parchman ML, et al. A Taxonomy for external support for practice transformation. The Journal of the American Board of Family Medicine. Jan 2021, 34 (1) 32-39. https://doi.org/10.3122/jabfm

Barriers and Facilitators in the Recruitment and Retention of More Than 250 Small Independent Primary Care Practices for EvidenceNOW

The New York City Cooperative used a stepped-wedge randomized controlled trial to look at factors that facilitate recruitment of small independent primary care practices and influence retention. Researchers analyzed qualitative data from recruiters’ field notes, diary entries, and provider interviews to identify barriers and facilitators encountered in recruiting and retaining 257 practices in New York City. They found that three main factors facilitated rapid recruitment: (1) a prior well-established relationship with the local health department, (2) alignment of project goals with practice priorities, and (3) providing appropriate monetary incentives. They also found that retention was facilitated in similar ways using a multifaceted communication strategy.

Cuthel A, Rogers E, Daniel F, et al. Barriers and facilitators in the recruitment and retention of more than 250 small independent primary care practices for EvidenceNOW. Am J Med Qual, 2019 Dec 22. https://pubmed.ncbi.nlm.nih.gov/31865749

Design of Healthy Hearts in the Heartland (H3): A Practice-Randomized, Comparative Effectiveness Study

The Midwest Cooperative randomized 112 and 114 practices to Point of Care ( POC) and POC + Population Management (POC + PM), respectively, to test the feasibility of implementing these two quality improvement strategies to improve ABCS (aspirin use for eligible patients, blood pressure control, cholesterol management, and smoking cessation) at practices in Illinois, Indiana, and Wisconsin. Randomization ensured baseline comparability for all nine key variables, including the ABCS measures indicating proportion of patients at the practice level meeting each quality measure. Surrogate estimates for the true ABCS at baseline, coupled with the unique randomization logic, achieved adequate baseline balance on these outcomes. Similar practice- or cluster-randomized trials may consider adaptations of this design. Final analyses on 12- and 18-month ABCS outcomes for the H3 study are forthcoming.

Ciolino JD, Jackson KL, Liss DT, et al. (2018). Design of healthy hearts in the heartland (H3): a practice-randomized comparative effectiveness study. Contemp Clin Trials. 2018 Aug;71:47-54. Doi: 10.101/j.cct.2018.06.004. Epub 2018 Jun 2. PMID:29870868.

From Concepts and Codes to Healthcare Quality Measurement: Understanding Variations in Value Set Vocabularies for a Statin Therapy Clinical Quality Measure

In the Northwest Cooperative’s development of a statin therapy clinical quality measure (CQM), independent measure developers created two unique value sets for the same global concepts. They first identified differences between the two value set specifications of the same CQM. They then implemented the various versions in a quality measure calculation registry to understand how the differences affected calculated prevalence of risk and measure performance. Global performance rates only differed by 0.8%, but there were up to 2.3 times as many patients included with key conditions, and differing performance rates of 7.5% for patients with ‘myocardial infarction’ and 3.5% for those with ‘ischemic vascular disease’. They concluded that the decisions CQM developers make about which concepts and code groups to include or exclude in value set vocabularies can lead to inaccuracies in the measurement of quality of care. One solution is that developers could provide rationale for these decisions.

Cholan RA, Rhoton D, Sacheva B, et al. From concepts and codes to healthcare quality measurement: Understanding variations in value set vocabularies for a statin therapy clinical quality Measure. eGEMS (Washington DC). 2017;5(1):19. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5983064/

Understanding the Impact of Variations in Measurement Period Reporting for Electronic Clinical Quality Measures.

Electronic Clinical Quality Measures (eCQMs) have increased in importance in value-based programs, but accurate and timely measurement has been slow. Northwest cooperative researchers asked 209 practices to extract and submit four eCQMs from their electronic health records on a quarterly basis using a 12-month measurement period. The measurement periods of the survey data were categorized into non-standard (3, 6, 9 months and other) and standard periods (12 months). For comparison, patient-level data from three clinics were collected and calculated in an eCQM registry to measure the impact of varying measurement periods. Differences between measures with standard versus non-standard periods ranged from –3.3 percent to 14.2 percent between clinics. Variations in measurement periods were associated with variation in performance between clinics for 3 of the 4 eCQMs, but did not have significant differences when calculated within clinics. The researchers conclude that variations from standard measurement periods may reflect poor data quality and accuracy.

Colin NV, Cholan RA, Sachdeva B, et al. Understanding the impact of variations in measurement period reporting for electronic clinical quality measures. eGMS (Washington DC) 2018;6(1):17. Epub 2018/08/11. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6078150/

Primary Care Practices’ Ability to Report Electronic Clinical Quality Measures in the EvidenceNOW Southwest Initiative to Improve Heart Health

EvidenceNOW Southwest researchers determined how quickly primary care practices can report electronic clinical quality measures (eCQMs) and the practice characteristics associated with faster reporting. A total of 211 primary care practices in Colorado and New Mexico participated. Practices were instructed on eCQM specifications that could be produced by an electronic health record, a registry, or a third-party platform. Practices received 9 months of support from a practice facilitator, a clinical health information technology advisor, and the research team. Practices were instructed to report their baseline ABCS (aspirin for eligible patients, blood pressure control, cholesterol management, and smoking cessation) CQMs as soon as possible. Time to report eCQMs varied by measure and practice type, with very few practices reporting quickly. The median time to report any baseline electronic clinical quality measure was 8.2 months. Practices took longer to report a new cholesterol measure than other measures. The researchers conclude that programs that require eCQM reporting should consider the time and effort practices must exert to produce reports, and that practices may benefit from additional support to succeed in new programs that require eCQM reporting.

Knierim KE, Hall TL, Dickinson LM, et al. Primary care practices’ ability to report electronic clinical quality measures in the EvidenceNOW Southwest initiative to improve heart health. JAMA Network Open. In press. PMID:31390033; DOI:10.1001/jamanetworkopen.2019.856

Specifying and Comparing Implementation Strategies across Seven Large Implementation Interventions: A Practical Application of Theory

ESCALATES, the EvidenceNOW national evaluation team, used empirical data to test how the Expert Recommendations for Implementing Change (ERIC) taxonomy applies to the EvidenceNOW dissemination and implementation initiative aimed at taking cardiac prevention to scale in primary care practice. The researchers used ERIC to identify the implementation strategies of the seven cooperatives involved in the initiative, and specified the actor, action, target, dose, temporality, justification, and expected outcome for each. They then grouped implementation strategies by outcomes and justifications. Thirty-three ERIC strategies were used by cooperatives. The researchers identified a range of revisions to the ERIC taxonomy to improve the practical application of these strategies. They also organized ERIC implementation strategies into four functional groupings based on the way they observed how they were applied in practice. The findings suggest revisions to the ERIC implementation strategies to reflect their use in real-work dissemination and implementation efforts. The researchers conclude that the functional groupings of the ERIC implementation strategies that emerged from on-the-ground implementers will help guide others in choosing among and linking multiple implementation strategies when planning small- and large-scale implementation efforts.

Perry CK, Damschroder LJ, Hemler JR, et al. Specifying and comparing implementation strategies across seven large implementation interventions: a practical application of theory. Implementation Science 2019; 14(32). Open access: https://implementationscience.biomedcentral.com/articles/10.1186/s13012-019-0876-4

A Population Approach Using Cholesterol Imputation to Identify Adults with High Cardiovascular Risk: A Report from AHRQ’s EvidenceNow Initiative

Using two different methods for estimating patients’ risk for cardiovascular disease, when cholesterol data are missing, can quickly and accurately identify high-risk patients, according to this study by AHRQ EvidenceNOW researchers in North Carolina. Using these methods could help clinicians avoid delays in implementing strategies to help reduce the cardiovascular risk for these patients.

Cykert S, DeWalt, DA, Weiner BJ, Pignone M, Fine J, and Kim, JI (2018). A population approach using cholesterol imputation to identify adults with high cardiovascular risk: A report from AHRQ’s EvidenceNow initiative.

Journal of the American Medical Informatics Association, November 29, 2018. https://doi.org/10.1093/jamia/ocy151

A Community Engagement Method to Design Patient Engagement Materials for Cardiovascular Health

The Southwest Cooperative describes research design challenges and findings from the use of a community-based intervention called Boot Camp Translation. This intervention focuses on translating evidence-based heart disease prevention strategies into messaging and materials that are relevant and understandable for community members. Findings indicate that this technique yielded messages and materials tailored to different communities, suggesting that heart disease prevention programs are not one-size-fits-all.

English A, Dickinson L, Zittleman L, et al. (2018). A community engagement method to design patient engagement materials for cardiovascular health. Ann Fam Med 2018;16(Suppl 1):S58-S64. http://www.annfammed.org/content/16/Suppl_1/S58.

Engaging Primary Care Practices in Studies of Improvement: Budgeting for Practice Recruitment

In this article, the Northwest and Midwest Cooperatives describe the approach, cost, and resources needed to recruit and enroll 500 primary care practices for EvidenceNOW. The recruitment effort required a total of 22,430 hours and $2.675 million, or $5,529 per enrolled practice. Prior relationships with practices or “warm hand-offs” predicted recruitment success.

Fagnan LJ, Walunas T, Parchman ML, et al. (2018). Engaging primary care practices in studies of improvement: budgeting for practice recruitment. Ann Fam Med 2018;16(Suppl 1):S72-S79. http://www.annfammed.org/content/16/Suppl_1/S72.

Recruiting Practices for Change Initiatives Is Hard: Findings from EvidenceNOW

A cross-cooperative analysis conducted by the EvidenceNOW National Evaluation Team of strategies used to recruit primary care practices into EvidenceNOW. The analysis explores important elements of primary care practice today that highlight the need for ever-changing recruitment methods.

Sweeney, S et al. (September 2017). American Journal of Medical Quality. Available at:  http://journals.sagepub.com/eprint/sktm6QrtsVRTST5dgKgM/full#articleCitationDownloadContainer.

Study Protocol for “Healthy Hearts Northwest”: a 2x2 Randomized Factorial Trial to Build Quality Improvement Capacity in Primary Care

A description of the EvidenceNOW Northwest Cooperative’s study protocol. The study targeted the enrollment of 250 smaller primary care practices across Washington, Oregon, and Idaho to assess four combinations of practice support—practice facilitation alone, practice facilitation with educational outreach, practice facilitation with shared learning opportunities, or practice facilitation with both—and their effectiveness in building quality improvement capacity in primary care.

Parchman, ML et al. (October 2016). Implementation Science 1(1):138. Available at: http://implementationscience.biomedcentral.com/articles/10.1186/s13012-016-0502-7.

Testing the Use of Practice Facilitation in a Cluster Randomized Stepped Wedge Design Trial to Improve Adherence to Cardiovascular Disease Prevention Guidelines: HealthyHearts NYC

A description of the EvidenceNOW New York City Cooperative’s study protocol. The study tested the use of a stepped-wedge cluster randomized control trial in evaluating the impact of practice facilitation versus usual care on the outcome of ABCS measures in 250 small- to medium-sized primary care practices in New York City.

Shelley, DR et al. (July 2016). Published in Implementation Science 11(1):88. Available at: http://implementationscience.biomedcentral.com/articles/10.1186/s13012-016-0450-2.

A National Evaluation of a Dissemination and Implementation Initiative to Enhance Primary Care Practice Capacity and Improve Cardiovascular Disease Care: the ESCALATES Study Protocol

An overview of the EvidenceNOW national evaluation research design. The observational study is examining quantitative and qualitative data across the seven EvidenceNOW cooperatives. Data collected will include information from online implementation diaries, interviews with practice staff, organizational characteristics, and performance on clinical quality measures (ABCS).

Cohen, DJ et al. (June 2016). Implementation Science 11(1): 86. Available at: https://implementationscience.biomedcentral.com/articles/10.1186/s13012-016-0449-8.

Advancing Heart Health in North Carolina Primary Care: the Heart Health NOW Study Protocol

A description of the EvidenceNOW North Carolina Cooperative’s study protocol. The study used a stepped wedge, stratified, cluster randomized trial to determine the effect of a comprehensive, evidence-based practice support strategy—including practice facilitation, expert consultation, technology support, and regional learning collaboratives—on the implementation of evidence-based heart disease prevention among patients in 300 primary care practices.

Weiner, BJ et al. (November 2015). Implementation Science 10:160. Available at: http://implementationscience.biomedcentral.com/articles/10.1186/s13012-015-0348-4.

Return to Topics

Other Topics

The Value of Funding a Primary Care Extension Program in the United States

This viewpoint discusses the value of implementing a primary care extension program to strengthen and ensure access to high-quality primary care. The article uses EvidenceNOW as an example of a primary care extension program that was successful in helping primary care practices improve their capacity and heart health services. Two findings from EvidenceNOW illustrated how a national primary care extension program could have even greater impact than what was accomplished by EvidenceNOW: 1) it is important to tailor these programs to the primary care sector that is most fragile and in need of support—smaller, clinician-owned practices, and 2) the effectiveness of cooperatives (extension agents) may grow over time as extension teams gain knowledge and their practice relationships deepen. The authors concluded that while implementing an extension program would be complex and require financial investment, EvidenceNOW shows that this investment is worth consideration.

Cohen DJ, Grumbach K, Phillips RL. The Value of Funding a Primary Care Extension Program in the United States. JAMA Health Forum 2023;4(2):e225410. http://doi.org/10.1001/jamahealthforum.2022.5410.

A Path Toward Health Care Equity: System-Based Interventions for Change  

This commentary describes system-based interventions that can improve health outcomes for everyone while reducing health care disparities, and how clinicians partnering with the North Carolina Area Health Education Centers can apply these results to practice. Findings from recently reviewed studies revealed that the following approaches can help to reduce disparities and improve healthcare quality: 1) creating transparent systems using real-time digital data, 2) building accountability through quality improvement that is mindful of disadvantaged groups, and 3) enhanced communication that incorporates community voices. The author concluded that to truly achieve health equity, efforts to support social determinants of health along with interventions to reduce the effects of experienced racism will be needed.

Cykert S. A Path Toward Health Care Equity: System-Based Interventions for Change. North Carolina Medical Journal, May 2022, 83 (3) 178-181. https://doi.org/10.18043/ncm.83.3.178

Generating and Reporting Electronic Clinical Quality Measures from Electronic Health Records: Strategies from EvidenceNOW Cooperatives

The EvidenceNOW Cooperatives and National Evaluation Team examined strategies that the seven cooperatives used to generate and report electronic clinical quality measures (eCQMs) from electronic health records (EHRs) to support primary care quality improvement. Cooperative strategies encompassed key elements, including adaptability, approaches to generating eCQMs, practice facilitation, and use of specific performance reporting strategies and tools. Cooperatives ultimately generated and reported eCQMs using hybrid strategies, because EHRs or centralized sources alone could not operationalize eCQMs for quality improvement.

Richardson JE, Rasmussen LV, Dorr DA, et al. Generating and Reporting Electronic Clinical Quality Measures from Electronic Health Records: Strategies from EvidenceNOW Cooperatives. Appl Clin Inform 2022 Mar;13(2):485-494. https://pubmed.ncbi.nlm.nih.gov/35508198/

Cultural and Structural Features of Zero-Burnout Primary Care Practices

This study examined the structural and cultural factors of practice environments with no burnout. The authors found that zero-burnout practices had higher levels of psychological safety and adaptive reserve, a measure of practice capacity for learning and development. Additionally, zero-burnout practices reported using more quality improvement strategies, were more commonly solo and clinician-owned, and were less likely to participate in accountable care organizations (groups of clinicians, hospitals and other health care providers who come together voluntarily to give coordinated high-quality care to patients) or other demonstration projects. The authors concluded that efforts to prevent burnout in primary care may benefit from focusing on enhancing organization and practice culture, including promoting leadership development and fostering practice agency.

Edwards ST, Marino M, Solberg LI, et al. Cultural and Structural Features of Zero-Burnout Primary Care Practices. Health Affairs. June 2021. https://doi.org/10.1377/hlthaff.2020.02391

The Effects of Major Disruptions on Practice Participation in Facilitation During a Primary Care Quality Improvement Initiative

This study examined the relationship between disruptions in primary care practices and practice participation in facilitated quality improvement (QI). Findings revealed that half of participating practices reported experiencing one or more disruptions during the interventions. Loss of clinicians was the most common disruption. Practices that continued active participation in the QI initiative were motivated, had some QI infrastructure, and found value in working with their facilitators. The authors found that facilitators enabled practice participation by doing EHR-related work for practices, adapting work for available staff, and helping to address needs beyond the specific goals of EvidenceNOW.

Hemler JR, Edwards ST, Valenzuela S, et al. The Effects of Major Disruptions on Practice Participation in Facilitation During a Primary Care Quality Improvement Initiative. The Journal of the American Board of Family Medicine. January 2022. https://doi.org/10.3122/jabfm.2022.01.210205

A Feasible Infrastructure To Meet The Country’s Current And Future Health Crisis

ESCALATES, the independent national evaluator of EvidenceNOW: Advancing Heart Health imagines in a blog that a country-wide infrastructure based on the EvidenceNOW Model of external support could be used to enable primary care practices to better identify, track, and manage early and ongoing COVID-19 cases as well as other diseases in diverse communities. The evaluators found that this model of external support improved the ability of primary care practices to deliver heart health services and they believe it shows promise for addressing other health problems in primary care. They suggest that a national infrastructure based on this model would leverage trusted relationships among people, a personal physician, and public health organizations, and would rely on statewide networks as well as practice facilitators to help clinicians on the frontlines of care.  

Cohen DJ and Sweeney SM. A Feasible Infrastructure to Meet The Country’s Current and Future Health Crisis. Health Affairs Blog. August 16, 2021 DOI: 10.1377/hblog20210809.323329

Diffusion of Community Health Workers Within Medicaid Managed Care: A Strategy to Address Social Determinants of Health

Addressing social determinants of health (SDH) in clinical settings under the current incentive system is a challenge, note the authors of this blog. While primary care providers recognize that social needs are as important as medical needs, they feel ill-equipped to address them. The authors note the benefit of an expanded role for community health workers (CHWs). They cite New Mexico as a successful model. The diffusion of clinically integrated CHWs throughout New Mexico’s Medicaid system was sustained by incorporating the cost into the capitated payment to the managed care organizations (MCOs). Moreover, hiring and incorporating CHWs into clinical care became a required component within the contracts of state Medicaid with MCOs. Acknowledging the success of the CHW model, in 2017, New Mexico Medicaid required all MCOs to increase their CHW contacts with clients by 20 percent. Because three of the four MCOs are national, the CHW model begun in New Mexico has been deployed in 12 States. The authors conclude that screening for social determinants at the beginning of every visit uncovers important needs otherwise missed. Immediate referral to a CHW, skilled in assisting the patient in addressing such uncovered needs, expands a primary care clinic’s ability to care for patients.

Nkouaga C, Kaufman A, Alfero C, et al. Diffusion of community health workers within Medicaid managed care: A strategy to address social determinants of health. Health Affairs Blog. July 2017. DOI: 10.10377/hblog20170725.061194

Health Extension and Clinical and Translational Science: An Innovative Strategy for Community Engagement

This paper describes how Health Extension Regional Officers (HEROs) through the University of New Mexico Health Sciences Center (UNMHSC) help to facilitate university-community engagement throughout New Mexico. HEROs, based in communities across the state, link priority community health needs with university resources in education, service, and research. The UNM Clinical and Translational Science Center (CTSC) provides partial funding for HEROs to bridge the divide between research priorities of UNMHSC and health priorities of the State's communities. The establishment of a bidirectional partnership between HEROs and CTSC researchers led to: enhanced community-engaged studies through the CTSC, the HERO model itself as a subject of research, a HERO-driven boost in local capacity in scholarship and grant writing, and development of training modules for investigators and community stakeholders on community-engaged research. The upshot of these efforts were 5 grants submitted, 4 of which were funded, totaling $7,409,002.00, and 3 research articles that were published.

Kaufman A, Rhyne RL, Anastasoff J, et al. Health extension and clinical and translational science: An innovative strategy for community engagement. Journal of the American Board of Family Medicine; January-February 2017; 30(1):94-99. DOI:10.3122/jabfm.2017.01.160119

Primary Care Practices’ Implementation of Patient-Team Partnerships: Findings from EvidenceNOW Southwest

EvidenceNOW Southwest provided 9 months of practice facilitation and information technology support to 211 Colorado and New Mexico primary care practices. The researchers analyzed surveys from participating practices on patient-team partnership activities of self-management support, patient social needs assessment, community resource linkages, and patient input to examine relationships between practice characteristics and patient-team partnership. They found that practices that used patient registries, were in a medically underserved area, had a multispecialty staff mix, and were using clinical cardiovascular disease management guidelines were significantly associated with greater patient-team partnerships. However, practices reported only partial implementation of patient-team partnership strategies, and could improve their assessment of patients’ social needs, incorporating patient expectations, and linking patients to community resources.

Hall TL, Knierim KE, Nease Jr. D, et al. Primary care practices’ implementation of patient-team partnerships: Findings from EvidenceNOW Southwest. JABFM July 2019; 32(4): 490-504. Available at: https://www.jabfm.org/content/32/4/490.full

The Role of Health Extension in Practice Transformation and Community Health Improvement: Lessons from 5 Case Studies

The Northwest, Southwest, and Oklahoma Cooperatives examined the effects of incorporating technical assistance for practices and their communities to address social determinants of health in five States: New Mexico, Oklahoma, Oregon, Colorado, and Washington. They interviewed the leaders of health extension initiatives in these States to describe case studies that stretched the boundaries of the primary care extension model. The findings reveal the importance of building sustained relationships with practices and community coalitions, documenting success in broad terms as well as achieving diverse outcomes of meaning to different stakeholders, understanding that health extension is a function that can be carried out by an individual or group depending on resources, and the importance of being prepared for political struggles over “turf” and “ownership” of extension. All authors saw the need for long-term sustained funding beyond grants for sustainability of quality improvement.

Kaufman A, Dickinson WP, Fagnan LJ, et al. The role of health extension in practice transformation and community health improvement: Lessons from 5 case studies. Ann Fam Med 2019; 17 (Suppl 1):S67-S72. http://www.annfammed.org/content/17/Suppl_1/S67.full

Virtual Educational Outreach Intervention in Primary Care Based on the Principles of Academic Detailing

This article describes the development by Healthy Hearts Northwest of a tailored virtual educational outreach program using principles of traditional academic detailing (AD). The program was adapted and deployed with small- and medium-sized rural and urban primary care practices across three States. The aim of the program was to increase practices' use of cardiovascular disease risk calculation and prescription of statins for primary prevention, when appropriate. The adapted virtual program has general application to the implementation of educational outreach interventions into geographically dispersed practices and can help overcome the limitations posed by more traditional resource-intensive AD programs.

Baldwin L-M, Fischer MA, Powell J, et al. (2018). Virtual educational outreach  intervention in primary care based on the principles of academic detailing. JCEHP 2018; a38(4):269-275. Available at: https://www.ncbi.nlm.nih.gov/pubmed/30346338.

Data-Driven Diffusion of Innovations: Successes and Challenges in 3 Large-Scale Innovative Delivery Models

A paper by the Northwest Cooperative exploring barriers and solutions for diffusing data-driven innovations in primary care. The authors found that many health care organizations are using technologies necessary for health care innovation, such as electronic health records. However, for a variety of reasons, organizations encounter challenges with using data from those sources to drive innovations in care. Proposed solutions to these challenges include facilitating peer-to-peer technical assistance, providing data feedback reports to clinicians, and working with practice facilitators who are skilled in using data technology for quality improvement.

Dorr, D, Cohen, DJ, and Adler-Milstein, J. (2018). Health Affairs 37(2):257–265. Available at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5810405/.

Taking Innovation to Scale in Primary Care Practices: The Functions of Healthcare Extensions

The EvidenceNOW National Evaluation team describes how EvidenceNOW cooperatives varied in their approaches to health care extension—a way of providing external support to primary care practices with the goal of spreading innovations. This paper provides early evidence that health care extension is a feasible and potentially useful approach for providing coordinated quality improvement support to primary care practices.

Ono, S et al. (2018). Health Affairs 37(2):222-230. Available at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5805471/.

Lessons in Advancing Evidence-Based Primary Care from the Heart of Virginia Healthcare EvidenceNOW Cooperative

This brief from the Virginia Cooperative shares challenges and successful strategies for implementing primary care quality improvement interventions, with lessons learned from EvidenceNOW. Major challenges included recruiting busy practices and extracting data on heart health measures. Successful strategies included leveraging and strengthening key relationships, as well as aligning quality improvement initiatives with other ongoing priorities for a practice.

Reck, J and Bacon, O. (2018). Published by the National Academy for State Health Policy. Available at: https://nashp.org/wp-content/uploads/2018/01/VCU-Brief-No-2.pdf.

Primary Care Provider Burnout: Implications for States & Strategies for Mitigation

A paper on the experiences of primary care practices participating in the EvidenceNOW Virginia Cooperative, which point to a number of practice challenges contributing to burnout including scope of practice, payment reform, reporting requirements, and electronic health records. This brief outlines a range of strategies and policy options that States have for mitigating burnout.

Reck, J. (2017). Published by the National Academy for State Health Policy. Available at: http://nashp.org/primary-care-provider-burnout-implications-for-states-strategies-for-mitigation.