Angela Stover

Angela M. Stover, PhD

Associate Professor
Department of Health Policy and Management
Co-Director
NC TraCS' Implementation Science Methods Unit
1103D McGavran-Greenberg Hall, CB #7411
Chapel Hill, NC 27599-7411

About

Dr. Stover is a health services researcher with expertise in patient-reported outcomes (PRO) methods and implementation science. She co-directs the NC TraCS' Implementation Science Methods Unit and is an associate member of Lineberger Comprehensive Cancer Center. Dr. Stover's research program quantifies the impact of treatment for chronic health conditions on symptom burden, identifies important gaps in implementing evidence-based practices in clinics, and determines how those gaps are related to poor patient and clinic outcomes. Dr. Stover’s research program is funded by NIH, PCORI, AHRQ, Pfizer Global, and foundations.


Prior to her doctoral degree, Dr. Stover was one of the original developers of six PROMIS® (Patient-Reported Outcomes Measurement Information System ®) item banks assessing mental health and alcohol misuse (U01-AR052155: Pilkonis, University of Pittsburgh).

Dr. Stover is currently accepting doctoral students.

She has published >60 peer-reviewed articles that have been cited more than 5,000 times.

------

Examples of Dr. Stover's implementation collaborations at UNC Health:
1) Evaluating a virtual quality improvement collaborative with independent primary care practices (PI: Catherine Rohweder, DrPH)
2) Implementing a perinatal checklist for emergencies in OBGYN (PI: Joanna Quist-Nelson, MD)
3) Implementing a prognostic tool for patients with metastatic breast cancer (PI: Emily Miller Ray, MD)
4) Developing a Smart Form PRO in Epic@UNC for pharmacists to track symptoms for oral chemotherapy (MPI with Mary-Haston Vest, PharmD)

Recent Publications
Healthcare systems and clinics are increasingly interested in implementing evidence-based practices in their clinical workflow. Dr. Stover has contributed to multiple implementation guides that help clinics think through barriers, but success rates are variable. Her work shows that clinics need ongoing, tailored, ongoing support to change workflows. Dr. Stover uses mixed methods to study health care systems, including electronic health record data extraction, stakeholder interviews with patients and clinicians, implementation science, and psychometrics.


Implementation Science:
•    Koczwara B, Stover AM, Davies L, Davis M, Fleisher L, Ramanadhan, Schroeck FR, Zullig LL, Chambers DA, Proctor E. Harnessing the Synergy between Quality Improvement Science and Implementation Science in Cancer: A Call to Action. J Oncol Pract. 2018;14:6:335-340.
•    Quist-Nelson J, Hannenberg A, Ruymann K, Stover AM, Baxter JK, Smith S, Angle H, Gupta N, Lopez CM, Hunt E, Tully KP. Institution-Specific Perinatal Emergency Checklists: Multicenter Report on Development, Implementation, and Sustainability. Am J Perinatol. 2023 Jan 16. doi: 10.1055/a-1990-2499. Epub ahead of print. PMID: 36452973.
•    Check DK, Zullig LL, Davis M, Davies L, Chambers DA, Fleisher L, Kaplan SJ, Proctor E, Ramanadhan S, Schroeck FR, Stover AM, Koczwara B. Improvement Science and Implementation Science in Cancer Care: Identifying areas of synergy and opportunities for further integration. J Gen Intern Med. 2021;36(1):186-195. PMC7859137. DOI: 10.1007/s11606-020-06138-w
•    Turner K*, Trogdon J, Weinberger M, Stover AM, Ferreri S, Farley J, Ray N, Patti M, Renfro C, Trygstad T, Shea C. Organizational determinants that influence implementation effectiveness in a community pharmacy Medicaid medication management program. Implement Sci. 2018;13(5):1-13.
             *Doctoral student (HPM), dissertation paper
•    Haines ER*, Kirk MA, Lux L, Smitherman AB, Powell BJ, Dopp A, Stover AM, Birken SA. Ethnography and user-centered design to inform context-driven implementation. Transl Behav Med. 2021:ibab077. PMCID: PMC8826991.
       * Doctoral student (HPM), dissertation paper


Dr. Stover teaches graduate courses in the HPM minors for Implementation Science and Decision Sciences and Outcomes Research (DSOR).


Honors and Awards

Finalist for "Best Paper of the Year" Award
2021, Journal Quality of Life Research

Emerging Leader
2020, International Society for Quality of Life (ISOQOL): competitive award recognizing leadership within ISOQOL and dedication to the field of health-related quality of life research

UNC Provost Award for Junior Faculty Research
2020, (competitive award with pilot funds)

Chair
2019-2021, International Society for Quality of Life research (ISOQOL): special interest group on using PROs in clinical practice (group has >400 international members)

Finalist for "Best Paper of the Year" Award
2019, Journal of Patient-Reported Outcomes

World-ranked expert in quality of life research
2019-present, Read more at Expertscape

Dr. Stover's research has been featured in media outlets, including...
OncToday (2017, 2022)
MedPage (2022)
Urology Times (2022)
Medical Ethics Advisory (2022)

Representative Courses

Dr. Stover teaches graduate courses in the HPM minors for Implementation Science and Decision Sciences and Outcomes Research (DSOR)

1) In odd years (spring): "Patient-reported outcomes (PROs) and application in healthcare delivery and research" (course code: HPM 794)

2) In even years (spring): "Implementation science in health" (course code: HPM 767)

Research Activities

o    Quantify the impact of treatment for chronic health conditions on symptom burden using patient-reported outcome measures (PROs)
o    Implementation science: Identify important gaps in implementing evidence-based practices in clinics and determines how those gaps are related to poor patient and clinic outcomes
o    Cancer outcomes and care delivery
o    Psychometrics and questionnaire design

Key Publications

Using an implementation science approach to implement and evaluate Patient-Reported Outcome Measures (PROM) initiatives in routine care settings. Stover AM, Haverman L, van Oers H, Greenhalgh J, Potter CM, on behalf of the ISOQOL PROMs/PREMs in clinical practice implementation science workgroup. First published online 11 July 2020. DOI: 10.1007/s11136-020-02564-9. (2021). Qual Life Res.

Harnessing the synergy between quality improvement science and implementation science in cancer: A call to action. Koczwara B, Stover AM, Davies L, Davis M, Fleisher L, Ramanadhan, Schroeck FR, Zullig LL, Chambers DA, Proctor E. (2018). J Oncol Pract., 14(6), 335-340.

Integrating real-time, electronic patient-reported measures into cancer care: Cancer patients’ and clinicians’ perceptions of acceptability and value. (Chosen for inclusion in AcademyHealth's "Patient-Reported Outcomes (PRO) Implementation Toolkit”). Stover AM, Irwin D, Chen RC, Chera BS, Mayer DK, Muss H, Rosenstein DL, Shea TC, Wood WA, Lyons JC, Reeve BB. (2015). eGEMs (Generating Evidence and Methods to Improve Patient Outcomes), 2(1), Article 23.

State of the psychometric methods: Patient-reported outcome development and refinement using item response theory (part of 5-article supplement). Stover AM, McLeod LD, Langer MM, Chen W-H, Reeve BB. (2019). J Patient Rep Outcomes, 3(1), 50.

Performance measures based on how cancer patients feel and function: Stakeholder recommendations and feasibility testing in six cancer centers. Stover AM, Urick BY, Deal AM, et al. (2020). JCO Oncol Pract, 16(3), e234-e250.

Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS): depression, anxiety, & anger. Pilkonis PA, Choi SW, Reise SP, Stover AM, Riley WT, Cella D. (2001). Assessment, 18.

Education

  • BA, Psychology and Sociology, Westminster University
  • MA, Psychometrics, University of Pittsburgh
  • PhD, Health Behavior, University of North Carolina at Chapel Hill