This website was made possible by funding from ViiV Healthcare, a global specialist HIV company established in 2009, majority owned by GSK, with Pfizer and Shionogi as shareholders
The PROgress Project: Implementing Patient Reported Outcomes Within Routine HIV Care.
• Helping patients share information with their doctor about their health, situation, needs and preferences that may otherwise not be discussed
• Improving patient provider discussions and relationships to facilitate better-informed care and improve clinical efficiency
The PROgress project, “Improving HIV Care Through The Implementation Of PROs within Routine Patient Management,” is a ViiV Healthcare sponsored research workstream in collaboration with the University of Washington. The goal of the project is to collate and supplement evidence, insights and resources that can support the implementation of patient reported outcomes and measures (PROs) within routine HIV care.
PROgress included work on three core interrelated components:
1. The PROgress North American Site Study: This is an implementation science study of the integration of PROs in routine care within two North American HIV outpatient clinics.
2. The PROgress Implementation Toolkit: This is a practical resource developed for health care practitioners considering the implementation of PROs within routine clinical HIV care.
3. The PROgress Evidence Review and Summary: This collates evidence relevant to PROs in the care of PLWH, highlighting the potential of a well implemented process within routine HIV care to benefit PLHIV, providers and clinics.
Each were designed as complementary outputs of PROgress, to support future HIV practice.
This website is a collation of outputs from PROgress, drawing upon the expertise and insights of patients, providers, and researchers involved in the workstream.
In the context of this evidence review, we focus on brief PRO assessments useful for clinical care, typically but not always collected on touch-screen tablets at the start of clinic appointments to improve care with summary results made available to providers for the clinic visit. Other approaches are also possible such as interviewer-based collection or electronic health record patient portals; however, we emphasize these much less due to the high costs, staff burden, and under-reporting of risk behaviors with interviewer-based approaches, and the exclusion of so many potentially high-risk patients with patient portals that require a level of technological sophistication and access that is not inclusive of entire HIV clinic populations.
Patient reported outcome measures, or PROs, gather patients’ assessments and experiences of clinically important issues, typically through brief, validated questionnaires. PROs offer insight beyond what may be directly observable by the provider in several dimensions of care.
On-site PRO collection prior to routine clinical care appointments, via hand-held computer tablets with real-time results available to providers during clinic visits, has improved provider ability to detect and address depression/suicidal ideation, inadequate antiretroviral (ART) adherence, and substance use in HIV care 1,2 . Integrating PROs into clinical care of patients with chronic conditions, such as HIV, cancer and rheumatoid arthritis, have also been shown to be acceptable to patients and providers and valuable in clinical care 2-4 ; they have improved patient-provider communication 5-9 and increased patient satisfaction with care 8,10-12.
The Value For HIV Providers
Improve identification of health issues and behaviors through improved patient-provider communication
PROs have been valuable in helping providers detect previously unrecognized problems 1,2. Controlled trials have found PROs improve provider ability to identify highly personal or stigmatizing symptoms or behaviors, including suicidal ideation, depression 1,13 , substance use 1 ,inadequate ART adherence 1 , and sexual behavior 14 . PROs have also improved detection of a broad range of symptoms in several clinical populations 7,15-20 as well as less-observable quality-of-life issues, such as social functioning 5,8,14,21.
Improve patient health outcomes
Evidence suggests the use of PROs has contributed to improved health outcomes including fewer emergency department visits and hospitalizations 22,23 , increased survival rates among cancer patients 22,23 , improved outcomes for mental health conditions 24 , lower symptom distress 16,17,25 and better health-related quality of life 7 .
Workflow impact
Providers reported PROs allowed for more comprehensive identification of issues and concerns that was generally regarded as an additional but manageable impact on workflow that was regarded as a valuable tradeoff. Both patients and providers described high acceptability of PROs in routine care and high added value.
Patients living with HIV have found the use of PROs improved communication with their provider in a number of ways. Specifically, it has 1) offered an opportunity to take inventory of current health needs, symptoms, health behaviors, and quality of life, including mental health and social well-being, improving their ability to advocate for their needs; 2) offered a preview in advance of the appointment of potential topics for discussion; and 3) helped patients to initiate, structure and prioritize discussion topics with their provider. 4) enabled easier discussion of sensitive or highly personal topics, such as mental health, sexual health, and substance use.28 .
Improve health outcomes
Evidence suggests the use of PROs has contributed to improved health outcomes including fewer emergency department visits and hospitalizations 22,23 , increased survival rates among cancer patients 22,23 , improved outcomes for mental health conditions 24 ,
lower symptom distress 16,17,25 and better health-related quality of life 7 .
Honestly, I was surprised at how useful I was going to find it….I figured my patients and I have a pretty good relationship…they're gonna tell me all these things. [But I was] hearing things I hadn't heard before. You're almost glancing behind a curtain.
-HIV Physician
It really did a lot for me because you had a lot of questions that I probably wouldn't have asked the doctor, or she probably wouldn't have asked me.
-Patient living with HIV
From HIV Providers and Patients Living with HIV
Two key areas for which patients and providers believed PROs had an impact: 2,26,27
1) Identifies and helps address less-observable and difficult-to-discuss behaviors and conditions
(examples include suicide ideation, depression, anxiety, alcohol use, substance use, IPV, adherence and treatment satisfaction)
From HIV providers:
From patients living with HIV:
Today, the patient sat down [and] said, “Yeah, things are okay, I’m just not sleeping good.” But when I looked at the PROs that he had just answered, he was suicidal a couple of times last week. -(Physician, San Diego)
It's a lot different to say things in person because you're scared of the facial expressions, you're scared of the reactions. The iPad is not going to look at you because you say you do crack every day, it's not going to do that…. so you can be a lot more open when you're doing it with the iPad by yourself. So…if you don't feel comfortable talking to a doctor about it at first it's a lot easier at least when they come in [with the iPad PRO results] and they already know. -(Patient, Ft. Pierce, FL)
I didn’t know the extent of one guy’s alcohol use ... we hadn’t talked about it for some time. So it’s actually quite useful to say “here’s what you told the [PROs], let’s talk more about that”. -(Physician, Boston)
I feel like the computer is impartial. It’s completely impartial. I think it’s harder [to answer PRO questions] if it’s somebody you know all the time. You don’t want to let them down. -(Patient, Ft. Pierce, FL)
[If] you look at someone and they're clearly distraught, maybe tearful and that sort of thing, you can engage in questions around that. But as everyone knows… you can mask that stuff very easily. People do it all the time every day. And unless prompted or asked specifically around depression and suicidal ideation, people won't admit to it…there's also a big stigma and shame around mental health issues. So unless it was very obvious … I wouldn't [have asked]. And in these cases, these are literally people that I don't think I would have flagged...at the end of the day, the best element of this tool is, if nothing else, it helps us engage in a topic or conversation that would be awkward otherwise. -(Physician, Toronto)
I find that it's easier to answer to an iPad than it is to a person. I found certain questions, like the alcohol question, I was a little more honest about on the iPad versus [in person]– because I feel like you're expecting a judgmental look back, even though my doctor is actually extremely great no matter what I've done –or not done. [Answering PROs on an iPad] takes away from that,– because [results are] on a sheet of paper, someone else is going to make their look while they're reading it, so you don't have to see it. You don't have to acknowledge it. -(Patient, Toronto)
Honestly, I was surprised at how useful I was going to find it….I figured my patients and I have a pretty good relationship…they're gonna tell me all these things. [But I was] hearing things I hadn't heard before. You're almost glancing behind a curtain. -(Physician, Ft. Pierce, FL)
2) Improves patient-provider communication, helping both patients and providers to initiate, structure and prioritize discussion topics
From HIV providers:
From patients living with HIV:
You have the whole picture of what needs to be addressed in that visit, what we are missing, which normally, like I said, you won't be able to ask so many questions in such a short period of time. So to me, it's a great tool. -(Physician, Ft. Pierce, FL)
…maybe if I…already have an idea of what the question gonna be, the person asked me, I wouldn't even answer, yeah. But just the fact that I already read it and aware of it, so when the question asked, I was more prepared -(Patient, Toronto)
It’s a nice starting point with a conversation as opposed to the more traditional, you know, starting at the bottom and working up.-(Physician, Birmingham)
It really did a lot for me because you had a lot of questions that I probably wouldn't have asked the doctor, or she probably wouldn't have asked me. -(Patient, Ft. Pierce, FL)
Patients always have their agenda when they’re coming in, but through the PROs they’re also getting a sense of what our agenda is ... what I found interesting was that a few of the patients who completed the [PROs], they’ll kind of launch and tell me what’s going on with their tobacco use – without my even asking ... -(Physician, Seattle)
The questionnaire is a good thing, because I imagine not everybody does come mentally prepared in terms of having questions and a goal, "I should have asked at the doctor that. Why didn't I ask him that when I was there?" So this is a good way for both parties, the doctor and the patient, to receive and give information. -(Patient, Toronto)
It makes patients feel as if they're more involved in their care and that's important -(Physician, Ft. Pierce, FL)
Clinical Topics Measured by PROs
PROs cover a broad range of topics clinically relevant to patients living with HIV, including symptoms, mental health, health behaviors, basic needs, social context, and quality of life. A resulting report summarizes results and displays topics of interest in order of clinical priority, and can depict changes over time. Alerts for critical issues such as significant anxiety or distress, interference with function, or suicidal ideation, may be sent to an appropriate provider or displayed to the patient, depending on whether the patient is within or outside a clinical setting when using the PROs. The following are just a sample of PRO measures, and is non-exhaustive.
Mental Health
Common PRO measures of mental health include the PHQ-9 29,30 for depression, the PHQ-5 29,30 and GAD-7 31 for anxiety.
Substance Use
Common PRO measures of substance use include the AUDIT-C/AUDIT 32,33 (alcohol use), and the ASSIST 34,35 (drug use). A measure by Bruneck et al 36 measures tobacco use. Past substance use treatment may be assessed via the Treatment Services Review. 37
Antiretroviral Adherence
PRO measures available include the adherence Self-Rating Scale, 30-day visual analog scale, AACTG adherence instruments (7 day missed dose, last missed dose, weekend missed dose). 38-40
Sexual Risk Behavior
Sexual risk behavior is measurable via the Sexual Risk Behavior Inventory 41 , which includes perceived partner attributes such as gender, HIV status, and ART/PrEP use, as well as concern for recent STI exposure.
Basic Needs
Basic needs include housing, and nutrition. Housing status is assessable via the CNICS Housing Measure 42 ; an option for measuring nutrition is the Canadian Nutrition Screening Tool 43 .
Social Environment
Measures to evaluate social environment and circumstance include Multifactorial Assessment of Perceived Social Support-Short Form (MAPSS-SF) 44 and the HIV Stigma Mechanism Measure 45 (adapted)
Quality of Life
The EQ-5D 46 is a commonly-used measure of health-related quality of life and PozQoL is an emerging option. Specific questions from the HATQOL are also used in the PROgress Study.
Symptom Tracking
Symptoms and level of severity is measurable via the HIV Symptom Index. 47
Exposure to Violence
The Intimate Partner Violence 4-item measure (IPV-4) 48 is a brief measure assessing physical, sexual, and psychological violence. The Adverse Childhood Experiences-International Questionnaire (ACE-IQ) 49 (adapted) assesses childhood household violence prior to age 18.
Sample PRO Results Page
PRO results reporting can be tailored to suit the needs of any clinic. Modifiable aspects of PRO results reporting include highlighting/prioritization of the most clinically urgent topics through use of placement, bold font, or color; the use of multiple time points to note change over time; and style and degree of scoring and interpretation needed. In addition, responses to clinically urgent questions, such as suicidal ideation, can be programmed to trigger pager alerts in real time for relevant staff.
PROgress Implementation Toolkit
The PROgress Implementation Toolkit provides practical advice to support the introduction of clinical PRO assessments into routine HIV care. These insights draw from a range of sources, including practical experience integrating PROs into HIV clinical care, published literature, and primary interviews with stakeholders with experience integrating PROs into HIV clinical care. Its focus is on implementation of tablet-based patient self-administered PRO assessments in clinical care yet many of the lessons are applicable across different types of applications. The toolkit includes information on:
Assessing clinic readiness and preparing for PRO implementation
Stakeholder engagement strategies
Building and/or selecting technical infrastructure for electronic data collection
Creating a PRO assessment that best suits the needs of your clinic and its patients, including an online time-budget tool to minimize patient response burden and impact on clinic flow
PRO integration and sustainability success
Staff training needs
Monitoring and evaluating successful PRO integration
An evidence summary document has been collated to raise awareness of the potential value of well implemented PRO instruments within routine HIV care. It draws upon evidence from published literature characterizing the impact of PROs in routine clinical care for patients with chronic comorbidities, including HIV-related literature as well as other fields, particularly oncology. It includes real-world evidence surrounding the impact on patient outcomes, care processes, and the usability and acceptability of PRO platforms.
The PROgress study implemented patient-reported measures and outcomes (PROs) in two HIV outpatient clinical care settings to answer two overarching research questions:
What is the added value of implementing PROs into routine HIV care for the salient stakeholders, including the patient, the providers, and other clinic staff?
What are the essential program elements that can improve the sustainable adoption and implementation of PROs into routine HIV care across a range of differently resourced clinics?
The two North American outpatient HIV care clinics were:
Midway Specialty Care Center, Fort Pierce, Florida, USA.
St. Michael’s Hospital, Toronto, Ontario, Canada.
The PRO assessments included measures of symptoms (e.g., depression, anxiety), behaviors (e.g. adherence to antiretroviral therapy (ART), substance use), and other circumstances and perspectives (e.g., housing status, intimate partner violence, HIV medication satisfaction).
Using an implementation science framework (RE-AIM) and a mixed methodology quantitative and qualitative approach, we sought effectiveness and implementation insights. Data collection included 1761 completed patient PROs, 600 chart reviews, 47 qualitative interviews, 200 patient questionnaires, 17 provider questionnaires, training evaluations and a significant volume of implementation data and insights.
RESULTS:
Primary outputs of the PROgress project will be added to this website periodically. Below you will find a number of resources currently available including videos, peer reviewed manuscripts, external articles, conference posters and conference slides.
PROgress Study Resources: Videos, manuscripts, conference presentations, posters and external references
Videos
PROgress Animation May 2022
Improving quality of life through Implementation Science: PROgress. ViiV Healthcare. 21 November 2020. Watch members of the PROgress Study Steering group discuss the findings:
Making PROgress: How a pre-consultation tablet survey can improve dialogue between PLHIV and their HIV doctors. Facebook Premiere PROgress Study Steering Group Panel Discussion. 18 November 2020.
Watch the Panel (15 minutes)* external link
External Media Articles
The PROgress Study: An electronic solution for improving patient consultation visits in routine HIV care. Research Outreach. 21 September 2022.
View Article* external link
THE PROGRESS PROJECT: Preparing patients and doctors for their next visit enhances patient satisfaction and care. The HIV Treatment Journal of TPAN. 3 August 2022.
View Article* external link
Preparing patients and doctors for their next visit enhances patient satisfaction and care. CATIE. July 2022.
View Article* external link
The PROgress Project Is Changing Lives. IN Magazine. 25 Febuary 2021.
View Article* external link
ViewPoints Interview: ViiV Healthcare's Duncan Short Shares Insight on PROgress Study Demonstrating that Pre-visit Survey can Improve HIV Care. PharmaShots. 8 February 2021.
View Article* external link
Manuscripts
Short D, Fredericksen RJ, Crane HM, Fitzsimmons E, Suri S, Bacon J, Musten A, Gough K, Ramgopal M, Berry J, McReynolds J, Kroch A, Jacobs B, Hodge V, Korlipara D, Lober W. Utility and Impact of the Implementation of Same-Day, Self-administered Electronic Patient-Reported Outcomes Assessments in Routine HIV Care in two North American Clinics.AIDS and behavior. 2022 Jan 22:1–16. doi: 10.1007/s10461-022-03585-w.
View Primary Results Manuscript
Short, D., Wang, X., Suri, S., Hsu, T. K., Jones, B., Fredericksen, R. J., Crane, H. M., Musten, A., Bacon, J., Wang, Y., Gough, K. A., Ramgopal, M., Berry, J., & Lober, W. B. (2022). Risk Factors for Suboptimal Adherence Identified by Patient-Reported Outcomes Assessments in Routine HIV Care at 2 North American Clinics. Patient preference and adherence, 16, 2461–2472. https://doi.org/10.2147/PPA.S378335 View Manuscript* external link
Fredericksen RJ. Short D. Fitzsimmons E. Korlipara D. Suri S. Jacobs B. Bacon J. Kroch A. Musten A. Hodge V. Ramgopal M. Tan D. Berry J. Yoong D. Naccarato M. Gough K. McReynolds J. Lober W. Crane HM. Patient perceptions of the usability, utility and impact of a same-day self-administered routine electronic patient-reported outcomes (PRO) assessment in HIV care in two North American clinics. In press, Journal of AIDS and HIV Research, 14(1), pp.10-21. January-June 2022. https://doi.org/10.5897/JAHR2022.0546
View Manuscript* external link
Fredericksen RJ. Short D. Fitzsimmons E. Korlipara D. Suri S. Jacobs B. Bacon J. Kroch A. Musten A. Hodge V. Ramgopal M. Tan D. Berry J. Yoong D. Naccarato M. Gough K. McReynolds J. Lober W. Crane HM. “You’re almost glancing behind a curtain”: HIV care provider perceptions regarding integration and value of pre-visit electronic tablet-based patient-reported outcomes data collection in two North American clinics. Journal of AIDS and HIV Research, Vol. 14(1), pp. 22-31, January-June 2022. DOI: 10.5897/JAHR2022.0548.
View Manuscript* external link
Suri S, Yoong D, Short D, Tan DH, Naccarato M, Crane HM, Musten A, Fredericksen RJ, Lober WB, Gough K. Feasibility of implementing a same-day electronic screening tool for clinical assessment to measure patient-reported outcomes for eliciting actionable information on adherence to HIV medication and related factors in a busy Canadian urban HIV clinic. Int J STD AIDS. 2021 Jul 23:9564624211032796. doi: 10.1177/09564624211032796. Epub ahead of print. PMID: 34293990.
View Manuscript* external link
Oral Conference Presentations
Short D, Wang X, Suri S, Hsu T, Jones B, Fredericksen R, Crane H, Musten A, Bacon J, Wang Y, Gough K, Ramgopal M, BerryJ, Lober W. Screening with Patient-Reported Outcomes (PRO) Assessments to identify risk factors for Suboptimal Adherence in Routine HIV Care. Adherence 2022 conference. (Washington DC) October 2022. Adherence Presentation Slides
Short D, Crane H, Lober B, McReynolds J, Karras S, Fitzsimmonds E, Fredericksen R. Antunes A. A toolkit to support the implementation of patient reported outcome measures in routine HIV care. 9th Encontro Nacional Clinica de Ambulatorio de VIH e Reuniao de Imunodisfuncoes. June 2-3 2022. Porto, Portugal. (National HIV Outpatient Clinic Meeting) of Immuno Dysfunctions). PORTUGAL SLIDES
Short D, Crane HM, Lober W, McReynolds J, Karras S, Fredericksen RJ. A toolkit to support the implementation of patient reported outcome measures in routine HIV care. Oral presentation: ISOQOL 28th Annual Conference, October 2021.
ISOQOL Presentation Slides
Short D, Fredericksen RJ, Crane HM, Lober W, Bacon J, Gough K, Tan D. The PROgress Study: An implementation science approach to the integration of patient-reported measures and outcomes (PROs) within routine HIV care in Toronto. Oral presentation: HIV Endgame conference Dec 2018.
Conference Poster Presentations
Antunes, A; Short, D; Esteves, C; Lazarus, JV; Méndez, J; Pacheco, P; Tavares, A; Racha-Pacheco, R. PRO-Act Workshop: Supporting PRO implementation in Portuguese HIV care. Poster presentation, 29th Annual Conference – ISOQOL 2022. ISOQOL Presentation Slides
Fredericksen RJ. Short D. Fitzsimmons E. Suri S. Korlipara D. Jacobs B. Hodge V. Musten A. Ramgopal M. Gough K. Bacon J. Yoong D. Tan DHS. Naccarato M. McReynolds J. Lober W. Crane HM. The impact of delivering electronic same-day patient-reported outcomes assessment results on HIV care providers’ medical record documentation and referral patterns. IAPAC Fast Track Cities 2021 (virtual/Lisbon, Portugal) October 20-22, 2021.
IAPAC Fast Track Cities Poster
Fredericksen RJ. Short D. Fitzsimmons E. Musten A. Jacobs B. Suri S. Korlipara D. Hodge V. Gough K. Ramgopal M. Bacon J. McReynolds J. Lober W. Crane HM. Provider perceptions of utility and impact of a same-day routine electronic patient reported outcomes (PRO) assessment in clinical HIV care. Virtual poster presentation, ISOQOL 27th Annual Conference, October 2020.
ISOQOL Provider Acceptability Poster
Fredericksen RJ. Short D. Fitzsimmons E. Musten A. Jacobs B. Suri S. Korlipara D. Hodge V. Gough K. Ramgopal M. Bacon J. McReynolds J. Lober W. Crane HM. Patient perceptions of the utility and impact of a same-day self-administered routine electronic patient-reported outcomes (PRO) assessment in HIV care in two North American clinics. Virtual poster presentation, ISOQOL 27th Annual Conference, October 2020.
ISOQOL Patient Acceptability Poster
Short D, Kotsopoulos N, Crane H, Fredericksen R. Can Patient-Reported Measures and Outcomes (PROs) Improve Routine HIV Consultations? A Targeted Review of the Literature. Patient Reported Outcomes Measures Conference, Birmingham UK, June 2018.
Literature Review Poster
Fredericksen RJ, Skalicky A, Kleinman L, Collins E, Lober W, Crane HM, Short D. Lessons learned: key implementer perspectives on successful introduction and administration of electronic tablet-based patient-reported outcome (PRO) measures in routine HIV care. ISOQOL 26th Annual Conference, October 2018.
Lessons Learned Poster
Other Similar Articles
Jabour S, Chander G, Riekert K, Keruly J, Herne K, Hutton H, Beach M, Lau B, Moore R, Monroe A. The Patient Reported Outcomes as a Clinical Tool (PROACT) Pilot Study: What Can be Gained by Sharing Computerized Patient‐Reported Mental Health and Substance Use Symptoms with Providers in HIV Care? AIDS and Behavior (2021) 25:2963–2972. 2021 Jan 18. doi: 10.1007/s10461-021-03175-2.
View Manuscript* external link
References and Acknowledgements
This website was made possible by funding from ViiV Healthcare, a global specialist HIV company established in 2009, majority owned by GSK, with Pfizer and Shionogi as shareholders. We thank the patients, providers, and research staff from two PROgress Study clinics, Midway Specialty Care in Ft. Pierce, FL, and St. Michael’s Hospital in Toronto, ON, for their rich insights and commitment to this work. We thank the staff of the Ontario HIV Treatment Network and affiliated clinics for their continued collaborative partnership in advancing the role of PROs in HIV care. We also thank the Centers for AIDS Research Network of Integrated Clinical Systems (CNICS), and the University of Washington Clinical Informatics Research Group (CIRG), for provision of resources and expertise in development of this website. Finally, we thank the PROgress Study Steering Committee, comprised of an expert panel of patients living with HIV, HIV care providers, clinic directors, and health care researchers, for their oversight and guidance.
References
Crane HM, Crane PK, Tufano JT, et al. HIV Provider Documentation and Actions Following Patient Reports of At-risk Behaviors and Conditions When Identified by a Web-Based Point-of-Care Assessment. AIDS Behav. 2017;21(11):3111-3121.
Fredericksen RJ, Tufano J, Ralston J, et al. Provider perceptions of the value of same-day, electronic patient-reported measures for use in clinical HIV care. AIDS Care. 2016:1-6.
Wolfe F, Pincus T, Thompson AK, Doyle J. The assessment of rheumatoid arthritis and the acceptability of self-report questionnaires in clinical practice. Arthritis Rheum. 2003;49(1):59-63.
Stover A, Irwin DE, Chen RC, et al. Integrating Patient-Reported Outcome Measures into Routine Cancer Care: Cancer Patients' and Clinicians' Perceptions of Acceptability and Value. EGEMS (Wash DC). 2015;3(1):1169.
Detmar SB, Muller MJ, Schornagel JH, Wever LD, Aaronson NK. Health-related quality-of-life assessments and patient-physician communication: a randomized controlled trial. Jama. 2002;288(23):3027-3034.
Wagner AK, Ehrenberg BL, Tran TA, Bungay KM, Cynn DJ, Rogers WH. Patient-based health status measurement in clinical practice: a study of its impact on epilepsy patients' care. Qual Life Res. 1997;6(4):329-341.
Velikova G, Booth L, Smith AB, et al. Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol. 2004;22(4):714-724.
Taenzer P, Bultz BD, Carlson LE, et al. Impact of computerized quality of life screening on physician behaviour and patient satisfaction in lung cancer outpatients. Psychooncology. 2000;9(3):203-213.
Brown RF, Butow PN, Dunn SM, Tattersall MH. Promoting patient participation and shortening cancer consultations: a randomised trial. Br J Cancer. 2001;85(9):1273-1279.
Wasson JH, Stukel TA, Weiss JE, Hays RD, Jette AM, Nelson EC. A randomized trial of the use of patient self-assessment data to improve community practices. Eff Clin Pract. 1999;2(1):1-10.
Nelson EC, Eftimovska E, Lind C, Hager A, Wasson JH, Lindblad S. Patient reported outcome measures in practice. BMJ. 2015;350:g7818.
Chen J. OL, Hollis S. J. A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Services Research. 2013;13(211).
Dobscha SK, Gerrity MS, Ward MF. Effectiveness of an intervention to improve primary care provider recognition of depression. Eff Clin Pract. 2001;4(4):163-171.
Berry DL, Blumenstein BA, Halpenny B, et al. Enhancing patient-provider communication with the electronic self-report assessment for cancer: a randomized trial. J Clin Oncol. 2011;29(8):1029-1035.
Kjaer A, Rasmussen TA, Hjollund NH, Rodkjaer LO, Storgaard M. Patient-reported outcomes in daily clinical practise in HIV outpatient care. Int J Infect Dis. 2018;69:108-114.
Ruland CM, Holte HH, Roislien J, et al. Effects of a computer-supported interactive tailored patient assessment tool on patient care, symptom distress, and patients' need for symptom management support: a randomized clinical trial. J Am Med Inform Assoc. 2010;17(4):403-410.
Cleeland CS, Wang XS, Shi Q, et al. Automated symptom alerts reduce postoperative symptom severity after cancer surgery: a randomized controlled clinical trial. J Clin Oncol. 2011;29(8):994-1000.
Mark TL, Johnson G, Fortner B, Ryan K. The benefits and challenges of using computer-assisted symptom assessments in oncology clinics: results of a qualitative assessment. Technol Cancer Res Treat. 2008;7(5):401-406.
Mazonson PD, Mathias SD, Fifer SK, Buesching DP, Malek P, Patrick DL. The mental health patient profile: does it change primary care physicians' practice patterns? J Am Board Fam Pract. 1996;9(5):336-345.
Chen J, Ou L, Hollis SJ. A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC health services research. 2013;13:211.
Crane H TJ, Fredericksen R, Schmidt S, Brown T, Harrington R, Lober W, Kitahata M, Ralston J. Evaluating Integration of an HIV Medication Adherence Computer Assisted Self-Administered Interview (CASI) with Routine Patient Care. 5th International Conference on HIV Treatment Adherence; May 23-25, 2010, 2010; Miami, FL.
Basch E, Deal AM, Kris MG, et al. Symptom Monitoring With Patient-Reported Outcomes During Routine Cancer Treatment: A Randomized Controlled Trial. J Clin Oncol. 2016;34(6):557-565.
Basch E, Deal AM, Dueck AC, et al. Overall Survival Results of a Trial Assessing Patient-Reported Outcomes for Symptom Monitoring During Routine Cancer Treatment. JAMA. 2017;318(2):197-198.
Marshall S, Haywood K, Fitzpatrick R. Impact of patient-reported outcome measures on routine practice: a structured review. J Eval Clin Pract. 2006;12(5):559-568.
Berry DL, Hong F, Halpenny B, et al. Electronic self-report assessment for cancer and self-care support: results of a multicenter randomized trial. J Clin Oncol. 2014;32(3):199-205.
Fredericksen RJ, Short D, Fitzsimmons E, et al. Provider perceptions of utility and impact of a same-day routine electronic patient-reported outcomes (PRO) assessment in clinical HIV care 27th Annual Conference of International Society for Quality of Life Research (ISOQOL); October 19–23, 2020; Virtual conference.
Fredericksen RJ, Short D, Fitzsimmons E, et al. Patient perceptions of the utility and impact of a same-day self-administered routine electronic patient-reported outcomes (PRO) assessment in HIV care in two North American clinics. 27th Annual Conference of International Society for Quality of Life Research (ISOQOL); October 19–23, 2020; Virtual conference.
Fredericksen RJ, Fitzsimmons,E., McReynolds, J., Brown, S., Smith, L., Lober, W., Crane, H.M. . Patients' perceptions of value of a self-administered electronic patient-reported outcomes assessment on quality of their HIV care. International Society of Quality of Life 26th Annual Conference; San Diego, CA 2019.
Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. Jama. 1999;282(18):1737-1744.
Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606-613.
Spitzer RL, Kroenke K, Williams JB, Lowe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092-1097.
Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol Use Disorders Identification Test. Arch Intern Med. 1998;158(16):1789-1795.
Bradley KA, Bush KR, Epler AJ, et al. Two brief alcohol-screening tests From the Alcohol Use Disorders Identification Test (AUDIT): validation in a female Veterans Affairs patient population. Arch Intern Med. 2003;163(7):821-829.
Newcombe DA, Humeniuk RE, Ali R. Validation of the World Health Organization Alcohol, Smoking and Substance Involvement Screening Test (ASSIST): report of results from the Australian site. Drug Alcohol Rev. 2005;24(3):217-226.
WHO ASSIST Working Group. The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST): development, reliability and feasibility. Addiction. 2002;97(9):1183-1194.
Kiechl S, Werner P, Egger G, et al. Active and passive smoking, chronic infections, and the risk of carotid atherosclerosis: prospective results from the Bruneck Study. Stroke. 2002;33(9):2170-2176.
McLellan AT, Alterman AI, Cacciola J, Metzger D, O'Brien CP. A new measure of substance abuse treatment. Initial studies of the treatment services review. J Nerv Ment Dis. 1992;180(2):101-110.
Simoni JM, Kurth AE, Pearson CR, Pantalone DW, Merrill JO, Frick PA. Self-report measures of antiretroviral therapy adherence: A review with recommendations for HIV research and clinical management. AIDS Behav. 2006;10(3):227-245.
Chesney MA, Ickovics JR, Chambers DB, et al. Self-reported adherence to antiretroviral medications among participants in HIV clinical trials: the AACTG adherence instruments. Patient Care Committee & Adherence Working Group of the Outcomes Committee of the Adult AIDS Clinical Trials Group (AACTG). AIDS Care. 2000;12(3):255-266.
Lu M, Safren SA, Skolnik PR, et al. Optimal recall period and response task for self-reported HIV medication adherence. AIDS Behav. 2008;12(1):86-94.
Fredericksen RJ, Mayer KH, Gibbons LE, et al. Development and Content Validation of a Patient-Reported Sexual Risk Measure for Use in Primary Care. J Gen Intern Med. 2018.
Fredericksen RJ, Harding B, Nance RM, et al. Acceptability of electronic patient reported outcomes assessments (PROs) among patients in HIV care. International Society of Quality of Life 26th Annual Conference; 2019; San Diego, CA.
Laporte M, Keller HH, Payette H, et al. Validity and reliability of the new Canadian Nutrition Screening Tool in the 'real-world' hospital setting. Eur J Clin Nutr. 2015;69(5):558-564.
Fredericksen RJ, Fitzsimmons E, Gibbons LE, et al. Development and content validation of the Multifactoral assessment of perceived social support (MAPSS), a brief, patient-reported measure of social support for use in HIV care. AIDS Care. 2019:1-9.
Earnshaw VA, Smith LR, Chaudoir SR, Amico KR, Copenhaver MM. HIV stigma mechanisms and well-being among PLWH: a test of the HIV stigma framework. AIDS Behav. 2013;17(5):1785-1795.
EuroQol G. EuroQol--a new facility for the measurement of health-related quality of life. Health Policy. 1990;16(3):199-208.
Ainsworth BE, Jacobs DR, Jr., Leon AS. Validity and reliability of self-reported physical activity status: the Lipid Research Clinics questionnaire. Med Sci Sports Exerc. 1993;25(1):92-98.
Fitzsimmons E, Loo S, Dougherty S, et al. Development and Content Validation of the IPV-4, a Brief Patient-Reported Measure of Intimate Partner Violence for Use in HIV Care. International Society of Quality of Life Research Conference; October 21, 2019, 2019; San Diego, California.
World Health Organization. Adverse Childhood Experiences International Questionnaire. Adverse Childhood Experiences International Questionnaire (ACE-IQ) 2018; http://www.who.int/violence_injury_prevention/violence/activities/adverse_childhood_experiences/en/
