Fidelity in complex behaviour change interventions: a standardised approach to evaluate intervention integrity
نویسندگان
چکیده
OBJECTIVES The aim of this study was to (1) demonstrate the development and testing of tools and procedures designed to monitor and assess the integrity of a complex intervention for chronic pain (COping with persistent Pain, Effectiveness Research into Self-management (COPERS) course); and (2) make recommendations based on our experiences. DESIGN Fidelity assessment of a two-arm randomised controlled trial intervention, assessing the adherence and competence of the facilitators delivering the intervention. SETTING The intervention was delivered in the community in two centres in the UK: one inner city and one a mix of rural and urban locations. PARTICIPANTS 403 people with chronic musculoskeletal pain were enrolled in the intervention arm and 300 attended the self-management course. Thirty lay and healthcare professionals were trained and 24 delivered the courses (2 per course). We ran 31 courses for up to 16 people per course and all were audio recorded. INTERVENTIONS The course was run over three and a half days; facilitators delivered a semistructured manualised course. OUTCOMES We designed three measures to evaluate fidelity assessing adherence to the manual, competence and overall impression. RESULTS We evaluated a random sample of four components from each course (n=122). The evaluation forms were reliable and had good face validity. There were high levels of adherence in the delivery: overall adherence was two (maximum 2, IQR 1.67-2.00), facilitator competence exhibited more variability, and overall competence was 1.5 (maximum 2, IQR 1.25-2.00). Overall impression was three (maximum 4, IQR 2.00-3.00). CONCLUSIONS Monitoring and assessing adherence and competence at the point of intervention delivery can be realised most efficiently by embedding the principles of fidelity measurement within the design stage of complex interventions and the training and assessment of those delivering the intervention. More work is necessary to ensure that more robust systems of fidelity evaluation accompany the growth of complex interventions. TRIAL REGISTRATION ISRCTN NO ISRCTN24426731.
منابع مشابه
Measures of fidelity of delivery of, and engagement with, complex, face‐to‐face health behaviour change interventions: A systematic review of measure quality
PURPOSE Understanding the effectiveness of complex, face-to-face health behaviour change interventions requires high-quality measures to assess fidelity of delivery and engagement. This systematic review aimed to (1) identify the types of measures used to monitor fidelity of delivery of, and engagement with, complex, face-to-face health behaviour change interventions and (2) describe the report...
متن کاملMany Moving Parts: Evaluating the Implementation of the Kin KeeperSM Cancer Prevention Intervention
Introduction: This paper details an evaluation of the implementation and feasibility of a multilevel project entitled Kin KeeperSM Cancer Prevention Intervention that utilizes community health workers (CHWs) to deliver breast and cervical cancer education. The evaluation includes intervention fidelity, participant satisfaction, participant retention, and the cost of program implementa...
متن کاملUsing mixed methods to assess fidelity of delivery and its influencing factors in a complex self-management intervention for people with osteoarthritis and low back pain
OBJECTIVES AND DESIGN Despite an increasing awareness of the importance of fidelity of delivery within complex behaviour change interventions, it is often poorly assessed. This mixed methods study aimed to establish the fidelity of delivery of a complex self-management intervention and explore the reasons for these findings using a convergent/triangulation design. SETTING Feasibility trial of...
متن کاملAssessment of fidelity in individual level behaviour change interventions promoting physical activity among adults: a systematic review
BACKGROUND Behaviour change interventions that promote physical activity have major implications for health and well-being. Measuring intervention fidelity is crucial in determining the extent to which an intervention is delivered as intended, therefore increasing scientific confidence about effectiveness. However, we lack a clear overview of how well intervention fidelity is typically assessed...
متن کاملA multidimensional approach to assessing intervention fidelity in a process evaluation of audit and feedback interventions to reduce unnecessary blood transfusions: a study protocol
BACKGROUND In England, NHS Blood and Transplant conducts national audits of transfusion and provides feedback to hospitals to promote evidence-based practice. Audits demonstrate 20% of transfusions fall outside guidelines. The AFFINITIE programme (Development & Evaluation of Audit and Feedback INterventions to Increase evidence-based Transfusion practIcE) involves two linked, 2×2 factorial, clu...
متن کامل