A Mixed Methods Evaluation of the Application of the REFLECT Framework to Psychological Services

Lomas, Christopher

Abstract

The REFLECT Psychological Services Audit Framework was developed to address critical gaps in the evaluation of mental health services, primarily within Employee Assistance Programmes (EAPs) and psychological services. This study aims to assess the framework’s impact on clinical outcomes, financial oversight, staff well-being, and risk management. A mixed-methods approach was employed, combining quantitative data—including paired t-tests, regression analysis, and Chi-square tests—with qualitative insights from semi-structured interviews and focus groups. Quantitative data were collected across 10 EAPs, evaluating 100 clients using the PHQ-9 and GAD-7 scales for depression and anxiety, respectively, and 50 staff members using the Maslach Burnout Inventory (MBI). Financial data included budget allocation efficiency and cost-effectiveness metrics. Risk management was assessed through safeguarding incidents and incident reporting time. Results revealed significant improvements across all key domains: client mental health outcomes (PHQ-9 and GAD-7 scores significantly reduced, p < 0.001), financial oversight (budget allocation efficiency improved by 13.2%, p < 0.001), and staff well-being (emotional exhaustion and depersonalisation decreased, personal accomplishment increased, p < 0.001). Safeguarding incidents also significantly declined (p < 0.001), while incident reporting times improved (p < 0.001). Qualitative findings highlighted enhanced clinician support, structured feedback systems, and improved operational transparency. These findings suggest that the REFLECT framework [1] offers a comprehensive, evidence-based tool for improving service quality, financial efficiency, and clinician support in psychological services.

Citation

Lomas, C. (2024). A Mixed Methods Evaluation of the Application of the REFLECT Framework to Psychological Services. Open Journal of Applied Sciences, 14(11), 3316-3346. https://doi.org/10.4236/ojapps.2024.1411219

• Journal Article Type: Article
• Acceptance Date: Oct 20, 2024
• Online Publication Date: Nov 22, 2024
• Publication Date: 2024
• Deposit Date: Dec 12, 2024
• Publicly Available Date: Dec 12, 2024
• Journal: Open Journal of Applied Sciences
• Print ISSN: 2165-3917
• Electronic ISSN: 2165-3925
• Publisher: Scientific Research Publishing
• Peer Reviewed: Peer Reviewed
• Volume: 14
• Issue: 11
• Pages: 3316-3346
• DOI: https://doi.org/10.4236/ojapps.2024.1411219