Evaluating the effectiveness of clinical practice benchmarking in improving the quality of care

Abstract

Clinical practice benchmarking is a new quality improvement benchmarking approach that involves structured learning from others in order to improve, accepting the subjective nature of health care. Evaluative research of clinical practice benchmarking requires mixed methods, quantitative and qualitative. This challenges the current reliance upon quantitative consideration of the effectiveness of quality improvement approaches. A worked quantitative example is provided and demonstrates that descriptive statistics support comparison activity only. It rejects the value of inferential statistics, since benchmark scores relate to subjective statements.
Therefore, inter-rater reliability is poor and it is not possible to directly attribute any change in clinical practice benchmark scores to actual changes in practice. Following the quantitative analysis, a qualitative research study was undertaken from
an interpretative perspective to evaluate the effectiveness of clinical practice benchmarking as a quality improvement approach. Particular emphasis was given to exploring the organisational factors that support its effectiveness. Data were gathered through semi-standardised interviews of nursing leaders of local paediatric benchmarking activity and frontline nurses, with rigour ensured through reflexivity and a critical approach to the analysis.
The main empirical contribution of this work provided new knowledge about nurses' understanding of clinical practice benchmarking. They defined it as using all evidence to agree best practice, focusing upon collaboration to support sharing, rather than competition. The findings identified the organisational factors that ensured the effectiveness of clinical practice benchmarking. The main enablers were motivation of those involved and supportive leadership, underpinned by an organisation that promotes learning and innovation.
This research provides compelling evidence that clinical practice benchmarking is an effective approach to quality improvement in health care. However, it requires acceptance of the importance of the subjective nature of health care and the necessity for qualitative approaches to evaluation. Methodological insights from this study also inform future evaluative research.