Abstract for presentation at National Medicines Symposium 2006

Purpose: At establishment, program evaluation was recognised as a critical component to support both the strategic direction and accountability of the National Prescribing Service (NPS). The purpose of this presentation is to describe the framework and outcomes of this evaluation.
Methods: The approach taken to measuring the impact of the NPS Program on beliefs and behaviours about medicines is broad ranging and comprehensive. Measures include: the process, scope and reach of activities; perceptions about the usefulness and trustworthiness of information; changes in awareness, skills and behaviour; and changes in health and economic outcomes. Effect of the NPS Program is measured from the perspective of a range of internal and external audiences. A variety of existing and purpose-designed datasets are used.
Results: Evaluation of the NPS Program to date show impressive achievements: high awareness of the organisation (GPs 98%, pharmacists 99%); widespread and increasing uptake of educational activities and resources across a broad range of therapeutic topics (10,000 GPs participating in voluntary educational activities in 2004/05 compared to 2,500 in 1998/99); high level of respect and trust in NPS as a reliable and independent source of medicines information (84% and 97% of GPs and pharmacists respectively rating NPS to be of either great or moderate value); changes in consumer and health professional knowledge, attitudes and behaviour consistent with program key messages (including changes in antibiotic use, NSAIDs and low-dose thiazides); and estimated PBS savings of >$235 million over the seven years of operation.
Conclusions: Measuring and reporting the impact of the NPS Program in terms of changes in beliefs and behaviours about medicines is essential for sustainability. Continued refinement of existing evaluation methods and further exploration of new techniques remains a priority.