Changemakers implementation and process evaluation

Embedding evidence in children’s services

Changemakers implementation and process evaluation

Highlights

  • The Changemakers programme successfully introduced Local Evidence Leaders (LELs) across four diverse local authorities and was implemented largely as intended
  • LELs improved coordination, stakeholder engagement, partnership working and problem-solving, making implementation more feasible and acceptable
  • Flexibility and local adaptation are strengths of the Changemakers programme model
  • Dedicated implementation support helped local authorities introduce and deliver evidence-based interventions more effectively
  • Changemakers showed promise in strengthening evidence-informed decision-making and building local capability to use evidence
  • Long-term sustainability is likely to depend on embedding implementation skills, partnerships and evidence use across local systems rather than maintaining dedicated LEL posts.

Evaluation briefing – Changemakers: Embedding evidence in local children's services

This briefing provides senior local authority leaders and national policymakers with an insight into the findings and what these mean for using evidence in children’s services to secure lasting change for children and families.

Download

Full report – Changemakers implementation & process evaluation

Download

Summary

The implementation and process evaluation (IPE) examined the Changemakers programme, which introduced Local Evidence Leaders (LELs) in four diverse local authorities to support the implementation of evidence-based interventions (EBIs) and strengthen evidence-informed decision-making. The findings suggest that the programme was feasible to deliver and added value by providing dedicated implementation leadership, coordination, and support. LELs helped local areas overcome implementation challenges, build partnerships, engage stakeholders, and improve the use of evidence in decision-making. The strongest evidence relates to improvements in implementation processes and local capability to introduce and deliver EBIs. While there were promising signs of wider changes in evidence-informed practice, these were less consistent across the four local authorities. The evaluation found that local leadership, workforce capacity, organisational readiness, and partnership infrastructure all influenced programme success.

Aims

The evaluation examined:

  • How the LEL role was adopted, implemented and integrated within local systems
  • Barriers and facilitators affecting implementation
  • The perceived impact of the LEL role on implementation of EBIs
  • Evidence-informed decision-making and partnership working; how implementation and outcomes varied across different local contexts
  • The extent to which the programme’s theory of change was supported by the evidence
  • And the likely sustainability of the LEL role and wider programme impacts beyond the funded period.

The evaluation sought to generate actionable learning for Foundations, participating local areas and wider stakeholders seeking to strengthen implementation of evidence-based approaches.

Method

Evaluation partner Cordis Bright conducted a mixed-methods implementation and process evaluation (IPE) of Changemakers.

Researchers reviewed programme documents, delivery plans, monitoring information and cost data. Data collection included 12 workshops and 24 interviews with LELs, strategic leads, delivery staff, evidence-based intervention providers, and Foundations staff. Qualitative data was analysed thematically, while quantitative monitoring and financial data were analysed descriptively. Findings were triangulated across different data sources to strengthen conclusions. Equality, diversity, inclusion and equity (EDIE) considerations were incorporated throughout the evaluation.

Key Findings

The evaluation findings indicate that it is feasible and valuable to implement a programme like Changemakers in local authorities. The programme addressed a common need within local systems for dedicated capacity to support implementation of EBIs, navigate implementation challenges, and bridge the gap between evidence, strategic decision-making, and operational delivery.

The findings also provide broad support for the Changemakers model and theory of change, indicating that dedicated evidence into practice leadership can strengthen the implementation of EBIs and contribute to catalysing improved conditions for wider evidence-informed decision-making and practice within local systems.

Across all four local areas, the programme was implemented largely as intended and stakeholders consistently identified the LEL role as the central mechanism through which implementation support, stakeholder engagement, relationship-building, and evidence translation occurred. Alongside this, external implementation support from Foundations’ PDAs and EBI providers emerged as important to success. Local contextual factors like leadership support, workforce capacity, organisational readiness, partnership infrastructure, and EBI fit all shaped how the programme was implemented and the extent to which wider ambitions relating to evidence use and systems change were realised.

The strongest evidence relates to the programme’s contribution to implementation processes and local implementation capability for the selected EBIs included in the programme. Stakeholders consistently perceived the LEL role as improving the acceptability, feasibility, and quality of EBI implementation by providing dedicated implementation leadership, coordination, and problem-solving capacity. The programme appears to have strengthened local stakeholders’ ability to critically assess, adapt, and implement the EBIs, and supported more reflective and evidence-informed approaches to implementation and decision-making.
There was also emerging evidence that the programme showed promise in strengthening the conditions needed for improved evidence use beyond the EBIs included in the Changemakers programme, such as improved infrastructure, understanding, and confidence for evidence-based decision-making. Some local areas demonstrated promising examples of broader evidence-informed activity beyond the selected EBIs, though this was not consistently evident across the programme and tended to be most apparent among operational stakeholders closely involved in Changemakers. However, in supporting these shifts Changemakers has strengthened the foundations for future evidence-informed decision-making and practice among stakeholders involved with the programme.

Implications for Policy

  • Recognise implementation capability as a critical component of evidence use and distinct investment need – The findings suggest that implementation support should not be viewed as an optional add-on to EBIs. Dedicated implementation leadership, coordination, and support are likely to increase the likelihood that investments in EBIs achieve their intended outcomes. Future funding and policy should therefore recognise implementation capability as a core requirement alongside EBI delivery
  • Design programmes to support successful implementation – Implementation frequently took longer than anticipated due to workforce pressures, stakeholder engagement requirements, and challenges relating to local fit. Future funded programmes should allow sufficient time for implementation activity alongside EBI delivery and consider local readiness during programme selection and mobilisation. Recognising differences in local context and implementation capacity may help tailor support and improve the likelihood of successful implementation
  • Embed sustainability from the outset – Future programmes should place greater emphasis on sustainability planning, capability transfer and embedding implementation knowledge within local systems from the beginning of delivery. Consideration should also be given to how implementation leadership and evidence-use capability can be sustained beyond the lifetime of individual programmes
  • Continued investment in implementation and intervention effectiveness is vital for EBI success – Evidence about implementation processes, adaptation, local fit, and intervention effectiveness is essential to improving future implementation of evidence-based approaches. Funders and policymakers should continue to support programmes that generate learning about implementation alongside impact
  • Address inequalities through intervention selection and adaptation – Improving reach among underserved populations requires attention not only to implementation approaches but also to whether EBI themselves are appropriate, accessible, and acceptable for the populations they are intended to serve. Policymakers should work with intervention
Linked Project

You can view the project linked to this publication here: 

Implementation & process evaluation of the Changemakers programme
SHARE

Related Publications

See all publications
  • Report

Supporting parenting

Parenting and whole-family interventions for families with multiple & complex needs with children & young people 11 to 19

Learn More
  • Report

Supporting parenting

Partnership for Change

Learn More

Cost ratings:

Rated 1: Set up and delivery is low cost, equivalent to an estimated unit cost of less than £100.

Rated 2: Set up and delivery is medium-low cost, equivalent to an estimated unit cost of £100–£499.

Rated 3: Set up and delivery is medium cost, equivalent to an estimated unit cost of £500–£999.

Rated 4: Set up and delivery is medium-high cost, equivalent to an estimated unit cost of £1,000–£2,000.

Rating 5: Set up and delivery is high cost. Equivalent to an estimated unit cost of more than £2,000.

Set up and delivery cost is not applicable, not available, or has not been calculated.

Click here for more information.

Child Outcomes:

Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient montes, nascetur ridiculus mus.

Supporting children’s mental health and wellbeing: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing child maltreatment: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Enhancing school achievement & employment: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing crime, violence and antisocial behaviour: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing substance abuse: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing risky sexual behaviour & teen pregnancy: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing obesity and promoting healthy physical development: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Evidence ratings:

Rated 2: Has preliminary evidence of improving a child outcome from a quantitative impact study, but there is not yet evidence of causal impact.

Rated 2+: Meets the level 2 rating and the best available evidence is based on a study which is more rigorous than a level 2 standard but does not meet the level 3 standard.

Rated 3: Has evidence of a short-term positive impact from at least one rigorous study.

Rated 3+: Meets the level 3 rating and has evidence from other studies with a comparison group at level 2 or higher.

Rated 4: Has evidence of a long-term positive impact through at least two rigorous studies.

Rated 4+: Meets the level 4 rating and has at least a third study contributing to the Level 4 rating, with at least one of the studies conducted independently of the intervention provider.

Rating has a *: The evidence base includes mixed findings i.e., studies suggesting positive impact alongside studies, which on balance, indicate no effect or negative impact.

Click here for more information. 

Powered by  GDPR Cookie Compliance (opens in a new tab)
Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.