Signs of Safety evaluation

An analysis of data from nine local authorities
Legacy Content

This project or publication was produced before or during the merger of What Works for Children’s Social Care (WWCSC) and the Early Intervention Foundation (EIF).

Signs of Safety evaluation

Highlights

This is an analysis of the impact of Signs of Safety on outcomes for children and families in 9 local authorities that implemented Signs of Safety as part of the Department for Education’s Innovation Programme. 

This analysis found no strong evidence that Signs of Safety (an approach to child protection work focusing on the strengths of the family) significantly impacted outcomes for children and families.  

Report

Download

Summary

Signs of Safety is an approach to child protection work focusing on the strengths of the family.

The aim of this project was to find out whether Signs of Safety improves outcomes for children.

We used routinely collected data on nine local authorities piloting Signs of Safety as part of the Department for Education’s English Innovation Programme. We compared the outcomes of children in local authorities who use Signs of Safety with children in similar local authorities who do not.

Aims

We had four main research questions:

  1. What, if any, is the impact of Signs of Safety on the duration of assessments?
  2. What, if any, is the impact of Signs of Safety on the likelihood of a case being re-referred if it has previously been assessed as ‘no further action’ (NFA)?
  3. What, if any, is the impact of Signs of Safety on the likelihood of a re-referral leading to a child protection plan (CPP) or to a child becoming looked after (LAC)?
  4. What, if any, is the impact of Signs of Safety on the likelihood of a child receiving kinship care instead of non-kinship care?

Method

We conducted a difference-in-differences analysis. This involves comparing outcomes for children in local authorities where Signs of Safety was introduced with outcomes for children in similar local authorities that did not introduce Signs of Safety.

To conduct the analysis, we accessed individual-level data on children’s social care outcomes for individuals in pilot and comparator local authorities held by the Department for Education.

We conducted an analysis to determine the impact of Signs of Safety on the four outcomes of interest.

We then conducted secondary analyses to evaluate the extent to which the impact of Signs of Safety is more pronounced within certain subgroups.

Key Findings

We were surprised that looked after children in local authorities using Signs of Safety were less likely to be placed in kinship care placements (compared with non-kinship care).

We found no moderate or high strength evidence of positive effects on the other outcomes.

For local authorities already using SoS, this research offers no reason to stop using it (although we would counsel monitoring kinship care closely).

For local authorities who are considering using Signs of Safety to improve outcomes and / or reduce costs, this research does not offer evidence to support the use of Signs of Safety to further these goals.

For local authorities who are considering using Signs of Safety as a values framework for their practice, this evidence is not the right type of evidence to support or oppose the use of Signs of Safety in this way.

SHARE

Related Publications

Cost ratings:

Rated 1: Set up and delivery is low cost, equivalent to an estimated unit cost of less than £100.

Rated 2: Set up and delivery is medium-low cost, equivalent to an estimated unit cost of £100–£499.

Rated 3: Set up and delivery is medium cost, equivalent to an estimated unit cost of £500–£999.

Rated 4: Set up and delivery is medium-high cost, equivalent to an estimated unit cost of £1,000–£2,000.

Rating 5: Set up and delivery is high cost. Equivalent to an estimated unit cost of more than £2,000.

Set up and delivery cost is not applicable, not available, or has not been calculated.

Click here for more information.

Child Outcomes:

Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient montes, nascetur ridiculus mus.

Supporting children’s mental health and wellbeing: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing child maltreatment: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Enhancing school achievement & employment: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing crime, violence and antisocial behaviour: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing substance abuse: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing risky sexual behaviour & teen pregnancy: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing obesity and promoting healthy physical development: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Evidence ratings:

Rated 2: Has preliminary evidence of improving a child outcome from a quantitative impact study, but there is not yet evidence of causal impact.

Rated 2+: Meets the level 2 rating and the best available evidence is based on a study which is more rigorous than a level 2 standard but does not meet the level 3 standard.

Rated 3: Has evidence of a short-term positive impact from at least one rigorous study.

Rated 3+: Meets the level 3 rating and has evidence from other studies with a comparison group at level 2 or higher.

Rated 4: Has evidence of a long-term positive impact through at least two rigorous studies.

Rated 4+: Meets the level 4 rating and has at least a third study contributing to the Level 4 rating, with at least one of the studies conducted independently of the intervention provider.

Rating has a *: The evidence base includes mixed findings i.e., studies suggesting positive impact alongside studies, which on balance, indicate no effect or negative impact.

Click here for more information.