Signs of Safety

Findings from a mixed-methods systematic review focused on reducing the need for children to be in care
Legacy Content

This project or publication was produced before or during the merger of What Works for Children’s Social Care (WWCSC) and the Early Intervention Foundation (EIF).

Signs of Safety

Highlights

This review finds a lack of evidence that Signs of Safety works to safely reduce care entry or the number of children in care. This raises important questions for policy makers and practitioners.

Report

Download

Summary

Signs of Safety (SoS) has been extensively rolled out across the UK and elsewhere without a comprehensive evidence base about whether it works, whether it is cost effective, and how to implement it.

This review finds a lack of evidence that Signs of Safety works to safely reduce care entry or the number of children in care.

Robust evaluations based on a clearly specified intervention theory are needed to adequately assess whether SoS can achieve its outcomes when delivered well.

Aims

To consider whether, how, for whom and under what conditions Signs of Safety works to safely reduce the number of children entering and re-entering care, and/or to increase the number of children re-unified with their family.

Method

A mixed-methods approach has been used, including a quantitative assessment (using traditional systematic review methods) of whether Signs of Safety works to reduce the number of children in care combined with an exploration of the mechanisms associated with effective delivery, and the contexts under which those mechanisms may operate (a realist synthesis). The review also uses the EMMIE framework, which considers Effect; Mechanisms; Moderators; Implementation; and Economics.

Key Findings

There is little to no evidence to suggest that Signs of Safety is effective at reducing the need for children to be in care. This reflects a limited evidence base, with few studies and none of a high quality for drawing conclusions about the impact of Signs of Safety on this outcome. Lack of evidence is not the same as evidence that Signs of Safety does not work to reduce care. Nor does it establish that Signs of Safety does not have other possible positive outcomes.

Evidence suggests that Signs of Safety can lead to positive engagement with parents, children, wider family and external agencies. The most commonly assumed mechanism through which Signs of Safety improves child safety is the development of shared understanding of and responsibility for minimising risk to children, primarily through the development and use of safety plans and safety networks. A programme theory drawn from the literature outlines the mechanisms that enable and follow from this main mechanism to improve child safety.

Key moderators of the development of a shared understanding of and responsibility for improving child safety relate to the contexts that enable relationship building and collaboration between children, parents, and social worker. A key moderator emerging from the review is that parents need to trust and collaborate with social workers if they are to develop a sense of shared responsibility for minimising risks to children.

Signs of Safety recognises the importance of whole organisation change to create a culture that supports social workers to practice with families. The review identifies key barriers and enablers of implementation. There is huge variation in how Signs of Safety is implemented and limited specification of how it is possible to be sure high quality Signs of Safety is being delivered. In part as a result of this, it is not possible to identify from the research evidenced examples of successful and sustainable implementation.

The review found no evidence of sufficient quality to analyse for cost effectiveness.

The evidence base for Signs of Safety urgently needs developing. The approach is currently widely used with little evidence of positive impact.

A clear and practicable specification of what high quality Signs of Safety looks like in practice is a first priority. Without it, implementation and evaluation are difficult.

Evaluations of the impact of high quality Signs of Safety compared to normal service or other models would then be possible – and given the substantial public money being spent on the approach such evaluations are a priority.

Once evidence for the impact of high quality Signs of Safety is established, research evaluating the implementation of the approach is crucial. Currently there is little evidence about the contribution of different elements that purport to be necessary to deliver Signs of Safety well.

Lack of evidence does not mean Signs of Safety does not work – but it does suggest that practitioners and service leaders need to think carefully about what they understand the model to involve, how they would know it was being delivered well and whether it is delivering the outcomes they seek to achieve.

In this respect, our programme theory is intended to make a constructive contribution by describing in some detail what is thought to be necessary to allow Signs of Safety to be effective in working with families. Our Practice Guide and Implementation Briefing are intended to share the programme theory in ways that can support those seeking to practice, lead or evaluate services based on the principles of Signs of Safety.

SHARE

Related Publications

Cost ratings:

Rated 1: Set up and delivery is low cost, equivalent to an estimated unit cost of less than £100.

Rated 2: Set up and delivery is medium-low cost, equivalent to an estimated unit cost of £100–£499.

Rated 3: Set up and delivery is medium cost, equivalent to an estimated unit cost of £500–£999.

Rated 4: Set up and delivery is medium-high cost, equivalent to an estimated unit cost of £1,000–£2,000.

Rating 5: Set up and delivery is high cost. Equivalent to an estimated unit cost of more than £2,000.

Set up and delivery cost is not applicable, not available, or has not been calculated.

Click here for more information.

Child Outcomes:

Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient montes, nascetur ridiculus mus.

Supporting children’s mental health and wellbeing: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing child maltreatment: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Enhancing school achievement & employment: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing crime, violence and antisocial behaviour: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing substance abuse: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing risky sexual behaviour & teen pregnancy: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Preventing obesity and promoting healthy physical development: Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient.

Evidence ratings:

Rated 2: Has preliminary evidence of improving a child outcome from a quantitative impact study, but there is not yet evidence of causal impact.

Rated 2+: Meets the level 2 rating and the best available evidence is based on a study which is more rigorous than a level 2 standard but does not meet the level 3 standard.

Rated 3: Has evidence of a short-term positive impact from at least one rigorous study.

Rated 3+: Meets the level 3 rating and has evidence from other studies with a comparison group at level 2 or higher.

Rated 4: Has evidence of a long-term positive impact through at least two rigorous studies.

Rated 4+: Meets the level 4 rating and has at least a third study contributing to the Level 4 rating, with at least one of the studies conducted independently of the intervention provider.

Rating has a *: The evidence base includes mixed findings i.e., studies suggesting positive impact alongside studies, which on balance, indicate no effect or negative impact.

Click here for more information.