Accredited official statistics

Fostering in England: Methodology and quality report

Updated 26 January 2021

Applies to England

Introduction

This document contains methodology and quality information relevant to the Office for Standards in Education, Children’s Services and Skills (Ofsted) annual release of fostering data, covering all fostering provision in England.

You should read this methodology and quality report in conjunction with the background notes contained within the statistical first release (SFR), because those notes include helpful information that is not in this report.

The SFR contains data sourced from local authorities (LAs) and independent fostering agencies (IFAs). The release includes data about fostering providers, foster carers, and children in foster placements.

The data includes:

• LA fostering agencies, including IFAs performing the function of LA fostering agencies
• IFAs

This release of fostering in England data covers the period between 1 April 2018 and 31 March 2019.

The statistical release is published as a full version annually and contains final data. We publish a number of official statistics covering children’s social care, including fostering, adoption and children looked after placements.

We welcome feedback about our statistical releases. If you have any comments, questions or suggestions, please contact the Social Care Data & Analysis Team on: [email protected].

Relevance

Ofsted regulates and inspects to achieve excellence in the care of children and young people, and in education and skills for learners of all ages. We release our official statistics to promote reform and improvement across government through increasing transparency and citizen participation.

Ofsted regulates and inspects IFAs under the Care Standards Act 2000. The Care Standards Act 2000, including regulations made under section 22, sets out the legal basis for regulating fostering agencies. More information is available on how Ofsted regulates and inspects IFAs.

Ofsted inspects LA children’s services functions, including fostering, under section 136 (2) of the Education and Inspections Act 2006.

Uses for the fostering data

Primarily, the data is collected from providers to support inspections of IFAs and LA fostering services. The data is analysed at an agency level, and using comparator data, to prompt lines of enquiry that will be followed at inspection. The data is also used to evaluate the effectiveness of fostering agencies, including ongoing monitoring of performance and improvement work.

Ofsted analyses the data to further enhance insight into the sector. This can then be used by others for planning and providing public services, for example, through being informed about the capacity of social care provisions nationally and by area. We also use the analysis of the data to inform our policy discussions and decisions, for instance by contributing to the reviews of inspection frameworks, evidence and reports. We also use the data to respond to ad-hoc requests and to give context to emerging issues or the impact of changes in the sector.

Communicating with users

The data is published annually as official statistics. The aggregation of data for official statistics allows us to communicate to users the key data and messages, for example, at different geographical levels and by provider type. The official statistics draw out the key messages and communicate these in an understandable way, appropriate for a wide range of different users. Users are able to interpret and manipulate the data published for their own purposes, because the release includes underlying data.

The data may, therefore, be used by stakeholder groups, academics and other interested parties across the sector. Fostering agencies may also use the data themselves, for local and regional use, to inform on areas of practice and to improve processes and standards.

Data sources

Some of the data about fostering in England is unique to Ofsted; alternative sources are not available. For instance, data about the capacity of fostering services and recruitment activity in England, as well as some other indicators, is only collected by Ofsted. This data is widely viewed as a valuable source for information about recruitment and capacity, for identifying vacancies and for providing an in-depth overall picture of fostering in England.

Some data is also published by other sources, such as the Department for Education (DfE). For example, ‘Children Looked After in England’ includes data about fostered children, who make up the majority of children in care.

Response rates

We received data returns from all LA fostering agencies and 99% of IFAs eligible to return data. Less than 1% of all returns contained data inaccuracies that could not be resolved. This data has been included in the national, LA and IFA data and in this report, with an acknowledgement where necessary.

Of the 293 eligible IFAs (excluding trusts), we received data from 291 (99%) which included 1 return with irreconcilable discrepancies. There were 4 agencies not eligible to submit data because they subsequently resigned and 5 submitted data which has been re-categorised as LA data because they were operated by IFA trusts.

The Isles of Scilly and the City of London provided nil returns, because their fostering services are provided by Cornwall and the Pan-London arrangement respectively, rather than in house. Hammersmith and Fulham, Kensington and Chelsea, and Westminster’s fostering services submitted a single combined return.

Meeting users’ needs

The content of the survey and accompanying guidance are reviewed annually by the Social Care Data and Analysis and Social Care Policy teams, to develop the collection. Senior managers then sign off any changes that are required. This review process ensures that the survey will meet the data requirements for inspections and takes into account any policy changes or emerging issues.

Online data collection

The new portal system was introduced for the 2017 to 2018 collection, following on from a formal consultation in September 2017 about modernising the collection. Feedback was subsequently sought from users, and updates have been made to the system where necessary to suit user needs. The introduction of the online system has enabled the quicker release of this year’s publication.

Helping and meeting with our users

Ofsted’s Social Care Data and Analysis Team is represented at regional meetings of performance leads from LAs. These regional meetings are organised by the Association of Directors of Children’s Services (ADCS). We have presented relevant information and publications to all of the existing regional groups, and sought feedback about whether our publications meet user needs. Our participation in these groups helps inform us about users’ views on our social care official statistics. We take on board suggested improvements. We have also attended additional workshops to help data suppliers and stakeholders to understand the data that is being asked for and how it can be used. An online webinar is available to familiarise data suppliers with the online portal collection system. Ofsted inspectors attend annual conferences, which include sessions on the data that is collected and how this can inform inspection preparation.

Social care outputs are also shared with users in other organisations, such as the DfE, LAs, and representatives from the private and voluntary sectors at Ofsted-led stakeholder meetings. These organisations use the data for a range of purposes including informing their own social care outputs (DfE) and benchmarking performance (LAs).

The accompanying guidance includes a glossary of terms, to help clarify what is being requested, and descriptions of all codes used for data entry. The online portal allows agencies to quality assure (QA), validate and sign off their data to help make sure data is accurate and complete. We published additional troubleshooting guidance to assist users with the process of submitting data though the online portal. The Social Care Data and Analysis team also offers help and guidance to agencies via email and telephone.

More information

The contact details for the Social Care Data and Analysis team are included in the releases. Users are encouraged to feedback about any unmet needs or suggested improvements and ask questions that are not covered in the glossary definitions and supporting guidance.

See more information about Ofsted’s engagement policy and confidentiality & access policy, as well as Ofsted’s statement of administrative sources. We also operate under more detailed internal engagement guidance.

Coherence and comparability

Ofsted has reported on fostering data in England since 1 April 2008. Over time, the data collection has been developed and improved. As the survey is reviewed and questions are amended or added, some areas are not comparable over time.

Reasons for these changes include:

• changes in legislation or policy; for example, a question about Staying Put was added when this arrangement was introduced
• in response to data supplier feedback; for example, when the DfE SSDA903 collection and Ofsted duplicated some of the same data and this was an additional burden on data suppliers, this has been reduced
• to provide more nuance in the resulting analysis; for example, placement offer data is now collected at household rather than agency level

If it is not directly possible to compare data over time, notes are given in the release to alert users.

The response rates have varied over the course of the survey. However, they have been consistently high at around 98 to 99% since 2012 to 2013. We reviewed the impact of the changing response rates, specifically around the impact of any missing data. We considered the potential for grossing up or using imputation when agencies did not return data, and found minimal impact from any missing data. Therefore, it was not deemed necessary to use any estimation or imputation. Data comparisons are made generally for the last 5 years where applicable.

Comparable data

Where appropriate, we reference comparable data collected by the DfE or the Office for National Statistics (ONS).

For example:

• we reference the DfE’s annual collection on ‘Children Looked After in England’ and the ONS’s publication of data from the 2011 census.
• we compare the numbers of children in foster care placed through IFAs or LAs, and those Staying Put in 2018 to 2019, against the DfE’s annual report on children in care and the ONS census statistics. At the time of this release, the DfE’s publication for 2018 to 2019 on Children Looked After in England had not yet been published. This release will be published in December 2019. Therefore, throughout this release, when making comparisons to the DfE data, we have used data from the 2017 to 2018 publication.

Data is presented at England level and then sub-divided by sector: LA or IFA. Although there is a small amount of comparable data collected for other countries in the UK, this is minimal and so has not been included, for example, the number of approved LA foster carers and places in Wales and data on children looked after in Scotland in 2014 to 2015. Comparable data for other countries, including via the Eurostat database, is not available.

The underlying data that accompanies the fostering in England release has been streamlined and improved, to increase value to users. As a result of improved data quality in recent years, we have now been able to publish underlying data to include more detail of fostering types, such as:

• fostering to adopt
• emergency foster care

In previous releases, fostering households were reported against aggregated categories:

• mainstream
• family and friends
• short breaks only

As a result of the decision to improve the reporting of the fostering households cohorts, there has been a slight recalculation of historical data to provide further details, where available.

Comparisons may be adversely affected by different reporting practices across data suppliers. For example, one agency may only record the ethnicity of the primary carer in a household, while most record the ethnicity of both carers where applicable.

The annual collection gives data at consistent intervals. It includes snapshot data as at the 31 March and periodical data for 12 months between 1 April and 31 March. The reporting period used is made clear in the release. An exception to the defined reporting periods may occur in certain circumstances, for example, if a new piece of legislation came into effect mid-way through the financial year.

Accuracy and reliability

All LAs and IFAs are asked to complete this return on a voluntary basis. There was a 100% response rate from LAs and 99% among IFAs in 2018 to 2019. The 2 IFAs that did not submit data had a negligible impact on the overall figures, therefore, this release does not currently use any imputation or other statistical techniques, and data is not used to make any estimates about the population or other geographical areas.

We carry out this survey across all LA fostering agencies and IFAs in England, and so there is no risk of potential bias through sample selection. This data is sourced from the agencies’ administrative systems and therefore the data returned by each agency reflects all fostered children and fostering households as at 31 March 2019. We recognise, however, that the data was collected from 438 agencies and that detailed information on their internal QA processes is not available. In total, 1 agency (less than 1%) returned data with discrepancies that could not be resolved with the agency before the deadline for publication. This was in line with last year.

Quality assurance process

The data is subject to a rigorous QA process, by both data suppliers and Ofsted. The online portal system has in-built validation functions that assist data suppliers with checking and amending the data. We also engage with data suppliers in conversation via email and telephone to clarify any queries or errors in the data and resolve these to the most accurate data the agency can supply. For some agencies with a larger number of issues, or that are new to completing the return, these conversations can be detailed and lengthy.

There are 2 tiers of validation carried out by the online portal system:

• at the point of upload the portal checks that all fields contain valid data
• using the validation tool, the portal checks that data is complete and accurate

QA checks during upload:

Invalid data: data that does not match the specified code set and format may be omitted from the upload or prevent the file uploading. For example, 31/02/2019 is an invalid date and WRBI is an invalid code

Invalid ID numbers: if any ID numbers have been duplicated within the data, this would prevent the file from uploading

QA carried out by the validation tool

Inconsistent data: validation rules compare data submitted across multiple fields to check that the data is consistent.

For instance, in recruitment data we would expect all ‘end dates’ to be after ‘start dates’. Another example is that we expect the number of filled places submitted in household data to match the number of children recorded for each household.

Incomplete data: based on the users’ response, additional fields may be expected to be completed

For instance, if there are 2 foster carers within a household, we expect ethnicity and training data for both carers.

After the QA process

Once the portal has carried out the QA checks, specific guidance is given to direct users to the field(s) containing errors. Guidance is available in 3 formats to allow maximum flexibility for users to check and amend their data. For instance, some users may prefer to download a validation report and then make changes to their original upload template, whereas other users may prefer to use the webform view where individual records can be edited straight into the portal.

The data is submitted online and stored securely in Amazon’s EEA data centre that meets all GDS data requirements. Data exported from the online portal is stored in system folders that are only accessible to members of the Ofsted Social Care Data and Analysis team. As data is now collected at person-level, agencies are asked to provide identifiers only and not names.

The deadline for all agencies to submit a validated return was 30 June 2019. Due to delays with the DfE SSDA903 data collection, some individual extensions were granted to a quarter of LAs.

QA checks are also carried out on the combined dataset, the analysis and the key findings, along with any supplementary statistics that are going to be published.

Where applicable, data is considered against the DfE data on Children Looked After as a ‘sense check’. However, the time periods in the 2 returns do not always match up, and so there is limited utility to this.

Strengths of the data

High response rates with all data provided: response rates for the last 5 years have been 99%-100%.

Robust QA of the data: We carry out detailed QA of all returns, which means we have a high level of confidence in the data presented. The QA tools, processes and outcomes are described in the introduction to the main report and elsewhere in this quality report.

Data benchmarking

When applicable, data returned to us is benchmarked against data submitted to the DfE, and generally found to be in line with DfE data. When there are differences, this is likely due to additional QA work done with individual agencies, particularly IFAs, to ensure quality of data. The DfE collects data from LAs only, this level of QA work is not always possible for it.

Comprehensive picture of fostering: Due to high response rates, and the volume of data collected, as well as the mix of in-year and end-of-year figures, the data provides a comprehensive picture of fostering in England over time.

Embedding of new methodology: The number of agencies that returned forms that still had errors at the point that the collection was closed was in line with last year.

Limitations of the data

Voluntary nature of the collection: The data collection is voluntary. As a result, response rates may fluctuate, though response rates to date have been close to 100%, with all respondents providing all requested data. As the collection is voluntary, there is no legislation compelling agencies, including LAs, to supply data, or to provide information on their own data quality. Her Majesty’s Chief Inspector has also not made use of her powers to compel reporting of this data.

Comparability to previous years: The changes made to the form each year, and particularly the introduction of a new way of collecting data from 2015 to 2016 meant that some previously comparable data items could no longer be compared to previous years’ data.

Known issues and variance with the data collected: There are some known issues and variance with the data collected. Some agencies reported that they were unable to provide some data items before the final deadline. Also, in some cases there were errors in the returns that could not be resolved by the deadline. A small number of IFAs did not fully validate their data and submissions included small errors, such as omitted approval dates for households. As a result, we are aware that the data may not be as robust as hoped. However, using the online portal and in-built validation has streamlined the process and reduced the numbers of data sets submitted with errors, compared with the manual process used up until 2016 to 2017.

Different reporting practices: Different agencies will have different reporting practices; there is no standard across all fostering agencies. This may impact the burden of completing the return on some agencies. There is also some anecdotal evidence of different recording practices in different agencies, such as around children going missing for short periods (fewer than 24 hours).

Minimal knowledge of data quality at provider level: Although we extensively quality assure all data returns, information is not generally available about how the agency ensures that accuracy of their own data. Steps are taken to mitigate the impact of this, including QA, and the provision of guidance on completion of the form. A helpline number is also operated so that data suppliers can speak to a member of the Social Care Data and Analysis team for queries.

Potential sources of error and bias

We have no direct knowledge of the agencies’ data storage systems, or the checks and QA they carry out on this. We are currently unable to explore this in any depth due to the time and resource needed. However, we perform extensive QA of data to minimise the impact of this. Also, the data collected is broadly similar year-on-year, so it is likely that agencies have systems in place to collect and report on the required data. There has also been evidence of improvement over the years as a result of this data collection.

There will always be situations that do not fit easily into the categories supplied. In these cases, personal interpretation may mean that different data suppliers code similar situations in different ways using a ‘best-fit’ approach. We aim to minimise this through use of guidance and support.

Agencies may perceive that the data will be used to form a judgement on their services, which could bias their return. We include guidance on the purpose of the collection in an aim to reduce this concern.

Finally, all agencies are asked to, and do, submit data. Therefore, there is no risk of sample or response bias in the data.

Timeliness and punctuality

Statistics are produced and published on an annual basis.

Data is published on the date pre-announced in the publication schedule. You can also find information on any delay in publication on the publication schedule. Reasons why a delay may occur include, for example, when more time is necessary to properly QA the data to ensure its robustness. We announce publications on our Twitter account and other social media channels on the day of release.

The average timescale for producing the fostering data release is approximately 6 months. This includes approximately 3 months for collecting the data including validation of the data, and an additional month for support and follow-ups with agencies. A further 6 weeks of the production involves:

• the analysis
• drafting the findings
• creating the statistical release
• QA of all outputs and publication on gov.uk

Pre-release is given in accordance with the Pre-Release Access to Official Statistics Order (2008), as detailed in Ofsted’s pre-release policy.

Accessibility and clarity

Ofsted releases are published in an accessible format on gov.uk. The information is publicly available and there are no restrictions on access to the published data.

Data covering children’s social care is held on a collections page on gov.uk.

The primary function of the data is to meet Ofsted’s data requirements for inspections. However, the data is shared for public use with the intention of informing about the fostering sector and for re-use by analysts and researchers as may be required. The underlying data presentation was amended to better support public use and re-use from 2014 to 2015.

Performance, cost and burden on respondents

We attempt to minimise the burden on respondents by improving the clarity of questions and definitions through direct consultation and feedback and queries. Some work was done in 2011, for the Department for Communities and Local Government (DCLG) single data list, to establish the annual respondent burden in terms of resource hours.

In order to reduce the burden on agencies around producing this data, Ofsted and the agreed (before the 2016 to 2017 collection) to introduce Ofsted URNs into the statutory SSDA903 data collection from LAs. This data is intended to be included in a supplementary release. We will assess how effectively this change has worked for all parties, and what amendments may be needed to ensure the process runs smoothly and continues to reduce burden for data suppliers.

As discussed above, we introduced an online portal for data validation and submission in 2017 to 2018. This substantially reduced the amount of time agencies wait for feedback on the quality of their returns. Validation is carried out immediately, at the point of submission and the validation tool is more comprehensive compared with the previous method.

Confidentiality, transparency and security

When we hold sensitive or personal data, the disclosure control processes we have in place ensure that this data is not published. All data releases follow Ofsted’s confidentiality and revisions policies. All staff using sensitive data have been trained in confidentially and disclosure awareness.

Methodology

The 2018 to 2019 fostering dataset collection asked for data on all children still in placement on 31 March 2019, looking back at the 12 months before this date (or whatever portion of the year the child was in placement with the agency).

Data processing involves aggregating data to England and sector level. This processing is done using Excel, and is reviewed and quality assured before the data is used. No data has been removed.

For data protection and disclosure purposes, all figures in the key findings and the underlying data have been rounded to the nearest 5; this has also been applied to figures from previous years used in the release. The purpose of the rounding is to ensure non-disclosure of sensitive data while maintaining its usefulness. This means, however, that some total figures do not match exactly with data aggregated at provider type, England or regional levels.

IFA agency level data is not published, because IFAs are subject to different legislation and frameworks than LA fostering agencies, as described above. IFAs are also often smaller, meaning that the risk of disclosure is higher if data is shared at agency level for this group. IFAs also include private organisations, for whom this data is commercially sensitive, and therefore not appropriate for sharing widely.

Definitions are provided in the SFR; for instance, the glossary includes placement types and what these mean, as well as references to relevant legislation where applicable.

Instructions for printing and saving

Instructions may vary depending on which browser you use, such as Internet Explorer or Google Chrome, and the type of device you use, such as an iPhone or laptop.

You will find your print and save options in your browser’s menu. You may also have other options available on your device. The instructions for mobile and tablet devices will be specific to their make and model.

How to search

Click on Ctrl + F on a Windows laptop or Command + F on a Mac

This will open a search box in the top right-hand corner of the page. Type the word you are looking for in the search bar and press enter.

Your browser will highlight the word, usually in yellow, wherever it appears on the page. Press enter to move to the next place it appears.

How to print a copy of the guidance

Click on Ctrl + P on a Windows laptop or Command + P on a Mac

You can also choose to save as a PDF.