State-funded schools inspections and outcomes as at 31 August 2019: methodology
Published 28 November 2019
Applies to England
Introduction
This document contains methodology and quality information relevant to Ofsted’s official statistics release of state-funded school inspections and outcomes data, which is published 3 times per year.
This official statistics release reports on the outcomes of state-funded schools inspections that were carried out within the most recent reporting period. This release also includes the most recent inspection outcome of all open schools as at the end of the reporting period, including those schools that have yet to be inspected for the first time. If an open school has not yet been inspected, we will include the inspection outcome of its predecessor school to give a more comprehensive view of the sector. This release covers all state-funded schools within England.
Quality
This section is broken down by the 5 dimensions to statistical output quality in the Code of Practice for Official Statistics:
- relevance
- coherence and comparability
- accuracy and reliability
- timeliness and punctuality
- accessibility and clarity
There is also additional information on meeting user needs.
Relevance
Information in this release has 5 distinct purposes:
- it allows media outlets to use our key findings to inform the public about the quality of schools across the country and in particular local areas
- it allows users to track movement in the education sector and monitor the quality of provision available at a national and local level and across provider types
- it gives an accurate picture of the provision, which influences policy decisions about the location and quality of school provision
- it helps identify areas of weak performance, which informs policy development within the Department for Education (DfE), local authorities and multi-academy trusts to address issues and implement strategies to mitigate them
- within Ofsted, inspection profiles inform inspection framework development and underpin policies to improve standards; also, the key messages within the official statistics contribute towards the findings in our Annual Report to Parliament
The data included in the release is generated by Ofsted’s regulation and inspection process and is therefore administrative data.
Assessment of users’ needs and perceptions
These official statistics are regularly reviewed to ensure that they meet users’ needs. This has included running several public consultations in the last few years.
In November 2017, we consulted on proposals to change the way we compile data on schools’ most recent inspections. Respondents supported these proposals. Based on these findings, we made all of the changes proposed as part of the consultation. These were applied for the first time in the official statistics published in June 2018.
Previously, in August 2015, we also published the results of an earlier consultation on this official statistics release. You can read documents relating to this consultation, which include a list of resulting changes.
Since the 2015 consultation, a small number of additional tables and fields have been added to the release to reflect the changes made to inspections in September 2015. These provide information on section 8 inspections of good and non-exempt outstanding schools as well as the new judgements introduced as part of the common inspection framework.
We welcome feedback about our statistical releases. If you have any comments, questions or suggestions, please contact the Schools Data and Analysis team at: [email protected].
Coherence and comparability
The tables and charts within the release compare inspection outcomes over the past several years. These tables and charts have all been updated to reflect the changes, since June 2018, to the way we compile data on most recent inspection outcomes.
There have also been a number of framework changes since the first release of statistics and these have been reflected in the publications.
The overall effectiveness judgement has remained broadly comparable across the different frameworks since 2005. Other judgements are, where possible, mapped across frameworks when changes occur. This is explained in more detail in the frameworks section below.
When these changes have occurred, users have been alerted via updates in the official statistics introduction and methodology sections of the key findings document. When changes to inspection frameworks or methodological changes have been implemented to improve the output, guidance has been added to footnotes and the key findings document for easy access.
If inspection reports are published after the final publication date included within a release, the inspection outcomes will be reflected within the next provisional official statistics release.
Some policies within Ofsted and the DfE impact on the comparability of different school types with each other and with schools as a whole. Comparisons between school types should be treated with caution due to the variation in the number of schools included in the different categories.
Other sources of similar data
There is no comparable data published by other producers of official or national statistics for school inspections in England.
Inspection reviews and reports:
- in Scotland, inspections are carried out by Education Scotland
- in Wales, inspections are carried out by Estyn
- in Northern Ireland, inspections are carried out by Education and Training Inspectorate (ETI)
We also produce monthly management information on the outcomes of school inspections, and a quarterly interactive web tool called Data View. At present, the methodology used to produce all 3 releases is the same.
Several third parties provide interactive tools displaying publicly available Ofsted inspection judgements. These appear to be collated by using advanced computer techniques to harvest information from published inspection reports. We cannot comment on the quality of these datasets.
Changes to inspection frameworks
The common inspection framework was introduced in September 2015 following the ‘better inspection for all’ consultation. This consultation initiated various changes to the way Ofsted inspects providers.
The common inspection framework was used until 31 August 2019, when the education inspection framework took its place.
Impact of framework changes on current reporting
- Overall effectiveness: this judgement is broadly comparable across all frameworks from September 2005 to August 2019.
- Effectiveness of leadership and management: this judgement is broadly comparable across all frameworks from September 2005 to August 2019.
- Quality of teaching, learning and assessment: this judgement is broadly comparable across all frameworks from September 2005 to August 2019.
- Outcomes for pupils: this judgement is broadly comparable across all frameworks from September 2005 to August 2019
- Personal development, behaviour and welfare: A new ‘personal development, behaviour and welfare’ judgement was introduced in September 2015 and superseded the previous ‘behaviour and safety of pupils’ judgement, which is no longer presented in the most recent outcomes data. As such, analysis of this judgement (personal development behaviour and welfare) will only represent inspections since September 2015 and will not provide a comprehensive view of the quality of provision nationally.
- Early years provision: This judgement is broadly comparable across all frameworks from September 2005 to August 2019, with the exception of 2012/13 and 2013/14 academic years when, due to legislation changes, the judgement was not made at inspections. Since September 2015, nursery schools have not received a separate early years judgement.
- 16 to 19 study programmes: This judgement has been broadly comparable since September 2005. However, this judgement was not reported in 2012/13 and 2013/14 due to changes in legislation. Between 2005 and 2012, the judgement was made under the ‘overall effectiveness of the sixth form’ judgement, which was replaced by the 16 to 19 study programme judgment in September 2005.
The new education inspection framework came into effect in September 2019. The changes made as part of that framework therefore do not affect the current official statistics.
The selection process
Schools are not inspected with equal regularity. Ofsted must inspect all schools to which section 5 of the Education Act 2005 (as amended) applies, within prescribed intervals.
The result of this is that the schools inspected in a particular academic year are unlikely to be representative of schools as a whole. This may also affect the comparability of school inspection outcomes between years. This is as a result of the following selection rules.
Selection rules
Schools that were previously judged to be less than good in their most recent inspections are inspected more frequently than good schools.
As of September 2015, good schools received a section 8 inspection approximately every 3 years. As of April 2018, this was changed to approximately every 4 years.
Before September 2015, all good schools received a section 5 inspection no later than the fifth academic year since their last inspection, including in cases when they continued to provide the same standard of education. Therefore, users should be particularly cautious if comparing outcomes from 2015/16 or later with previous years.
Primary and secondary schools previously judged to be outstanding in their most recent inspection are exempt from routine inspection and will not be inspected unless we have concerns about them. This can include concerns identified through risk assessment, a complaint, a serious safeguarding incident or concerns about the standards of leadership and management.
Outstanding special schools, nursery schools and pupil referral units are not exempt from routine inspection. These schools receive a section 8 inspection in the same way that all good primary and secondary schools do.
New schools are usually inspected according to a fixed cycle, so in the majority of cases the timing of this inspection is not determined by performance data of the school.
The exact timing of a schools’ next inspection can also vary depending on the outcomes of a data-based risk assessment process, and a desk-based review of other information by a senior HMI in one of Ofsted’s regional teams.
The comparability of data on the most recent inspection outcomes for all schools
The official statistics include analysis of the most recent inspection outcomes of all open schools (based on nearly 22,000 schools nationally). This analysis is often summarised as the percentage of schools judged good or outstanding at the end of each academic year. This statistic is used by Ofsted and others to try to measure the quality of the school sector over time.
The comparability of this statistic is affected by a number of the factors discussed previously in this document, and should therefore be used with caution.
Comparability factors
Changes to inspection frameworks over time:
The overall effectiveness judgement is intended to be broadly comparable since section 5 inspections began in 2005. There may have been some fluctuations over time in where the bar is set between ‘good’ and ‘requires improvement’/’satisfactory’. However, we do not believe there has been a substantial lowering of this bar since 2010 that would account for the substantial rise in the proportion of schools judged good or outstanding at their most recent inspection since that time.
Government’s exemption from routine inspection for primary and secondary schools judged to be outstanding
A small proportion of schools have now not had a full inspection for over 10 years. There is a risk that this could inflate the proportion of schools that are graded outstanding because schools become outstanding and may not be inspected again. However, we carry out a risk assessment on exempt schools every year, and still inspect these schools if we have cause for concern. From 2018/19 onwards, we planned to inspect 10% of exempt schools each year.
Different lengths of time between inspections for schools of each grade
This means that schools that are less than good are usually inspected more frequently than other schools. The impact of this is most clearly seen when users of our data try compare inspections that take place in individual academic years. The inspections carried out in any single year are not designed to be representative of all schools nationally, and the mix of grades is usually lower than that seen across all schools at their most recent inspection. Schools are risk assessed regularly, and inspections can be brought forward at any time if we have concerns about a school.
Changes to section 8 inspections of good and non-exempt outstanding schools introduced in January 2018
These section 8 inspections now only convert to a full inspection if there are concerns about safeguarding, behaviour or the quality of education. Far fewer section 8 inspections have converted to a full inspection since this change. This policy change means that some schools are still classed as good or outstanding in our data, whereas under the previous policy the inspections may have converted, and some of these schools may have then been judged to have a lower grade. However, in our estimation, the impact of this change on the proportion of ‘good’ and ‘outstanding’ schools nationally is fairly minor at the current time.
Accuracy and reliability
Inspections outcome data is extracted from Ofsted’s administrative systems. Inspection outcomes are entered onto our systems by the lead inspector. As inspection reports undergo a quality assurance process, any errors are likely to be identified at this stage. In addition, we check a sample of the entries made onto our administrative system to ensure that these match the inspection report. There is a focus on checking those entries where the risk of there being an error is highest. An example of this is when the inspection outcome awarded changes during the quality assurance process. There remains a small chance that some outcomes are entered incorrectly onto our systems.
We moderate all inspection reports when a school is judged to be inadequate. This may result in some inspection reports being published after the publication cut-off date required for inclusion within the provisional release. Therefore, provisional statistics are likely to under-represent schools being placed in a category of concern. In addition, when there are concerns that further evidence may be required to secure the inspection evidence base, this will delay publication of an inspection report.
Revisions to the data are published in line with Ofsted’s revisions policy for official statistics.
Technical production
Technical production of the official statistics publication may also result in manual errors. We use a rigorous data quality assurance procedure, with the aim of minimising the risk of reporting error. If an error is discovered within the document, we place a note on the website and upload a corrected version of the document as soon as possible.
Read more information on issues relating to the use of administrative data.
Data obtained from other sources
We get data indicating whether schools are opened or closed, their type and phase of education and any links to predecessor schools from the DfE’s Get information about schools (GIAS) database, formerly called Edubase.
The quality of data relating to school opening and closures is considered to be good. Changes that occur because of schools converting to academy status, re-brokering between academy trusts, or closing to become sponsor-led academies are managed centrally by the DfE’s Academies Operations and Strategies team. The process for changes undergoes monthly reconciliation checks against other data systems within the DfE. Some issues have been identified around the closure, merger and amalgamation of local authority maintained schools. Local authorities do not always inform the DfE of these changes, and therefore these are sometimes identified after the event. These discrepancies are usually identified as part of checks built into other processes.
Official statistics published since April 2016 use GIAS data for all charts and tables. Data obtained from GIAS on the type of education is considered to be of good quality. Any change to the type of education requires verification from the DfE. The phase of education is not subject to the same verification. Local authority maintained schools have some remit to change their age range through a local process. Errors are picked up as part of the DfE’s performance table validation process, but this may be after the event. The DfE requires schools to update their records every 90 days.
Timeliness and punctuality
Data is currently published 3 times a year and includes details of inspections that have taken place and been published in the relevant period. To ensure that data is as timely as possible, each release includes the most recent possible full month of inspections.
Data is published at 9:30am on the date pre-announced in the publication schedule.
You can also find information on any delay in publication on the publication schedule.
We allow 1 calendar month after the end of the reporting period as the cut-off date for the inclusion of published inspection reports. For instance, when an inspection would have to have been completed by the end of March, the report would have to have been published by the end of April. This is to allow time for most of the relevant reports to have been published. We do not usually publish inspection reports during school holidays, so the timing of school holidays can affect the proportion of reports that are published by the cut-off date for the statistics.
The average production time for this official statistics release is approximately 6 weeks. This time includes obtaining and cleaning the data, drafting findings, quality assuring all outputs and uploading the information onto the gov.uk website.
We announce publications on our social media channels. Pre-release access is given in accordance with the pre-release to official statistics order (2008).
You can find the list of post holders granted pre-release access as a separate document accompanying each release.
Accessibility and clarity
Ofsted releases are published in an accessible format on GOV.UK. The information is publicly available and there are no restrictions on access to the published data. Each release includes outcomes from Ofsted inspections that have subsequently been published. The data is aimed at keeping users informed of the progress of the inspection framework and of changes in the state-funded schools sector.
Supporting underlying data in an accessible format accompanies each release to allow users to perform their own analysis. Users may use and re-use this information (not including logos) free of charge in any format or medium, under the terms of the Open Government Licence.
Performance, cost and burden on respondents
There is no burden on respondents in relation to this statistics release because data is a by- product of Ofsted’s inspection process. The only cost involved is the internal resource involved in collating the release.
Confidentiality, transparency and security
When we hold sensitive or personal data, the disclosure control processes we have in place ensure that this data is not published.
All data releases follow Ofsted’s confidentiality and revisions policies.
Methodology
Data in this official statistics series is from inspections carried out under sections 5 and 8 of the Education Act 2005. You can find further detail on the dates of inspections included within the release. If an inspection report is not published by the cut-off date given in the release, then the previous inspection will be reported as a school’s most recent inspection where applicable.
Data will be presented and analysed in 2 ways:
- inspections that have occurred within the academic year being reported when published by the given date
- the most recent inspection outcome of all open schools as at the end of the reporting period, including those schools that have yet to be inspected for the first time; when an open school has not yet been inspected, we will include the inspection outcome of its predecessor school to give a more comprehensive view of the sector
For official statistics, data on inspection outcomes is collected 1 month after the end of the reporting period. This helps to ensure that the vast majority of inspections carried out within the reporting period are published and reflected within the official statistics. This is done to minimise bias. For instance, inspection reports of those schools judged inadequate undergo additional moderation checks, and may otherwise miss a shorter reporting period.
Under exceptional circumstances, we may withhold/withdraw publication of an inspection report. Outcomes of withheld/withdrawn inspection reports are not included in any of the datasets. If this is the case, these are highlighted with footnotes throughout the report.
Warning notice data is included in the school level data for any local authority maintained school receiving a warning notice from a local authority and for any academy receiving a warning notice from the Secretary of State for Education during the academic year being reported on. Pre-warning notices given to academies are not included. Any warning notices given by local authorities that are currently under appeal or have been withdrawn have not been included.
Section 8 inspections of good and non-exempt outstanding schools
In September 2015, we introduced section 8 inspections of good and non-exempt outstanding schools. When a short inspection converts to a full section 5 inspection, the outcome is reported within the outcomes for full inspections. Additional tables have also been added to the release to show the volumes of section 8 inspections of good and non-exempt outstanding schools, the proportion that converted to full inspections, and the resulting inspection outcomes. When a school remains the same grade, for transparency, we also include all section 8 inspections which did not convert, as they have confirmed the grade of the previous full inspection.
When statements are made about whether inspection outcomes have declined or improved, they refer to the most recent inspection outcome compared to those of the previous inspection outcome. When a school has not been inspected in its current form, the most recent inspection (and the previous inspection outcome) will relate to the predecessor school.
Following a change to Ofsted’s policy in January 2018, these section 8 inspections only convert to a full inspection if there are concerns about safeguarding, behaviour or the quality of education. If the inspector feels the school may be declining, but does not convert the section 8 inspection to a full inspection, then the outcome for the inspection is that the next inspection will be a full section 5 inspection. Far fewer section 8 inspections of previously good and outstanding schools have converted to a full inspection since this change.
Data View
Data in this release is also used to update an interactive Ofsted web tool called Data View.
Schools are included within most recent inspection outcomes if they were open on the final day of the reporting period, or if they closed on that day and they or their predecessor school have been inspected.
Phases of education
Ofsted reports on various phases of education, which include different types of establishment.
When early years provision is governed by the school or it provides care for children aged 2 or over, it will be inspected as part of the section 5 inspection and outcomes are included in the schools statistical release. Early years provision that cares for children aged under 2 needs to be registered on the Early Years Register, and will have an early years inspection. These outcomes are reported under our early years official statistics.
The welfare provision for boarding and residential special schools is inspected at the same time as the section 5 inspection of education provision, where possible.
Inspections of this type are referred to as integrated inspections. The outcomes of the inspection of the welfare provision are published in a separate inspection report from the outcomes of the inspection of the education in the school.
Glossary
Academy converter
Academy converters are the most common type of academy. They do not have to follow the national curriculum and can set their own term times. They still have to follow the same rules on admissions, special educational needs and exclusions as other state schools. New academy converters usually retain the local authority establishment number (LAESTAB) and the latest inspection grade of their predecessor school. However, as part of a re-brokering process some academy converters lose their LAESTAB when they join a new multi-academy trust. If this happens and if they have not been inspected in their current form, the inspection outcomes shown will relate to their predecessor schools.
Academy sponsor-led
Sponsor-led academies are academies that have sponsors such as businesses, universities, other schools, faith groups or voluntary groups. Sponsors are responsible for improving the performance of their schools. If they have not been inspected in their current form, the inspection outcomes shown will relate to their predecessor schools.
Free schools
Free schools are funded by the government but are not run by the local authority. They are set up on a not-for-profit basis by charities, universities, and community and faith groups, among others. Free schools are ‘all-ability’ schools, so cannot use academic selection processes like a grammar school. They can set their own pay and conditions for staff and change the length of school terms and the school day. Free schools do not have to follow the national curriculum.
Local authority maintained schools
Maintained schools are funded by the government and run by the local authority. They must follow the national curriculum. If they have not been inspected in their current form, the inspection outcomes shown will relate to their predecessor school.
Phases
Nursery schools are all maintained by local authorities.
Primary schools include converter academies, sponsor-led academies, free schools and local authority maintained primary schools. These include some middle schools that have been deemed to be primary schools because the majority of pupils are primary-age children.
Secondary schools include converter academies, sponsor-led academies, free schools, studio schools, city technology colleges, university technical colleges and local authority maintained secondary schools. These include some middle schools that have been deemed to be secondary schools because the majority of pupils are secondary-age children. This category also includes all-through schools (usually catering for children aged between 3 and 19).
Special schools include converter academies, sponsor-led academies, free school special schools and local authority maintained special schools. It also includes non-maintained special schools inspected under section 5 of the Education Act 2005.
Pupil referral units include alternative provision academies (converter, sponsor-led and free schools) and local authority maintained pupil referral units.
Predecessor schools
When a school closed and re-opened in another form, such as an academy, the closed school is referred to as the predecessor of the open school.
School types
This data includes 4 state-funded school types: academy converters, sponsor-led academies, free schools and local authority maintained schools.
Section 8 inspections of good and non-exempt outstanding schools
In September 2015, we introduced section 8 inspections of schools that we judged good at their most recent section 5 inspection. These section 8 inspections last for 1 or 2 days and take place approximately every 4 years. The section 8 inspection determines whether the school continues to provide a good standard of education for the pupils and that safeguarding is effective.
These arrangements also apply to special schools, pupil referral units and maintained nursery schools that were judged outstanding at their previous section 5 inspection. These settings are currently not exempt from inspection under section 5 if they are judged outstanding.
A section 8 inspection will not result in individual graded judgements. It will not change the overall effectiveness grade of the school. If the inspection is converted to a section 5 inspection, then inspectors will make the full set of graded judgements using the 4-point grading scale, required under section 5.
From November 2017, primary and secondary schools that were judged good at their previous inspection, may be selected for a full section 5 inspection following risk assessment to determine if they have undergone significant change, such as changing their age range, or when the quality of provision may have deteriorated significantly.
From January 2018, there have been further changes to the way we carry out section 8 inspections of good and non-exempt outstanding schools. The purpose of these section 8 inspection is to determine whether the school continues to provide a good standard of education and whether safeguarding is effective.
Possible outcomes for section 8 inspections of good and non-exempt outstanding schools
There are 4 potential outcomes from a section 8 inspection of good and non-exempt outstanding schools.
Outstanding nursery schools, pupil referral units and special schools are not exempt from inspection.
Outcome 1
The school continues to be a good school.
Outcome 2
The school remains good and there is sufficient evidence of improved performance to suggest that the school may be judged outstanding if it received a section 5 inspection now. The school will be informed that its next inspection will be a section 5 inspection, which will typically take place within 1 to 2 years.
Outcome 3
The lead inspector is not satisfied that the school would receive at least its current grade if a section 5 inspection were carried out now. The school will be informed that its next inspection will be a section 5 inspection within the statutory timeframe, which will typically take place within 1 to 2 years.
Outcome 4
The lead inspector has gathered evidence that suggests the school may be inadequate in 1 or more of the graded judgements under section 5 inspections; there are serious concerns about safeguarding, pupils’ behaviour or the quality of education; and/or there are concerns that the performance of an outstanding school that is not exempt could be declining to ‘requires improvement’. The section 8 inspection will be converted to a section 5 inspection, usually within 48 hours.