Social housing lettings in England, technical notes: April 2023 to March 2024
Published 5 December 2024
Applies to England
1. Introduction
The “Social Housing Lettings in England” statistical series has been badged as Accredited Official Statistics[footnote 1], the quality mark of government statistics, following assessment by the UK Statistics Authority in 2014 and subsequent compliance check in the summer of 2024. We abide by the standards of trustworthiness, quality and value in the Code of Practice for Statistics from data collection through to publication.
2. Data collection
Information for the 2023/24 release reflects data given by providers for the financial year ending 31 March 2024. CORE has been a requirement on the Single Data List for local authorities since 2010 and is a regulatory requirement of the social housing regulator for private registered providers.
Statistics presented in this release are based on the data submitted through the online Continuous Recording system (CORE) by private registered providers and local authorities. CORE was first set up in 1989 for PRPs and its remit expanded to local authorities in 2004.
The table below sets out what data currently available:
Table 1: CORE data availability by provider type, 1995/96 - present
Time period | PRP coverage | LA coverage |
---|---|---|
1995/96 | Data collected for General needs only (i.e. no Supported Housing) | Data not collected |
1996/97 – 2002/03 | All data collected and available | Data not collected |
2003/04 – 2005/06 | All data collected and available | Data collected on a voluntary basis |
2006/07 - present | All data collected and available | All data collected and available |
Data providers complete a range of information set out in a form about tenants that are accessing social housing and the property they are letting. Practice varies in terms of how local authorities and housing associations collect and compile the data that is submitted on the CORE form. Some questions are answered with information recorded at the point of registration, other elements about the type of tenancy and stock are drawn from the providers’ own housing management information system, with the remaining CORE-specific questions asked of tenants by housing officers at sign-up.
Once complete, the CORE logs are input online, either manually or directly from their internal systems via a bulk upload. The data are initially validated at the point of entry as they are submitted by data providers, and then undergo further validation and quality assurance processes. These processes are described in the “Data Quality” section.
3. Data quality
3.1 Collection method
CORE data is collected from housing providers – both local authorities (commonly called ‘council housing’) and private registered providers (commonly called ‘housing associations’).
CORE data comprises three key themes: information about the tenants, tenancies, and properties.
Housing providers are the direct creators (and holders) of the information about tenancies and properties. Often, they need this information themselves for day-to-day management of their stock and lettings. By collecting this data from housing providers, we are collecting data directly from the source.
Some information about the tenant can only be answered by the tenant themselves, e.g. self-reported reason for leaving last settled home. Whilst ideally we would collect this information directly from the tenant, central government has no existing interface with tenants when they get a new social housing let. Since housing providers have at least one face to face interaction with tenants and housing providers also hold the information we require on tenancies as properties, the most efficient method to collect the CORE-specific tenant questions is for housing providers to ask tenants at sign-up, i.e. when tenants move into the property.
3.2 Coverage
The data collected through CORE differs from the social housing data in the Local Authority Housing Survey (LAHS) in that CORE is a ‘flow’ measure of all new social housing lettings which records data at case level (i.e. individual lettings), whereas data in LAHS is a ‘stock’ measure of all social housing stock in local authorities. Some LAHS information is presented in this release to provide context to the information from CORE on new lettings. See the Technical notes.
The English Housing Survey (EHS) also provides social housing lettings data but the statistics are based on a survey and are again a ‘stock’ measure of social housing stock. CORE data focuses on the tenancy details at the point of letting, and besides property characteristics also collects information on the socio-demographic profile of the household, their housing circumstances and some financial information. CORE does not record any information of social housing lettings that are continuing – only new lettings.
CORE lettings data are reported by all registered providers, and voluntarily by those who are not registered with the Regulator of Social Housing for new lettings only. Information is collected for General Needs and Supported Housing, for Social Rent, Affordable Rent and Intermediate Rent, by financial year.
Some types of lettings are excluded from CORE, (see the guidance page for data providers), including:
-
Mutual exchanges (where tenants have swapped homes)
-
Conversions of starter or introductory tenancies to assured or secure tenancies (because the introductory tenancy will have previously been reported to CORE)
-
Successions by assignment (where the tenancy has transferred to another person at the request of the sole tenancy)
-
Social Rent or Affordable Rent General Needs lettings on a fixed-term basis for less than two years (these are deemed temporary housing)
3.3 Completeness of CORE data
CORE is designed to be a complete census of new social housing lettings provided by local authorities and private registered providers that own social housing stock.
Whilst data providers should submit data for all new social housing tenancies, this does not always happen in practice. In addition, not all questions are compulsory so information may be incomplete for some tenancy records. This may introduce bias into the end statistics. We minimise this by applying weighting and imputation processes.
Weighting is applied at case level (i.e. for individual lettings) to adjust for non-response by local authorities.
Imputation is applied at item level (i.e. for individual questions within a letting log) to compensate for question non-response. This is done for both local authorities and private registered providers.
Local authority weighting
Local authority weights are calculated by comparing the total number of lettings in that area reported to the Department’s Local Authority Housing Statistics (LAHS) return.
Weights are calculated for groups of similar local authorities. The groups are determined by conducting clustering analysis on the last three years of CORE data for a given local authority on a set of metrics that best separate local authorities into groups. In 2023/24 these metrics were:
-
Average household income
-
Percentage of lettings to households where the lead tenant is in employment
-
Average weekly rent
-
Percentage of lettings to properties being let for the first time
-
Percentage of lettings that were General Needs
-
Average number of household members
-
Percentage of lettings which received reasonable preference
-
Percentage of lettings let as Social Rent
-
Average age of the lead tenant
-
Percentage of lettings to household deemed homeless This resulted in 6 groups of local authorities, with each group comprising 26 - 64 local authorities.
Before 2023/24 we used the 2011 ONS area classifications to group local authorities, which are based on the 2011 Census. However as these classifications are not being updated to use the 2021 Census data we switched clustering model to the approach described above using CORE data.
For each group of local authorities, the weight is calculated for all responding local authorities as the ratio of the number of lettings judged to be the most reliable (either reported to LAHS or reported to CORE), relative to those reported to CORE.
Currently weights are not calculated for Private Registered Providers as their response rate is high and there is no alternative data source robust enough to be used for CORE weighting purposes. For instance, whilst the Statistical Data Return (SDR) published by the Regulator for Social Housing includes the number of lettings by private registered providers, the Regulator’s coverage is different to that of CORE. We will continue to review this assumption over time.
Weights are only suitable for use when conducting analysis at the national level. When conducting analysis on sub-national geographies such as local authority areas the weights should not be used. Summing sub-national figures will not give a true figure for the England total, as the national figure should be calculated separately using weights.
Imputation of missing items
Some of the questions on the CORE questionnaire are not compulsory. In particular, data on household characteristics may not be available to the housing officer or the tenant may prefer not to answer. In these cases, we impute responses.
Our imputation methods are based on the recommendations of the ONS Methodology Advisory review in 2013. We follow a ‘nearest neighbour’ or ‘donor imputation’ approach, a standard statistical technique. This involves identifying records that are similar to the records with missing data, based on variables that have been determined to be of most importance (e.g. other demographic characteristics, geography etc.). The algorithm randomly chooses a record (the ‘donor record’) from the set of records with the closest data for the non-missing variables and copies the data for the missing variables from the donor record into the record with missing data.
The imputation process uses the groups of local authorities as in the weighting process as one of the variables used to judge lettings’ similarity. The imputation is carried out separately for General Needs and for Supported Housing and separately for the different rent types, to reflect the different demographic profiles of their tenants.
Imputation is done one variable at a time on the missing variables for the lead tenant in the following order: age, gender, economic status, nationality and then ethnicity. In most cases the imputation methodology prevents using donor data that would normally fail the usual validation process.
We impute the following demographic variables for the lead tenant:
-
Age
-
Gender
-
Economic status
-
Ethnicity
-
Nationality
Income data is not imputed. Income has a higher non-response rate and as the rate is uneven across household types any imputed results may lead to biased estimates. Instead, to improve completeness of income data the department is working with data providers to encourage a higher response rate.
3.4 Derived variables
In addition to the information given by providers for new social lettings, additional variables are created for each log using the existing information. Some are simple, for example weekly rent and weekly income values are derived from their equivalent base values and their frequencies. More complicated derived variables are described below.
Vacant days
The vacant days refers to the number of days an existing social property was available to let before the start date of the new tenancy.
The vacant days calculation uses the void date, the major repairs completion date (if relevant) and the start date of the new letting. All of these dates are collected in the CORE form.
The void date is the date the property was (legally or contractually) available to let, or for:
-
re-lets: the day after the previous tenant’s contract ended
-
new builds: the day the landlord legally first owned the property (‘completion date’)
-
new conversions or acquisitions: completion date, or the day after rehabilitation work ended
-
new leases: the day the landlord got contractual property rights and could let it out to tenants
The major repairs completion date is the date when any works that could not be reasonably carried out with a tenant living at the property were completed. For example, structural repairs.
The vacant days is the difference between the void date and the start date of the new letting. If the property underwent major repairs, the number of vacant days is the difference between the major repairs completion date and the start date of the new letting.
For example, for a letting that had a void date of 07/12/2023, a major repair completion date of 17/12/2023 and a tenancy start date of 18/12/2023 then the vacant days will be 1. If this letting had no major repairs (so no major repair date) then the vacant days would be 11.
Bedroom standard
The bedroom standard is a measure of whether a property is of an “appropriate” size for the household. The definition is set out in law[footnote 2]. Comparing the derived bedroom standard for a household with the number of bedrooms in the property of their new let shows whether the household has been allocated a property that is “too small”, “too big”, or “of the appropriate size”.
The derivation for bedroom standard uses the age, gender and relationship to lead tenant of all household members, which are collected in the CORE form.
If the lead tenant answered ‘prefers not to say’ for age or gender then the imputed versions are used. If any of the other household members answer age, gender or relationship to the lead tenants with ‘prefers not to say’ then the bedroom standard is not calculated and the variable is left blank.
The bedroom standard is calculated, according to law, by allocating a separate bedroom to each:
-
adult couple
-
any remaining adult (aged 21 years or over)
-
two adolescents (aged 10 to 20 years) of the same sex
-
one adolescent (aged 10 to 20 years) and one child (aged 9 years or under) of the same sex
-
two children (aged 9 years or under) regardless of sex
-
any remaining child (aged 9 years or under)
For example, a couple with children of different sexes and less than 9 years old would be assigned two bedrooms, whereas if one of the children was older than 9 years then the household would be assigned 3 bedrooms.
For years where self-reported gender as opposed to biological sex were collected (2019/20 onward) the bedroom standard has been calculated using self-reported gender. When calculating the bedroom standard for these years where sex is involved in room sharing (for example adolescents sharing a room) those identifying as “Other” are only assumed to share a room with another household member identifying as “Other”.
Dependent children
In 2023/24 the dependent children variable was introduced for comparability with other data sources. This is defined as the number of under 16s in the household and the number of 16 to 18 year olds in full time education who are not the lead tenant or in a relationship with the lead tenant. This variable is set to “Prefers not to say” if:
-
Any of the ages of household members are reported as “Prefers not to say”
-
There are 16 to 18 year olds with an economic status of “Prefers not to say”, or relationship to lead tenant reported as “Prefers not to say”
Household composition
The household composition variable is a summary descriptor of a household, such as couple with children.
Household composition is derived from household members’ ages, genders, and relationship to the lead tenant, which are collected in the CORE form.
If the lead tenant answered ‘prefers not to say’ for age or gender then the imputed versions are used. If any of the other household members answer age, gender or relationship to the lead tenants with ‘prefers not to say’ then the household composition is not calculated and the variable is left blank.
In 2023/24 the method for household composition derivation was changed to match other data sources such as the English Housing survey and the census.
The new method is calculated in the following process:
-
If any of the household members’ age is “Prefers not to say”, then the composition is “Prefers not to say”.
-
If there is only one household member and they are aged 66 or older, then the composition is “Single adult aged 66 years and over”.
-
If there is only one household member and their gender is “Prefers not to say”, then the composition is “Prefers not to say”.
-
If there is only one household member and their gender is “Male” then the composition is “Single male aged under 66 years”.
-
If there is only one household member and their gender is “Female” then the composition is “Single female aged under 66 years”.
-
If there is only one household member and the gender is “Non-binary” then the composition is “Other household types”.
-
If there are two household members, the relationship is “Partner” and the age of either of the household members is 66 or over then the composition is “Couple with at least one person aged 66 years or older”.
-
If there are two household members, the relationship is “Partner” then the composition is “Couple with no children”.
-
If the number of dependent children is greater than zero, the difference between the number of household members and dependent children is one and the lead tenants gender is “Male” then the composition is “Single male with dependent child(ren)”.
-
If the number of dependent children is greater than zero, the difference between the number of household members and dependent children is one and the lead tenants gender is “Female” then the composition is “Single female with dependent child(ren)”.
-
If the number of dependent children is greater than zero, the difference between the number of household members and dependent children is two and one of the household relationships is “Partner” (with corresponding age 16 and over) then the composition is “Couple with dependent child(ren)”.
-
If any of the relationship variables or the number of dependent children are ”Prefers not to say” then the composition is “Prefers not to say”.
-
If none of the above have been triggered then the composition is “Other household types”.
Previously household composition was calculated in the following process:
-
If the ages of either the lead tenant or the second household member are 60 and over, the relationship between the second household member and the lead tenant is “Partner” and there are only two household members then the household composition is “Elder couple”.
-
If the age of the lead tenant is over 60 and there is only one household member then the household composition is “Single elder”.
-
If the age of the lead tenant is over 16, one member of their household has the relationship of “Partner” and one or more members have the relationship “Child” then the household composition is “Couple with child(ren)”.
-
If the age of the lead tenant is over 16, one member of their household has the relationship of “Partner” and there are only two household members then the household composition is “Couple”.
-
If the gender of the lead tenant is male, and they are 16 or over, the number of household members with a relationship of “Child” is greater than 0 and the number of household members with other relationships (“Partner” or “Other”) is 0 then the household composition is “Single male with child(ren)”.
-
If the gender of the lead tenant is female, and they are 16 or over, the number of household members with a relationship of “Child” is greater than 0 and the number of household members with other relationships (“Partner” or “Other”) is 0 then the household composition is “Single female with child(ren)”.
-
If the gender of the lead tenant is male, the lead tenant is 16 or over and there is only one household member then the household composition is “Single male”.
-
If the gender of the lead tenant is female, the lead tenant is 16 or over and there is only one household member then the household composition is “Single female”.
-
If the household hasn’t been assigned a composition by this point then they are “Other”.
As part of this transition the changes in comparable household compositions were analysed.
The biggest shifts are the shrinking of “elder” categories. This is because with the minimum age in the “elder” definition raised from 60 to 66 years old , so people aged between 60 and 66 years are no longer included in this group under the proposals.
The other notable shift is the increase of “Prefers not to say”. This is mostly where one or both halves of a couple answered “Prefers not say” (so we can’t determine if they’re 66+) and where we can’t determine whether a younger person is a dependent child (see ‘Dependent children’ section above).
Income
Income is collected at a household level. It includes income after tax from employment, pensions, Universal Credit and child benefit. It excludes National Insurance (NI) contributions, tax, housing benefit and council tax support. The child benefit element of income is not collected in CORE and instead derived using the ages of household members, their relationships to the lead tenant and their economic status.
Income is an optional question. In 2023/24 income was missing for 62.8% of lettings logs. The response rate differs by needs type, rent type and provider type. Exact figures are available in table 4b of the Data Quality tables, available from the same page as these Technical Notes. We do not impute income because of the uneven response rate from different household types which may cause imputed results to have biased estimates.
Rent burden
Rent burden is the proportion of a household’s income that is spent on rent and eligible service charges.
We can therefore only calculate a household’s rent burden in cases where they have answered the question on income. In 2023/24 this was 37% of lettings. Rent and eligible service charges are mandatory questions so the data is complete.
Households may receive Universal Credit or housing benefit to help pay their rent and specific eligible charges. Our definition of income (see ‘Income’ above) includes Universal Credit as this is paid directly to the tenant. This means that the money to pay their rent is included in the income figure collected in CORE.
However, our definition of income excludes housing benefit as this is paid directly to the landlord. This means that for households on Universal Credit the money to pay for their rent isn’t included in the income figure reported to CORE.
In order to calculate rent burden in a consistent way, for households who receive housing benefit we estimate the amount of housing benefit paid and add that to the collected income figure.
We use information from the question on the CORE form: ‘after the household has received any housing-related benefits, will they still need to pay for rent and charges?’. If the answer to this question is ‘no’, then the amount of housing benefit the household receives is equal to the total of the rent and eligible service charges. If the answer is ‘yes’, then the tenant also provides the outstanding amount, and we therefore calculate the amount of housing benefit received as the total of the rent and eligible service charge minus the outstanding amount.
Prior to 2022/23 we used an alternative method based on demographic information about household members, the number of bedrooms in the property and weekly rents and service charges. The need for the number of bedrooms meant we could only calculate rent burden for General Needs tenancies, whereas from 2022/23 we also have estimates for Supported Housing. See the 2022/23 technical notes for further discussion of the change in methodology and its impacts.
Quality assurance procedure
4. Users, uses and user engagement
CORE is a unique source of information in providing detailed information about individual tenancies. No other existing data source, either published or held internally by governmental or other central bodies, contains the breadth of information collected by CORE. It is the only census of all new lettings in England, the only data source across the social housing sector collected at individual tenancy level and the only source that allows detailed multivariate analysis of household and dwellings in the social sector. Social housing lettings statistics and the underlying CORE datasets inform national housing policy in areas such as social housing allocation policy, homelessness reduction and as part of the evidence base for the Domestic Abuse Bill. Data on housing costs, housing-related benefits and affordability is used to inform modelling on the value for money and societal impact of investment into new affordable housing, e.g. via the Affordable Homes Programme. The Department uses CORE data on demographics of households in new social lettings to inform equality impact assessments, e.g. for changes to eligibility requirements following the UK leaving the European Union.
CORE data is also used to fulfil the Department’s parliamentary scrutiny obligations through Parliamentary Questions (PQs) and to meet government transparency aims through Freedom of Information requests.
The Department’s Arms’ Length Bodies use CORE data in order to carry out their functions. For example, Homes England use the data to monitor government investments and schemes, and the Regulator of Social Housing use CORE data in their regulatory activities.
Other government departments also use CORE data. For example, CORE data is a component of the key government inflation measure – the Retail Price Index (RPI) published by the Office for National Statistics (ONS). Another example is our collaboration with the Ministry of Defence (MoD) on social housing provision for armed forces personnel to inform their Armed Forces Covenant which aims to ensure members of the Armed Forces are not disadvantaged in their access to government-provided services.
Social housing providers use the data to understand the market for social housing and benchmark their own performance. Local government also use the data to inform their Strategic Housing Market Assessments that form part of the National Planning Policy Framework.
Academics, researchers, charities and the wider public use these statistics to understand social housing issues. Some of these users also use the underlying administrative data available at the UK Data Archive.
4.1 User engagement
We conduct an annual questionnaire review to ensure that the data we collect meets the needs of our users with the minimal possible burden for our data providers.
We seek proposals for changes to the questionnaire for the upcoming reporting year from our providers in the form of a survey. This enables us to understand which questions could be clearer and identify any real-life scenarios where the questions are tricky to answer. We also seek broader feedback on the ease of use of the data collection platform and any other suggestions for improvement.
We also engage with our policy and operational end users within MHCLG and its Arms’ Length Bodies. Where new topics of interest arise, we first consider whether CORE is the most appropriate vehicle for collection (e.g. is case level information really required) and only then consider adding questions or response categories to the questionnaire. Where data is no longer required for policy monitoring we remove the question.
Proposals are discussed at CLIP-H, a forum for central and local government officials to discuss data collections related to housing. Proposals must be approved by CLIP-H and go through a new burdens assessment (if additional burden is generated) before they can be implemented.
Throughout the year we maintain regular contact with our data providers via both mass communication and individual helpdesk tickets. We have a continuously running customer satisfaction survey, available from the data collection service.
We also maintain regular contact with our policy end users, the Regulator for Social Housing and, when appropriate, engage with cross-government groups such as the GSS Housing Statistics Working Group.
5. Data protection and confidentiality
Since the introduction of the General Data Protection Requirements (GDPR) on 25 May 2018 updates have been made to how data are submitted into the CORE system:
-
Data sharing agreement – all CORE data providers must sign a formal data sharing agreement with MHCLG;
-
CORE data protection officer – all CORE data providers must set up a CORE data protection officer on the CORE system to electronically sign the data sharing agreement on behalf of their organisation;
-
Privacy notice – a new CORE privacy notice must be made available to all new social housing tenants when their data are collected which informs tenants why their data is being collected, how it is used and how their confidentiality is protected.
All of these steps must be taken for an organisation to submit data into CORE. This ensures that tenants are informed of how their data will be used and that it is being processed securely.
Our disclosure policy is applied to all internal and external uses of the data, including this statistical release and accompanying products.
Case level data sets are available to researchers and the public through the UK Data Archive via one of three types of licence agreement with different levels of data protection to meet different user needs whilst maintaining tenant confidentiality in line with legislation.
The Department shares case level data with a small number of other governmental bodies, e.g. the Regulator for Social Housing, as detailed in our privacy notice. All aspects of data protection legislation are followed, including ensuring legal justification, minimising the number of data items shared, and putting appropriate processes in place for sharing and storing the data.
6. Revisions policy
This policy has been developed in accordance with the UK Statistics Authority Code of Practice for Official Statistics and the Department‘s Revisions Policy:
-
Non-scheduled revisions: These are where a substantial error has occurred as a result of the compilation, imputation or dissemination process. Revised products are released as soon as is practicable, alongside an explanatory note on both the cause and impact of the error. Data are clearly indicated in tables as ‘provisional’ (P) or ‘revised’ (R).
-
Scheduled revisions: Providers cannot retrospectively submit or revise data after the close down deadline date for the re-porting year. The only scheduled revision is to the weights, currently based on provisional LAHS data, once the final LAHS data are published. Revised weights and estimates are made in the subsequent release in the historic tables.
For example, 2021/22 weights were revised after the publication of final LAHS 2021/22 data in summer 2022. The summary tables published as part of the 2023/24 Social Housing Lettings release use the revised weights for the 2022/23 figures in the time series tables.
7. Related statistics
7.1 Social housing sales data
The Department’s Social Housing Sales and Demolitions in England statistical series utilises data collected through CORE for sales of self-contained dwellings and re-sales of any part-owned dwellings (shared ownership) from private registered providers. They are available from Social housing sales (including Right to Buy and transfers).
7.2 Housing stock in England
The Department publishes annual live tables on housing stock and vacancies by tenure at Live tables on dwelling stock (including vacants).
7.3 Private registered provider social housing
The Regulator for Social Housing in England, the separate statutory regulatory body, publishes its annual Statistical Data Return (SDR) including the total number of social and affordable lettings and stock, is based on data collected from private registered providers. They are available from Private registered provider social housing stock and rents in England 2023 to 2024.
7.4 Local authority housing social housing
The Department’s annual Local Authority Housing Statistics (LAHS) data return reports on a wide range of housing related data including total dwellings, lettings and vacant stock, waiting lists, rents, and condition of stock[footnote 3] , available from Local authority housing data.
7.5 English Housing Survey (EHS)
The Department’s annual English Housing Survey (EHS) providing information on the quality and quantity of both social and non-social stock in England based upon a sample of households is at English Housing Survey.
7.6 Homelessness
The Department’s statistics relating to homelessness include quarterly Statutory Homelessness and the annual Rough Sleeping in England, both available from Homelessness statistics.
7.7 Devolved administrations
The devolved administrations of the UK produce and publish their own social housing lettings and sales statistics. These data are not published alongside the England statistics in this release because there are not directly comparable figures across the country due to differences in data collection methodologies and policies.
Wales
Scotland
Northern Ireland
8. User engagement
Users are encouraged to provide feedback on how these statistics are used and how well they meet user needs. Comments on any issues relating to this statistical release are welcomed and encouraged. For this year any views on the rent burden methodology change are particularly welcomed. Please contact [email protected].
9. Enquiries
Media enquiries:
Office hours: 0303 444 1209
Email: [email protected]
Public or statistical enquiries:
Email: [email protected]
10. Footnotes
-
Accredited official statistics are called National Statistics in the Statistics and Registration Service Act 2007’. Further details can be found on the Office for Statistics Regulation website. ↩
-
Prior to 2011/12 much of this information was collected through the department’s Housing Strategy Statistical Appendix (HSSA). ↩