Background quality report: Finance and economics annual statistical bulletin: MOD regional expenditure with UK industry and commerce and supported employment 2017/18
Published 31 January 2019
1. Introduction
1.1 Overview
These statistics present information on MOD expenditure with UK industry and commerce in 2017/18, with some comparisons made to previous financial years. This information is analysed by both region and industry group.
Using this expenditure data, employment data from the Business Register and Employment Survey (BRES) and turnover data from the Annual Business Survey (ABS) (both of which we received from the Office for National Statistics (ONS)), we have calculated an estimate of the number of jobs supported by MOD expenditure with UK industry. Similarly, this information has been presented by both region and industry group.
For further context, the expenditure information has been presented per person, to take into account the population of the different regions. The number of supported jobs has also been presented per 100,000 people in full-time equivalent (FTE) employment, again to adjust for different regional populations and also different employment levels. This makes the figures between regions more directly comparable to one another.
In addition we have accounted for inflation by quoting comparisons over time only in terms of 2017/18 constant prices. This means that we have used the GDP Deflators from the ONS to calculate how much expenditure in previous years would be worth in 2017/18. This allows for more valuable comparisons between expenditure in different financial years.
1.2 Background and Context
Figures on regional MOD expenditure were published annually by the MOD up until 2009 in the UK Defence Statistics publication. The MOD resumed publication of these figures in March 2017 to help with the monitoring of various commitments, such as the Prosperity agenda set out in the Strategic Defence and Security Review (SDSR) 2015.
Many improvements have been made to the old methodology that have led to a more accurate estimate of MOD expenditure with UK industry. This includes expenditure that was previously attributed to the UK now being correctly apportioned overseas. We also have more precise information on the location of expenditure within the UK, and the industries that it is spent in. For more information on these changes see the section below on Methodology and Production and this Statistical Notice.
There have been some on-going data quality issues arising from the introduction of the new Contracting, Purchasing and Finance (CP&F) online end to end procurement system in 2016/17. Some issues arose in the accounting processes which resulted in an additional £300 million in unpaid invoices at the end of 2016/17. That expenditure was instead reported in 2017/18 dataset used in last year’s report. Going forward there are no further issues expected due to unpaid invoices.
Expenditure in 2017/18 was also affected by a restructuring of Defence Science and Technology Laboratory (Dstl). Dstl ceased to be a Trading Fund in April 2017 and are therefore no longer paid through contracts processed by DBS Finance Systems and are instead funded through the central MOD budget through which it continues to run its own financial activities. This will have resulted in a substantial payment being excluded from the 2017/18 expenditure total (MOD paid £590 million to Dstl in 2015/16 and £560 million in 2016/17). This exclusion will certainly offset any increase seen from the unpaid invoices appearing in 2017/18 expenditure and as such the increase in current prices from the previous year should be viewed as a true increase in MOD expenditure with UK industry. For further details on comparability of this publication with previous versions refer to Coherence and Comparability.
1.3 Methodology and Production
Expenditure information against headquarter (HQ) contracts recorded on the MOD contract payment system and Miscellaneous contract expenditure were used to calculate total MOD expenditure for each financial year. Further detail on HQ and Miscellaneous contracts can be found in the Trade, Industry and Contracts background quality report. The higher value contracts were then cleansed to ensure that Standard Industrial Classification (SIC) codes and Location of Work (LOW) codes were as accurate as possible. Overseas expenditure was identified, where possible, and removed. LOW codes were used to break the expenditure down by UK region and SIC codes were used to break it down by industry group.
Mid-Year regional population figures were taken from the ONS website. These were used to produce figures on MOD expenditure with UK industry, per person for each region. This was achieved by dividing the regional expenditure by the population of the area to see how much money was spent for each person living in that region. This gives the expenditure figures some context and allows comparisons across different regions to be drawn more easily.
Using employment data from the BRES and turnover data from the ABS we were able to calculate turnover per FTE employment for each financial year. By dividing our figures for MOD expenditure with UK industry by these figures we can estimate how many jobs this expenditure supports in the UK. Again these figures are presented broken down by both region and industry group.
Using the employment data from the BRES we were able to calculate FTE employment for each region. We then used these figures to calculate how many jobs MOD expenditure supports for every 100,000 people in FTE employment in the region. This takes into account both the population of the area and the number of people in employment and therefore, like the per person expenditure figures, makes it easier to make comparisons across the different regions.
2017/18 saw the general production process enhanced by using an open-source programming language to automate large parts of the data processing. As well as reducing production time, the quality of the publication was improved and the process can be easily reproduced. Additional Quality Assurance actions were programmed into the data pipeline, reducing the scope for human error that was more likely to occur when doing the large volume of manual data manipulation that was previously required. This process has once again been used for 2017/18’s publication.
2. Relevance
Statistics on MOD expenditure with UK industry and the number of jobs that supports were published annually up until 2009. This publication was re-introduced in response to a request from the Secretary of State for Defence to begin producing these statistics again, which was supported by the Permanent Under Secretary in March 2016.
These statistics aid the measurement and monitoring of various regional expenditure and employment targets throughout the MOD, including those set out in the SDSR 2015.
The scope of the publication to meet user needs will continue to be reviewed based on feedback from users. The figures published here are more accurate than the previous figures published on the topic and enable comparison of MOD expenditure with UK industry across different regions and industry groups.
3. Accuracy
As mentioned in the Methodology and Production section, recent improvements have been made to the methodology to make the process more reproducible and have provided a more reliable estimate of MOD expenditure with UK industry. Automating the data process has led to an increase in accuracy of MOD expenditure estimates by reducing scope for human error. Accuracy has also been increased by excluding overseas expenditure that had been incorrectly included in previous editions. The result of reclassifying expenditure as UK or overseas has a knock-on effect for the way spend is apportioned to regions for contracts that do not have a LOW code.
However one key issue is that the majority of contracts still only have one SIC code associated with them. This is because when contracts were previously raised using a DEFFORM 57 only one SIC code could be entered. The vast majority of contracts will relate to multiple different industries, but due to the number of contracts raised in each financial year it would be impossible to follow up with all of the project teams to get an accurate SIC breakdown. Therefore we contact the project teams who own the larger contracts, such as those with AWE, NETMA and OCCAR and distribute these more accurately across a wider range of SIC groups.
In a previous edition of this bulletin presenting 2015/16’s financial data, payments from electronic Procurement Cards (ePC) were attributed as a single large payment in the North East of England. In subsequent bulletins this payment has been distributed across the locations of MOD personnel. We have further categorised electronic Procurement Cards into SIC Groups where known; and where not known we have categorised these payments into SIC groups according to the distribution of payments in HRMS and JPA (the MOD administration systems for Civilian and Military personnel respectively).
Issues in the commercial reporting processes in the new Contracting, Purchasing and Finance online purchasing and accounting system (CP&F) have led to a greater number of missing and incomplete fields in our data. A large volume of data cleansing has had to be carried out on the dataset. We are confident that the data have been cleansed to a sufficient standard for our analysis.
Various assumptions have had to be made throughout the process when concrete information was lacking. These assumptions are listed below:
- Any contracts that had locations of British Forces Post Offices, British Crown Dependencies and UK Overseas Territories were all treated as being expenditure outside the UK throughout the analysis.
- The small number of HQ contracts that we could not find accurate LOW information for were distributed across the regions based on the regional proportions seen for the rest of the HQ contracts.
- Likewise the small number of HQ contracts which we could not categorise into SIC groups have been distributed into SIC groups based on the proportions of other HQ contracts.
- SIC code information is entered when the contract is let. It is likely that in different years of the contract’s life that the SIC distribution will fluctuate as different phases of work are started and completed. We have no way to measure these changes however so we have used the same SIC distributions throughout the life of the whole contract.
- Miscellaneous contracts do not have any SIC code information associated with them. Therefore the Miscellaneous expenditure was assumed to have the same SIC distribution as the HQ contracts.
- Miscellaneous contracts also do not have LOW code information associated with them. Therefore Miscellaneous expenditure was distributed regionally using the bill paying postcode.
- NETMA location was also assumed to be wholly in the North West as the Typhoons are being constructed in Warton, Lancashire and we were unable to get hold of more precise information at this time.
- ePC payments were distributed across the location of MOD personnel, including overseas.
- ePC payments, where not explicitly known, were categorised into SIC groups according to the SIC categorisation of HRMS and JPA payments.
- Accurate location data was not available for DSG in 2013/14 and 2014/15; therefore the same locations that were used for DECA contracts were also used for DSG.
- Some contracts were country-wide. This expenditure was distributed regionally based on military strengths.
- Not all overseas HRMS expenditure can be identified, but what can be has been removed.
- Any JPA expenditure in GBP (£) was counted as being UK expenditure. Any payments in other currencies were excluded from the analysis as it was assumed that they were overseas.
- The number of jobs supported is also only an estimated figure. There is no concrete way of counting the number of jobs supported by MOD expenditure with UK industry. Instead we have taken the turnover per FTE employment in each industry group and divided our regional expenditure figures by this. This gives an estimate of how many jobs MOD expenditure supports in the UK.
- For some SIC groups either turnover data or employment data was not available due to suppression. In these cases data was estimated based on other available financial years (if similar SIC groups had consistent data across financial years). If a lot of variation was seen across financial years in a similar SIC group then the average turnover per FTE employment was applied here instead. Please contact us if you need information on which SIC groups were affected by this.
- BRES data was not available at the level we required it for Northern Ireland and therefore we had to use published figures from the UK Business Register and Employment Survey directly from the ONS website.
4. Timeliness and Punctuality
4.1 Timeliness
The publication uses data from 5 financial years; 2013/14 to 2017/18. While the contract information is first available in April, it is not possible to release the publication at that time, as the data must be cleansed and quality assured first. Data from the ONS on UK turnover is also not available until December, so the bulletin cannot be published before this time as the employment figures cannot be calculated until we have that data. Further analysis and quality assurance processes are then needed before the bulletin can be put together.
4.2 Punctuality
Release was preannounced for January 31st 2019 and this publication date was achieved.
The release date for this publication was pre-announced on the MOD’s Calendar of Upcoming Releases section of GOV.UK.
5. Accessibility and Clarity
5.1 Accessibility
The statistics can be accessed on the GOV.UK website and are available to download in HTML format. They can be found in the ‘Economics and Finance’ section. They can also be accessed by using an internet search engine.
All the tables and any data behind graphs and charts in the report are available here.
24 hour pre-release access to the report is available to a limited distribution list within the Ministry of Defence (MoD). The full list can be found in the Pre-Release access list available on the GOV.UK website.
Sources are provided for all of the data presented in the publication to allow users to contact the relevant team if they need further information.
5.2 Clarity
Commentary is provided in the publication to clearly discuss key facts and trends in the data and to clarify any complex points. It is also used to discuss the quality of the data and any assumptions made and to provide appropriate caveats.
Users who are interested in just the key findings can read the ‘Key points’ section at the start of the report which provides a list of the main points in the publication.
Graphics have been utilised throughout the publication to visually present key data. This is beneficial for those users who are not confident with statistics to aid their understanding and also allows users to understand the data more quickly than text alone. These graphics include bar charts to display the regional expenditure levels and the jobs that this supports and also to demonstrate the effects of inflation. There are also choropleth maps included to show regional expenditure per person and the number of jobs supported for every 100,000 people in FTE employment in the area.
Supplementary data tables are published alongside the bulletin for those users who wish to access the data presented in the publication themselves.
A brief description of methodological information is included in the publication, and on the relevant data tables, but a full methodology can be found in the Methodology and Production section of this Background Quality Report.
A glossary of key terms is included at the end of the publication to aid users understanding of specialist terms. If the terms are particularly vital to understanding the statistics then an explanation is included in a small glossary box on the page that the statistics are presented on.
6. Coherence and Comparability
6.1 Coherence
Figures were previously published by Defence Economics on MOD expenditure and the jobs that it supports in the UK Defence Statistics (UKDS) publication, but these were ceased in 2009. Figures presented in this bulletin are most comparable to the ‘Direct Employment from MOD expenditure’ figures quoted in the UKDS bulletin. There are however differences in the methodologies so the figures are not directly comparable.
The figures in the current publication should not be compared to the ‘Total Employment’ figures in UKDS because these include additional estimates of indirect employment and employment from defence exports, which the current figures do not.
6.2 Comparability
Throughout the bulletin we compare data across 5 different financial years. With a short time series these conclusions could be due to the inherent variability of contract data and not indicative of a long-term trend since we would expect total expenditure to fluctuate year on year due to the occurance of large payments. As such, any comparisons should be used with caution.
It should be noted also that prior to 2017/18, the total expenditure figure included direct MOD payments to Defence Science and Technology Laboratory (£590 million in 2015/16 and £560 million in 2016/17), as mentioned in the above section on Background and Context. This means that a substantial payment is excluded from expenditure totals in 2017/18 and beyond.
By breaking expenditure and supported employment down into NUTS 1 Regions comparisons can be made about different areas of the UK. While the variation in expenditure is still present at a regional and industrial level some comments about changes over time can be made here. If overall expenditure is going down in specific regions, or industries are showing a substantial rise, then this is more likely to be a significant observation.
The inclusion of expenditure per person and jobs supported per 100,000 people in FTE employment also makes the statistics more comparable across different regions. Without these measures, differences in the populations and employment levels of the regions could make it difficult to compare expenditure levels and jobs supported.
Where comments are made about variation across years at the regional and industrial level it is important to consider inflation. In simple terms, inflation measures how the cost of goods/services change over time. Inflation of 2% would mean that something that you could purchase for £1 last year would cost you £1.02 this year. Therefore, inflation can mask effects when comparing expenditure across different years. This is because you are comparing expenditure in one year against another where the value of the pound was different.
To account for this, expenditure can be calculated in constant prices. This accounts for inflation by adjusting expenditure in one year so that it is in another year’s prices. When the effect of inflation is removed the real increases and decreases in expenditure can be seen.
Throughout the publication, expenditure is presented in constant prices 2017/18 prices when comparing across different Financial Years. To access all of the data in both current and constant prices please see the supplementary data tables.
7. Trade-offs between Output Quality Components
We could produce the regional expenditure figures at a much lower level, for example by cities and towns rather than regions. This would however be a much more in-depth process that would take much longer. Moreover, the location of work (LOW) codes, used to determine where the work took place, don’t consistently provide coverage of the same sized area, making the level of granularity required for lower level analysis difficult. Therefore, the decision was made to present the figures at the regional level to allow a more timely publication.
8. Assessment of User Needs and Perceptions
The MOD has previously held consultation meetings with users of Defence Official Statistics, which provided a forum for user feedback on their needs and perceptions. Internal publication reviews have also taken place. Proposed changes were set out at the consultation meetings in order to gain feedback from both internal and external users.
The MOD invites users to provide feedback to the statistical output teams on any of their publications or reports using the contact information on the front and at the end of the publication.
9. Performance, Cost and Respondent Burden
The methodology for this bulletin has gone through streamlining processes to reduce the burden of production. Cleansing the data and calculating the figures is a time-consuming process, however doing it all at once for this bulletin saves time overall as we regularly get ad hoc requests for this sort of data. This publication uses many of the same data sources as the Trade, Industry and Contracts bulletin which saves time as this data is already collected. Turnover per FTE employment calculations are also carried out on our behalf by the ONS, this saves time as they are experts on this data and can produce the figures much faster than we can.
10. Confidentiality, Transparency and Security
In producing these statistics, we adhere to the Defence Statistics Confidentiality Policy. We adhere to the principles and protocols laid out in the Code of Practice for Official Statistics and comply with the pre-release access arrangements, The Defence Statistics Pre-Release Access lists are available on the GOV.UK website.
The expenditure figures in the data tables have been rounded to the nearest million pounds. This is because contract information is commercially sensitive and rounding has been employed as a measure of disclosure control. Expenditure per person have been rounded to the nearest £10, the number of jobs supported by MOD expenditure has been rounded to the nearest 1,000 with the number of jobs within particular regions and SIC Groups being rounded to the nearest 100, and the jobs supported per 100,000 FTE employment were rounded to the nearest 10, again as a measure of disclosure control.
11. References
- Statistics at MOD Homepage
- MOD’s Timetable of Future Releases of National and Official Statistics
- Statistical Notice
- ONS User Requested Data
- Defence Statistics Confidentiality Policy
- UK Code of Practice for Official Statistics
- Pre-Release List
- Glossary of Terms and Abbreviations
Note: The MOD is not responsible for the contents or reliability of the listed non-MOD web sites and does not necessary endorse the views expressed therein. Listings should not be taken as endorsement or any kind. We have no control over the availability of these sites. Users access them at their own risk. The information given was correct at the time of publication.
12. Contact Details
Defence Expenditure Analysis Head of Branch
Tel: 030 679 84442
Email: [email protected]
Defence Statistics (Defence Expenditure Analysis)
Ministry of Defence
Oak 0 West, #6028
MOD Abbey Wood North
Bristol
BS34 8QW
For general MOD enquiries, please call: 020 7218 9000