Skip to main content
Mayor of London logo London Assembly logo
Home

MD2633 AEB Data Publication and Purchase of EMSI Data

Key information

Decision type: Mayor

Reference code: MD2633

Date signed:

Decision by: Sadiq Khan, Mayor of London

Executive summary

The following request for Mayoral Decision (MD) covers:

1. Adult Education Budget (AEB) Data Publication: The GLA will publish quarterly a range of data about its AEB programme in order to ensure transparency, engage stakeholders, bridge information gaps to support a more strategic approach to skills provision, and support learners and employers to make more informed decisions.

As data producers, a structured institutional sign-off process is being proposed to guarantee the highest statistical and research standards. The process will comprise the joint work of the GLA Economics team and the Skills & Employment Unit, relying heavily on the pillars of the UK Code of Practice for Statistics.

This decision briefly describes the content of the AEB data publications and seeks approval for the approach that will be taken each quarter to produce these statistics.

2. Purchasing of Economic Modelling Specialist International (EMSI) job posting data: Job postings data provide unique information about the demand for skills in London. EMSI gathers millions of job postings created by employers. Therefore, it is more granular than traditional Labour Market Information, offering details about the labour market with virtually no time lag (an advantage compared to official statistics).

This data would support the GLA monitoring of the labour market and the GLA’s skills and employment policy in response to COVID-19.

Decision

That the Mayor approves:

• the overarching principles of the quarterly AEB data publication, including the range of data to be published each quarter and the process for informing the relevant parties ahead of each publication;

• expenditure of £20,000 to purchase jobs posting data from ESMI; and

• an exemption from the requirement of the GLA’s Contracts and Funding Code to procure such supplies competitively.

Part 1: Non-confidential facts and advice

This Mayoral Decision (MD) seeks approval for: the publishing Adult Education Budget (AEB) quarterly data and the proposed clearance process prior to the data publication; the purchase of EMSI jobs posting data; and a related exemption from the requirement of the GLA’s Contracts and Funding Code (“Code”) to procure such supplies competitively.

Adult Education Budget data publication

General

From 1 August 2019, the Secretary of State for Education delegated responsibility for the commissioning, delivery and management of London’s AEB to the Mayor.

In early 2020, the AEB Mayoral Board agreed that AEB programme data should be published following the Department for Education’s Further Education and Skills data publication and in line with the UK Code of Practice for Official Statistics (which the GLA has signed up to on a voluntary basis).

A comprehensive list of proposed data to publish at London, Sub-Regional and Borough level is included at Appendix B. The data publication tables in the appendix were approved by the AEB Mayoral Board in February 2020.

The AEB quarterly data publication will cover a range of data on participation, achievements and spend, broken down across a range of metrics, including Mayoral areas of interest. Sub-Regional and Borough tables will be also provided, although these may include slightly less detail in order to protect individuals’ identities.

The data publication will be accompanied by a short descriptive note that assists in interpreting the statistics and highlights any key points and data limitations.

Some of the headline estimates from the data publication will also form the basis of the Skills & Employment Unit Dashboard monitoring of the AEB.

Additional information, including further detail on the types of data to be published, is publicly available in the AEB Mayoral Board report “Adult Education Budget Data Publication and Dashboard Key Performance Indicators”.

Data sources

In terms of data sources, the GLA receives rich administrative data, the Individualised Learner Records (ILR). The ILR is an on-going, nationally specified collection of data about learners and the learning undertaken by them from providers.

The GLA, DfE and Education and Skills Funding Agency (ESFA) maintain a Data Sharing Agreement (DSA) permitting the monthly transfer of AEB delivery data collected by providers in the Individualised Learner Record (ILR).

The GLA as a data producer

The GLA will produce and publish data following the UK Statistical Code of Practice (to which it has voluntarily signed up).

The production of data tables will involve a strict quality assurance process (broadly set out in Appendix A) to ensure the highest statistical and research standards. The procedure will comprise the joint work of the GLA Economics team and the Skills & Employment Unit.

Ahead of publication, the GLA will provide a four week notice of data they will publish in line with the Code of Practice for Statistics.

Once the data tables and associated narrative are ready for publication, the following process will be followed to inform the relevant parties ahead of publication and in line with the DSA:

• outputs will be shared (for information purposes only) with the AEB Mayoral Board and a restricted list of relevant GLA officers. This would usually take place between 24 to 48 hours prior to publication;
• in addition, data tables and other outputs may be shared as necessary with the DfE in advance to discuss any issues/concerns prior to publication; and
• following publication, the data and associated narrative will be reported formally back to the AEB Mayoral Board and Skills for Londoners Programmes Board at the next formal meeting.

Under the delegation arrangements for the AEB programme, the Mayor is required to consider all AEB decisions personally and cannot delegate under the usual thresholds. This decision is designed to agree the overarching principles of the data publication, including the range of data to be published each quarter and the process for informing the relevant parties ahead of the publication. The production of the data tables in itself is considered an operational matter, and, therefore, while the AEB Mayoral Board will be informed of the data to be published ahead of the publication date wherever possible, it is not considered that a formal decision is required each quarter ahead of the publication.

First and subsequent publications

The first GLA publication, including London level figures only, has been delayed from May to 12 June 2020 due to the COVID-19 crisis. This mid-point academic year delayed publication has been approved by the GLA’s Chief Statistician, currently the Demography and Policy Analysis Manager and pre-announced in the official channel.

A more complete set of statistics, including sub-regional and Borough figures, is expected to be published in the subsequent quarterly releases i.e. starting from the ILR data return “R10” (i.e. third quarter 2019/20 academic year) onwards.
Purchasing of Economic Modelling Specialist International (EMSI) job postings data

The COVID-19 crisis is a fast-evolving situation, and the economic impact is not yet fully observed in official statistics that are usually published with a two-month time lag. Therefore, to enhance our ability to understand the key developments in the labour market and to implement a rapid response, it is important that the GLA Economics team have access to real time data.

Job postings data provide information about the demand for skills in London. It gathers millions of job postings created by employers. Therefore, it is more granular than traditional Labour Market Information, providing details about the labour market (e.g. specific skills requested by employers) with virtually no time lag.

Approval to purchase job posting data from EMSI is being sought via MD as it will be funded by the AEB administrative budget and therefore the usual delegation thresholds do not apply.

It is proposed that the purchase is made without competing the contracting opportunity. Section 9 of the GLA’s Contracts and Funding Code requires where the expected value of a contract for supplies is between £10,000 and £150,000, that the supplies required should be procured competitively. However, Section 10 provides that an exemption from this requirement may be approved where there is a complete absence of competition for the supplies in question. Officers are of the opinion that this is case for the reasons set out in sections 1.22 to 1.24 below.

Having researched the availability of online jobs postings data (including through discussions with central Government departments), officers identified three potential sources/suppliers. One was discarded on quality grounds, with issues of duplication. The other two (EMSI and Burning Glass) are considered similar quality, matched closely to official statistics.

Officers have had access to Burning Glass data in the past and therefore have a good knowledge of their offer. For the EMSI data, officers attended a seminar on the data and did some research into the product having also explored it in relation to the COVID-19 impact dashboard. EMSI job postings data is collected from a range of different company sites, major job boards, and staffing agencies. In a typical month, EMSI aggregates between 0.8 and 1 million job postings across Great Britain. These postings are then de-duplicated to avoid overstating the demand for a particular job and measure how long the posting is live for and the ratio of duplicates as a measure of recruiting effort. This can then be filtered by to a local level.

Although of very similar quality, the quote for EMSI data offered much greater value for money. As such, EMSI data currently supersedes its two competitors on either quality or price. Consequently, an exemption from the Contracts and Funding Code is sought. The contract will be for one year only to allow for a re-review of the products on the market.

The GLA aims to acquire the data as soon as possible, as research teams will be monitoring the labour market on an ongoing basis to support the GLA’s skills and employment policy in response to COVID-19.

Adult Education Budget data publication

The proposed process is aimed to ensure the GLA acts in accordance with the UK Code of Practice for Statistics and our DSA with the DfE. Specifically, it is aimed at ensuring:

• there are sufficient data assurances in place, which are needed to produce timely, accurate and reliable data;
• public confidence that the data has been objectively and independently handled;
• safe, controlled and limited pre-publication sharing of the data (with the AEB Mayoral Board and relevant senior management having one day advanced oversight of the data outputs); and
• transparent adjustments, such as decisions to delay pre-planned publications (e.g. in the context of unforeseen circumstances) or to issue corrections, can be optimally taken at the senior management level in line with the UK Code of Practice for Statistics.

In terms of outputs, the GLA will publish AEB data as soon as possible after the DfE has published national/regional statistics. As mentioned above, the GLA will provide data listed at London levels and, whenever possible, at Sub-Regional and Borough level, subject to disclosure controls.

Purchasing of EMSI job postings data

With the EMSI job posting data, research teams will be able to identify, in a timelier manner, turning points in the labour market. This should support more informed policy and decision making around employment, skills and related issues.

Publication of data on participation and achievement of learners with protected characteristics observed in the ILR under the Equality Act will ensure clarity regarding their engagement with the Mayor’s AEB programme and could help highlight any policy changes that may be needed to support their achievement.

Additionally, in line with Section 149(1) of the Equality Act 2010 the analysis of EMSI real-time labour market data will help the GLA to identify groups that have been disproportionally affected by COVID-19 and produce policies that:

• eliminate discrimination, harassment, victimisation and any other conduct that is prohibited by or under the Equality Act 2010; and
• advance equality of opportunity between persons who share a relevant protected characteristic and persons who do not share it.

Links to Mayoral strategies

The need for timely and robust labour market data is critical to the implementation of the commitments made in the Mayor’s Skills for Londoners Strategy, to:

• empower all Londoners to access the education and skills to participate in society and progress in education and work;
• meet the needs of London’s economy and employers, now and in the future; and
• deliver a strategic city-wide technical skills and adult education offer.

Risks arising/mitigation related to the AEB data publication

The GLA has reached agreement with the DfE to publish the tables intended.

The ILR, from which this data will be published, contains sensitive personal data. Any extracts published from it must be compliant with General Data Protection Regulation (GDPR) legislation from 2018. The quantity of data that is being published quarterly makes this a large and complex task given that each publication is an independent product that needs its own quality assurance process, comprising several stages described in Appendix A. It is worth noting that implementing disclosure controls may limit the publication of some of the tables.

Ensuring protection of commercially sensitive data could also prevent some of the proposed data being published.

Contingencies, such as delays due unforeseen circumstances, or any potential changes to the AEB data publication process will be implemented following sections T1-T6, Q1-Q3 and V1-V5 of the aforementioned Code of Practice.

Other

There are no conflicts of interest to declare from those involved in the drafting or clearance of this decision.

The AEB Mayoral Board endorsed the data publication proposals at its meeting on 19 February 2020. A draft of this MD was also circulated to the Board for endorsement in May 2020.

Approval is being sought to publish data about the AEB programme on a quarterly basis; the publication of which has no direct financial implications.

Approval is also sought for expenditure of £20,000 to purchase EMSI job posting data which provides details about the labour market with virtually no time lag.

The expenditure of £20,000 to purchase the data will be contained within the overall AEB 2020/21 administrative budget. Any additional costs that might arise will be contained within the ring fenced AEB and will be subject to further approval.

Section 39A of the Greater London Authority Act 1999 permits the delegation of ministerial functions to the Mayor, subject to certain limitations and conditions. This forms the basis of the delegation to the Mayor of AEB functions from the Secretary of State for Education. A particular limitation of the delegation is that the usual power of delegation by the Mayor is not available in respect of s39A delegated functions.

In taking the decisions requested, the Mayor must have due regard to the Public Sector Equality Duty; namely the need to eliminate discrimination, harassment, victimisation and any other conduct prohibited by the Equality Act 2010, and to advance equality of opportunity and foster good relations between persons who share a relevant protected characteristic (race, disability, sex, age, sexual orientation, religion or belief, pregnancy and maternity and gender reassignment) and persons who do not share it (section 149 of the Equality Act 2010). To this end, the Mayor should have particular regard to section 3 (above) of this report.

Section 9.1 of the GLA’s Contracts and Funding Code (the ‘Code’) requires that supplies with a value of that concerned here should be procured competitively. However, the Mayor may approve an exemption from this requirement under section 10 of the Code upon certain specified grounds. One of those grounds is that a contract may let without competition where there is a complete absence of competition for the supplies in question. Officers have indicated that this ground applies and that the proposed contract affords value for money. On this basis the Mayor may approve the proposed exemption if satisfied with the content of this report.

In the event that the Mayor makes the decisions sought, officers must ensure that a contract is entered into and executed by the GLA and EMSI before the purchase of the supplies.

Activity

Timeline

AEB Data Publication

Quarterly. First release on 12 June 2020 (delayed from May due to COVID-19).

Subsequently, it is expected that data will be published on the following timetable each year:

  • July / August
  • November / December
  • January / February
  • March / April

The exact dates will be announced a month in advance.

Purchasing of EMSI jobs posting data

May 2020

Signed decision document

MD2633 AEB data publication and EMSI data - SIGNED

Supporting documents

Need a document on this page in an accessible format?

If you use assistive technology (such as a screen reader) and need a version of a PDF or other document on this page in a more accessible format, please get in touch via our online form and tell us which format you need.

It will also help us if you tell us which assistive technology you use. We’ll consider your request and get back to you in 5 working days.