Scottish Funding Council logo

Outcomes Framework and Assurance Model FAQs

Register with us

Register with us to view a personalised homepage and to receive emails relating to your interests.

Register here

The Outcomes Framework (OF) and Assurance Model (AM) together comprise the revised approach to assurance and accountability. It has been developed in response to the recommendations in the SFC’s 2021 Review of Coherence and Sustainability.

Process and impact

Does SFC envisage that the new OF and AM will represent a reduction in burden for institutions?

One of our key priorities has been to design a system which gives us the assurance that we need, whilst reducing burden for institutions where we can. We believe that the new arrangements will be less burdensome because they make greater use of existing data and sources of information, and significantly reduce the requirement for written commentary from institutions. If there are improvements we can make, e.g. using different/new data sources that will help provide assurance, we can look at that. We will want to check with the sector that we are using the correct information, and we will review in the early years to check it is working as intended and reducing burden.

Is the new approach to assurance exclusively data-driven?

The new assurance model is data and insight led and is firmly based on continued engagement with institutions. This approach, which prioritises our relationships with institutions, will allow us to better contextualise data returns and to work with institutions to address any issues in a timely manner. We will continue to use an expert quality agency or other external/third-party equivalents to support our assurance.

How do you envisage navigating potential changes to strategic direction or reporting requirements in the future - for example, any new requirements flowing from the Scottish Government’s education reforms which remain ongoing?

The OF and AM are sufficiently flexible to absorb changes and we can build in other measures or data sets as necessary. If SFC’s duties or remit change, we may revisit the outcomes to ensure these are reflected appropriately but hope to keep these as fixed as possible to provide institutions with certainty and consistency about expected outcomes year-on-year. If we receive topical items of policy direction from ministers, we will try to deal with these through separate monitoring that is appropriate to the matters of interest rather than constantly changing the OF or the AM.

In most cases where SFC is removing requirements for written material (specifically, the OA or the self-evaluation) these are being replaced with "contextual commentary and thematic reviews". Can SFC provide reassurance that the commentaries and thematic reviews don't expand quickly to become an equivalent burden?

SFC received a strong steer from institutions that it is important to them to be able to continue to provide some context on their performance as part of the OF and AM. In doing so, SFC is committed to ensuring that the Contextual Commentary does not grow arms and legs and is not lengthy. It is our view that the commentary should provide concise context around the data that institutions submit within the monitoring returns and to frame this in the strategic context of the institution. The commentaries will not be published but may be discussed as part of SFC’s regular engagement with colleges and universities. Institutions will be required to submit their first Contextual Commentary in November 2025. SFC will work with sector groups in the coming year to determine the level of detail required, and whether there is demand for SFC to provide guidance or templates. Overall, our aim will be to ensure the Contextual Commentaries provide institutions with the opportunity to give appropriate context but do not become unnecessarily lengthy or burdensome.

Thematic Reviews will be introduced from 2025-26. We do not envisage that these will cover all outcomes every year. Our current expectation is that there will be no more than two to three Thematic Reviews each academic year. Thematic Reviews will be more likely to cover topical or emerging issues, or those which cross multiple Outcomes. They may also be used to examine those issues which may be better viewed over a longer timescale – perhaps on a three-year cycle, rather than an annual one.

Our intention is to involve the sector in deciding themes for review, and to develop in partnership with institutions a long-term programme for Thematic Reviews, so that colleges and universities can prepare to report on up-coming issues. As part of our commitment to streamlining our ask of institutions, we will work with sector groups (for example, Universities Scotland, Colleges Scotland and QAA) to ensure that the issues that SFC wishes to address do not duplicate with similar asks from other organisations.

We expect that some of the work on conducting Thematic Reviews will be carried out by SFC, but some may be commissioned to other organisations.

The AM requires institutions to retrospectively analyse their performance against the OF, instead of focussing on planned activity. How will this fit with the areas where SFC requires future-looking information, for example the need for universities to submit a Knowledge Exchange and Innovation Fund Strategy?

The OF and AM are designed to provide SFC with assurance that institutions have delivered on our core expectations. Therefore, the model shifts the balance to place greater emphasis on retrospective analysis of what has been delivered by institutions in support of the OF. However, there are some policy areas where SFC may need to continue to take account of the detail of institutions’ forward-looking strategies and planned activity. This applies to the Knowledge Exchange and Innovation Fund were strategies outlining priorities for KE&I that demonstrate alignment with Scottish Government national priorities form an important element of the model.

What consideration is given to SFC’s requirements of smaller institutions under the OF and AM?

The OF is largely drawn from SFC’s statutory duties and reflects our expectations in return for the significant funding that institutions receive. We have worked to remove duplication from the AM that underpins the OF and sought to streamline this where possible.  We will consider convening a group of Small Specialist Institutions going forward to hear how they will be impacted to enable us to take this into account as we work through the implementation of the AM.

SFC has stated that the monitoring process will pick up "emerging issues". What about using it to support institutions with emerging opportunities?

The engagement aspect of the AM will provide the space for institutions to discuss emerging opportunities with us.  Institutions have previously requested that SFC prioritises the preservation of core formula funding, particularly where we are operating within a constrained funding environment, and this reduces SFC’s ability to create reserve funds to provide bespoke additional financial support to institutions to embrace emerging opportunities. However, SFC may be able to provide support in other ways (such as the provision of guidance) which we would welcome discussing with institutions as these matters arise.

How will ‘dialogue between senior leadership of institutions and senior leadership of SFC’ fit with regular engagement with Outcome Managers?

SFC senior leadership engagement visits are just one aspect of SFC’s Engagement Strategy.  The purpose of the visits is to inform SFC’s understanding of the performance, strategy, risks, opportunities, and challenges facing an institution, as well as issues identified through recent routine engagement with the institution. The visits will enable discussion between the senior leadership and students of institutions and SFC’s executive team, regional lead, and the Outcome Manager, along with other SFC colleagues with expertise relevant to the meeting. The intention is that this dialogue will strengthen relationships, enhance our understanding of institutions, and provide an opportunity for institutions to demonstrate their impact and highlight the main issues which affect them. This will help SFC to take account of the nuance of individual institutions’ circumstances.  The visits will also support the SFC executive in understanding how the sector is performing at a regional and national level, ensuring that SFC is able to advise Scottish Government effectively on how funding is being used. SFC will work on a rolling programme of visits for its senior management team, which will take account of other visits (for example SFC Board visits) so that individual institutions are not over-burdened with visits.

SFC recommended the development of a National Impact Framework in its National Review. Is this recommendation being taken forward?

The National Impact Framework (NIF) was intended to cover the broader impacts of institutions and their contribution to Scotland. This has been covered (and superseded) by Scottish Government’s Purpose and Principles. The OF is largely drawn from SFC’s statutory duties, but if there are areas that institutions want to highlight to showcase impact, then we can work with Universities Scotland and Colleges Scotland to look at how this can be delivered.

The OF and AM Publication sets out a list of Interventions that SFC might make in relation to assurance. Is this a move towards a more regulatory role for SFC?

SFC is not a regulator of tertiary education. Our powers to intervene to address institutional performance flow from the Further and Higher Education (Scotland) Act 2005 (as amended, including by the Post-16 Education (Scotland) Act 2013).

The potential interventions listed in the publication are based on our existing practices and the approach we have always taken to working constructively with institutions as we seek to support them to address the issues they face. The new assurance model will see interventions continue to be used in a proportionate, targeted, and bespoke manner to best address the matters at hand. Our inclusion of these in the guidance note about the OF and AM is intended to increase transparency about how we work with institutions currently, which we envisage continuing into the future.

Student engagement

How have students been engaged in the development of this work so far, and how will they be engaged in the next steps?

The project has reported through the Skills, Enhancement, Access and Learning Committee which includes the NUS Scotland President.  We have addressed all the President’s comments which included the need to ensure student engagement is effective.  Policy teams, including policy teams that implement student engagement, have worked closely with us to develop outcomes and consider how best to monitor on an ongoing basis.  We will consider how best to engage students going forward.

How will SFC use student feedback on estates and infrastructure to prioritise funding for improvements?

SFC takes account of student feedback across a range of issues. This feedback may be used, in the round, to influence SFC’s funding decisions where relevant. In the case of investment in estates and infrastructure, student feedback would be considered in conjunction with a range of other factors, such as (but not limited to) information on the age and condition of estates and infrastructure, previous levels of investment in estates and infrastructure, backlog maintenance value, and other topical issues (for example, presence of Reinforced Autoclaved Aerated Concrete).

Governance arrangements

What are SFC's expectations about governance arrangements? Previously our OAs would be signed off by our Boards/Courts.

We will ask the sector what they think would be the best approach. We are currently considering sign-off through the Accountable Officer rather than by institutions’ Boards/Courts, and in this event would encourage the information is shared with Boards/Courts for their information. This question will be addressed through sector engagement about implementation over the next few months.

Data and measures

SFC has built up its internal business intelligence capability. Could the dashboards be shared with institutions so that we are all looking at the same data and commenting on the same data?

Yes, we want to do this. We will discuss this as part of our sector engagement about implementation of the AM.

Institutions will not need to provide data projections on their expected progress against outcomes, but their progress towards these measures will be monitored retrospectively. Will there be a ‘from’ and ‘to’ measure of performance and what is the baseline you are building from?

The interpretation of data returns will vary according to outcome area and the data being considered. We may set sector-level target measures for some outcomes, but it will not be appropriate to attach numeric targets and measures to sources of assurance that are qualitative. Whatever the source of assurance, assessment of institutional performance and decisions on SFC’s response to this will not be purely mechanistic: We will take into account the wider context as reflected in Contextual Commentaries and our ongoing programme of engagement with institutions. We will discuss with sector contacts the detail of assessing performance against each of the outcomes as we implement the AM.

Where SFC is using its core data sources (e.g. FES and HESA returns) to populate the dashboard and to assess institutions’ contribution to national outcomes, can SFC continue to produce technical guidance on the sources of information it is using, so that institutions can see how their progress is being assessed in relation to each outcome?

Yes, once we have shared our plans on the sources of data we will use, we can develop technical guidance on relevant numeric and data-based sources of information. We will discuss this as part of our sector engagement about implementation of the AM.

How will you translate the insight that you glean from the performance data into advice for the benefit of SG or other public bodies to support continuous improvement of the system as a whole?

As at present, SFC will do this in a number of ways. We will publish reports and analyses of sector-level performance in relation to the OF. With the permission of institutions, these may feature examples of particular activities that institutions are engaging in, as submitted through Case Studies and Thematic Work. In line with our role as a provider of Official Statistics and Accredited Official Statistics (previously National Statistics) covering Further and Higher Education in Scotland, we will continue to publish a series of statistical reports each year which may contain more detailed information on individual institutions. SFC will continue to use the information on institutional performance to inform engagement with and briefings for Scottish Government, and to feed into processes such as its Resource Spending Review. We may also share intelligence with other stakeholders, particularly those with whom we have Memoranda of Understanding or data sharing agreements in place.

Will there be cross-checking of contextual returns against data returns?

Yes, we will look at the contextual returns alongside the data to ensure that we take appropriate account of the context provided by institutions in understanding and interpreting the data.

(For Universities) Will the Assurance Model use data derived from the Early Statistics, the Early Access and Final Figures Returns, for as long as SFC requires these?

We will share our plans regarding the use of data and the timings of this through our sector engagement with institutions about the implementation of the AM.

Do you expect to ask institutions for supplementary data if there are issues with HESA Data Futures Student Returns?

SFC’s Early Statistics, Early Access, and Final Figures Returns will continue to run until in-year Data Futures Returns are introduced by Jisc. We may also continue to run these additional returns concurrently for a year or two until the Data Futures Returns are fully established, as a contingency measure. However, we will work with the sector on the detail of this when the time comes.

We do not plan to create supplementary sector-level data returns directly connected with the OF and AM. However, SFC may need to make additional data or ad-hoc data collections for other purposes, on specific areas of interest and concern. For example, in recent years we have collected additional information from universities around the recruitment of overseas students.

Where specific issues are identified with an individual institution’s Data Futures Student Return, SFC’s Data Collections Team may ask the institution to provide clarifications or, if necessary, supplementary data.

Could you explain how SFC uses Longitudinal Education Outcomes (LEO) data?

Longitudinal Education Outcomes (LEO) data is created and managed by the Scottish Government. SFC may use LEO data along with the other sources of data available to us on graduate destinations, to enhance our understanding on outcomes for university students after they have completed their studies.

How will SFC use HESA Data Futures? What is the planned approach for monitoring in future and assurances with regards to data quality and timings?

SFC wants its Assurance Model to be based on robust data. We will work with institutions to ensure data is used appropriately; this includes taking into account any challenges with the early submissions of the Data Futures model. We will be discussing with institutions in the coming months (a) the data to be used and (b) the timing of this, so that we have a shared understanding.

We rely on SFC to provide elements of data monitoring, particularly in relation to retention information. Will this continue to be supplied via the Report on Widening Access or equivalent?

SFC produces Official Statistics and Accredited Official Statistics (previously National Statistics) covering Further and Higher Education in Scotland. These support our work with colleges and universities to measure and improve performance across the sectors. We will continue to provide a variety of reports and analyses, such as the Report on Widening Access, as part of this work. We will engage with the sector on the implementation of the AM, and discuss with institutions the ways in which we will use the data held by SFC as part of the AM.

How will the knowledge exchange and innovation strategy relate to the measures in the Knowledge Exchange and Innovation Fund (KEIF)?

Timings

When should we expect more details on the timings relating to the Research Assurance and Accountability Return (RAAR) and the Self Evaluation and Action Plans (SEAPs) required under Scotland’s Tertiary Quality Enhancement Framework?

We published an announcement on the OF and AM on 6 June 2024 which describes how the RAAR and the SEAP will be key sources of information which will feed into the AM, without duplication. Guidance on the Research Assurance and Accountability Return was published on 13 June 2024. Guidance on Scotland’s Tertiary Quality Enhancement Framework and the SEAP is expected to be published in July 2024.

The proposed submission date for the Contextual Commentary (November 2025) is very similar to the Self Evaluation and Action Plan (SEAP) which will be required under Scotland’s Tertiary Quality Enhancement Framework – this could be seen as a burdensome time of year if asking for a lot of reflection at the same time?

We will discuss and agree timings of the Contextual Commentary in the coming months as part of our sector engagement about implementation of the AM. In the meantime, we note that the SEAP and Contextual Commentary relate to different outcomes in the OF and so it is likely that these will be prepared by different teams in institutions. However, we will test this assumption with institutions.

Contextual Commentaries

Are institutions free to frame the Contextual Commentary as they want? What if SFC fundamentally disagrees with the content, or sees a significant disconnect with performance in data – will institutions be asked to re-draft?

The Contextual Commentary is an opportunity for institutions to provide context around the data that they submit within the monitoring returns and to frame this in the strategic context of the institution. As it is not a document for publication, we would not anticipate that SFC will need to agree the content of the commentaries. If there is a disconnect between the information in the Contextual Commentary and the performance indicated by the data or other monitoring information, then this would be part of the discussions that SFC’s Outcome Managers will have through our regular engagement with institutions.

Could Contextual Commentaries be published as part of a response to a Freedom of Information request?

Contextual Commentaries are not intended for publication. However, all the information that SFC holds could potentially be released in response to Freedom of Information request.  As with all Freedom of Information requests, we would consider the public interest in determining what to release and would consider the application of allowable exemptions if appropriate (for example, in relation to personal or commercially sensitive information).

How much guidance will SFC give to the sector on Contextual Commentaries?

SFC will work with sector groups in the coming year to determine the level of guidance that institutions would like to receive, and whether there is demand for SFC to provide templates. Overall, our aim will be to ensure the Contextual Commentaries provide institutions with the opportunity to give appropriate context but do not become unnecessarily lengthy or burdensome.

Completion of 2023-24 Outcome Agreement process

What topics do institutions need to cover in their Self-Evaluations for 2023-24?

Colleges and universities should submit a short factual report of up to six pages of self-evaluation against the commitments made in the 2023-24 OA under the following headings:

  • Priority area 1: Fair access and transitions
  • Priority area 3: Coherent learning provision
  • Priority area 4: Work-based learning and skills
  • Priority area 5: Net zero and environmental sustainability response
  • Priority area 7 (Universities only): University Innovation Fund (UIF)

The self-evaluations should identify highlights and challenges from AY 2023-24 and identify any areas for improvement and consider outcomes for all learners. The reports should include:

  • Reflection on available statistical/performance data for AY 2023-24. For the year in question, audited statistical data will not yet be available so institutions should use their own data.
  • Reporting qualitative and quantitative progress, including specific reference to published milestones and commitments in the OA for AY 2023-24 across the priority areas (with the exception of the priority areas of learning and quality and research, as detailed below).
  • Reporting on early mitigations in place to address challenges moving forward into AY 2024-25.

Note that institutions do not need to provide a self-evaluation against the following headings:

  • Priority area 2: Quality learning and teaching (this will be covered by the SEAP).
  • Priority area 6 (Universities only): High-quality research and innovation (this will be covered by the RAAR).

Are the two case studies to be submitted to SFC in December 2024 essentially updates on the case studies that institutions already submitted in Autumn 2023 which related to AYs 2022-23 and 2023-24?

The case studies to be submitted will be expected to illustrate how funding provided during AY 2023-24 has been used by institutions. (In a similar way, most of the case studies submitted in Autumn 2023 related to how funding received during AY 2022-23 had been used.) Outcome Managers will discuss the submission of Case Studies in more detail with institutions.

Scotland’s Tertiary Quality Enhancement Framework (TQEF)

FAQs in relation to the TQEF

For FAQs in relation to the TQEF, please refer to the TQEF’s own published FAQs on our website.

Further feedback, and engagement re implementation of OF and AM

How can we feedback once we have considered the announcement and details of the OF and AM?

The OF has been agreed and is in effect from 1 August 2024 – it reflects SFC’s statutory duties as well as outcomes that well-run institutions will be delivering anyway. We will review this after the first year to ensure that it is working as intended.

Over the next few months, we will be engaging with the sector on the detailed implementation of the AM. As during 2023, we will engage through:

  • Colleges Scotland and College CDN Networks
  • Universities Scotland and its policy groups, and the University Planners Forum

We encourage institutions to get involved with the engagement sessions.

You can also share any comments with the project team directly (Sarah Kirkpatrick, email: skirkpatrick@sfc.ac.uk, Cath Carr: email: ccarr@sfc.ac.uk) or through Outcome Managers.

 

SFC Strategic Plan 2022-27

Building a connected, agile, sustainable tertiary education and research system for Scotland.

Register with us

Register with us to receive emails relating to your interests.