How we will evaluate our plan

Institute of Social Innovation and Impact (ISII) leads the independent evaluation of our Plan. Experienced researchers ensure a robust evaluation cycle. We use a Theory of Change to assess impact across the student lifecycle, identify improvement areas, and uncover hidden needs. This approach integrates data collection, evaluation, and reporting, fostering knowledge sharing and responsive interventions.

Reflecting on our OfS self-assessment, we consistently use two types of evaluation per TASO’s classification:

1. Type 1 (narrative): Research based on existing APP literature and our evaluation results, placing interventions within a theoretical framework.
2. Type 2 (empirical enquiry): Pre and post surveys for spotlight activities, supported by qualitative data and thematic analysis of semi-structured interviews.

In the past year, we’ve moved towards Type 3 (causality) evaluation, using longitudinal quantitative data to rigorously assess impacts. We’re enhancing student engagement and using tools like our postcode calculator and HEAT to track Widening Access activities. We gather data from HESA, OfS, and internal sources, using surveys and interviews to understand student experiences and improve our strategies. Our continuous reflection and development of evaluation methods ensure we meet our APP objectives.

The OfS self-assessment tool highlighted the need for stronger dissemination. We aim to share findings more clearly with our community, supporting staff through research and journal contributions, and our annual APP conference. We strive to build an evaluation culture that enhances internal knowledge and contributes to the national APP context.

We also need to ensure evaluation findings inform decision-making and future interventions. This involves integrating evidence into initiatives and making it accessible to stakeholders via our APP Steering Group and Learning and Teaching Enhancement Hub.

To engage our whole provider approach, we will:

1. Ensure evaluation findings are integrated into our APP governance structure, with leadership accountability.
2. Continuously improve evaluation by engaging working groups for institutional scrutiny.

We complete two annual Evaluation reports to help us continue to make the right decisions surrounding the support we offer our students, they are:

• The Financial Support Package review
• Annual APP evaluation