Primary tabs

The four stages of using evaluation for inclusive change

By kiera.obrien , 17 November, 2026
Staff conversations can reveal what participation figures miss. Here is how universities can use collaborative evaluation to understand inclusive practice, identify barriers and inform change
Article type
Article
Main text

University staff are working under competing pressures. Teaching, assessment, administration and student support leave limited time to reflect on practice. Institutions want staff to make education more inclusive but the resources, working conditions and recognition needed to support that ambition can vary across departments.

This creates a challenge for evaluation. How do we know whether an inclusion initiative is making a difference? Metrics, workshop attendance and resource downloads can show engagement but they tell us less about what colleagues have changed, whose experiences have improved or why an approach works in one setting but struggles in another.

Evaluation can help institutions understand this gap. Designed as a collaborative process evaluation, focusing on people as well as metrics gives staff opportunities to examine practice, identify what supports change and inform decisions about what happens next.

At our university, we explored this through a formative evaluation of “Pathways to inclusion”, an inclusive education practice guide. The guide provided a starting point for discussions with academic and professional services staff. Those discussions extended to wider questions about workload, institutional culture, professional learning and how meaningful progress should be recognised.

What gets missed when we measure activity alone

Participants valued practical guidance, examples from colleagues and opportunities to engage flexibly. They also identified barriers that could limit the movement from understanding inclusion to putting it into practice:

  • Time and workload: Staff need opportunities to reflect, adapt materials and review the effects of changes. Access to guidance does not create that time.
  • Different roles and contexts: Colleagues need to see how inclusive practice relates to their responsibilities. A shared institutional resource might require different routes through it for different users.
  • Cognitive load: Complex concepts, lengthy content and difficult navigation can make professional learning harder to fit into an already demanding working day.
  • Fear of getting inclusion wrong: Uncertainty can make colleagues hesitant to ask questions or try an unfamiliar approach. Staff need opportunities to discuss difficulties without judgement.
  • Institutional processes: Inclusive practice is harder to sustain when it sits outside the routines through which teaching is reviewed, supported and recognised.

These findings point to the need to evaluate both practice and the conditions that make it possible. Otherwise, an institution risks asking staff to demonstrate progress without understanding what enables them to act.

Using evaluation to understand and inform change

We combined appreciative inquiry, developed by researchers David Cooperrider and Suresh Srivastva, with a realist evaluation lens, informed by academics Ray Pawson and Nick Tilley.

Appreciative inquiry begins with existing strengths and invites participants to imagine how those strengths could support improvement. A realist lens draws attention to context: what helps an approach work, for whom and under what conditions.

Together, these approaches allowed us to explore what staff valued while also examining structural barriers. Academic and professional services colleagues took part in online workshops, co-facilitated by an academic developer and an evaluator. Participants contributed through collaborative digital whiteboards, and we anonymised and analysed their contributions for themes.

The workshops followed four stages: discovery, dream, design and destiny. They offer a practical structure that other institutions can adapt.

1. Discover what already works

Ask participants for specific examples of useful resources, conversations or practices. Follow up with questions about why they helped and what made them possible.

In our evaluation, staff valued practical relevance, interactive navigation and examples from colleagues. Understanding these strengths helped identify what should be retained when improving provision.

2. Imagine what better practice would look like

Invite colleagues to describe what would make inclusive practice easier to understand and apply. Keep the discussion close to everyday work.

Our participants suggested clearer pathways for different roles, more varied formats and simpler navigation. These suggestions showed how the design of professional learning could better acknowledge staff time and cognitive effort.

3. Identify what would enable change

Move from ideas to the support needed to put them into practice. Ask which changes a team could make and which require wider institutional decisions.

Participants recommended connecting inclusive practice with programme review and validation, appraisal and promotion, alongside training and tailored support. These proposals helped embed inclusion within established processes and made it sustainable.

4. Agree how progress could be recognised

Ask participants what evidence would convince them that practice was changing. Consider what different forms of evidence can tell you.

Staff highlighted personal accounts of change, peer learning, curriculum redesign and recognition of inclusive practice. They also questioned how confidently changes in institutional metrics could be attributed to one resource. These discussions helped clarify the limits of the evidence as well as its value.

Creating the conditions for helpful evaluation

Evaluation should use shared understandings to bring about meaningful change. Institutions can support this through practical steps:

  • Explain the purpose: Make clear how contributions will inform improvement, how they will be used and how confidentiality will be handled.
  • Include different perspectives: Bring together colleagues across roles, disciplines and career stages. Pay attention to whose experiences are missing.
  • Allow uncertainty: Invite questions, unfinished ideas and examples of approaches that did not work as expected. Avoid making polished success stories the only acceptable contribution.
  • Connect findings to responsibility: Identify who can act on a resource problem, a development need or a structural barrier. Allocate ownership and time for agreed actions.
  • Return to participants: Explain what has changed, what remains unresolved and when progress will be reviewed. This makes the connection between participation and action visible.

Practical do-now ideas for teams

Choose one existing inclusion activity and ask colleagues three questions: what has it helped you do? What has made it difficult to act? What would help next?

Collect a few concrete examples, then look for recurring barriers and differences between contexts. Agree on one action within the team’s control and one issue that needs wider institutional attention. Set a date to revisit both.

Our evaluation captured staff perspectives; these should inform further work alongside student experiences and other evidence of change.

Inclusive education depends on everyday decisions, relationships and institutional support. Evaluation can make these visible and help colleagues understand where effort is producing change and where additional support is needed.

For a large university, this means looking beyond participation and metrics to examine how practice develops across different settings. Used in this way, evaluation becomes a recurring opportunity to listen, learn and make better decisions about inclusion.

Vanessa Mar-Molinero is senior teaching fellow in academic practice and Naomi Clements is senior teaching fellow in academic practice (education), both at the University of Southampton.

If you would like advice and insight from academics and university staff delivered direct to your inbox each week, sign up for the Campus newsletter.

Standfirst
Staff conversations can reveal what participation figures miss. Here is how universities can use collaborative evaluation to understand inclusive practice, identify barriers and inform change

comment