The case for collaborative purchasing of digital assessment technology

Higher education in the UK has a solid background in leveraging scale in purchasing digital content and licenses through Jisc. But when it comes to purchasing specific technology platforms higher education institutions have tended to go their own way, using distinct specifications tailored to their specific needs.

There are some benefits to this individualistic approach, otherwise it would not have become the status quo. But as the Universities UK taskforce on transformation and efficiency proclaims a “new era of collaboration” some of the long standing assumptions about what can work in a sharing economy are being dusted off and held up to the light to see if they still hold. Efficiency – including finding ways to realise new forms of value but with less overall resource input – is no longer a nice to have; it’s essential for the sector to remain sustainable.

At Jisc, licensing manager Hannah Lawrence is thinking about the ways that the sector’s digital services agency can build on existing approaches to collective procurement towards a more systematic collaboration, specifically, in her case, exploring ideas around a collaborative route to procurement for technology that supports assessment and feedback. Digital assessment is a compelling area for possible collaboration, partly because the operational challenges are fairly consistent between institutions – such as exam security, scalability, and accessibility – but also because of the shared pedagogical challenge of designing robust assessments that take account of the opportunities and risks of generative AI technology.

The potential value in collaboration isn’t just in cost savings – it’s also about working together to test and pilot approaches, and share insight and good practice. “Collaboration works best when it’s built on trust, not just transaction,” says Hannah. “We’re aiming to be transparent and open, respecting the diversity of the sector, and making collaboration sustainable by demonstrating real outcomes and upholding data handling standards and ethics.” Hannah predicts that it may take several years to develop an initial iteration of joint procurement mechanism, in collaboration with a selection of vendors, recognising that the approach could evolve over years to offer “best on class” products at a competitive price to institutions who participate in collective procurement approaches.

Reviewing the SIKTuation

One way of learning how to build this new collaborative approach is to look to international examples. In Norway, SIKT is the higher education sector’s shared services agency. SIKT started with developing a national student information system, and has subsequently rolled out, among other initiatives, national scientific and diploma archives, and a national higher education application system – and a national tender for digital assessment.

In its first iteration, when the technology for digital assessment was still evolving, three different vendors were appointed, but in the most recent version, SIKT appointed one single vendor – UNIwise – as the preferred supplier for digital assessment for all of Norwegian higher education. Universities in Norway are not required to follow the SIKT framework, of course, but there are significant advantages to doing so.

“Through collaboration we create a powerful lobby,” says Christian Moen Fjære, service manager at SIKT. “By procuring for 30,000 staff and 300,000 students we can have a stronger voice and influence with vendors on the product development roadmap – much more so than any individual university. We can also be collectively more effective in sharing insight across the network, like sample exam questions, for example.” SIKT does not hold views about how students should be taught, but as pedagogy and technology become increasingly intertwined, SIKT’s discussions with vendors are typically informed by pedagogical developments. Christian explains, “You need to know what you want pedagogically to create the specification for the technical solution – you need to think what is best for teaching and assessment and then we can think how to change software to reflect that.”

For vendors, it’s obviously great to be able to sell your product at scale in this way but there’s more to it than that – serving a critical mass of buyers gives vendors the confidence to invest in developing their product, knowing it will meet the needs of their customers. Products evolve in response to long-term sector need, rather than short-term sales goals.

SIKT can also flex its muscles in negotiating favourable terms with vendors, and use its expertise and experience to avoid pitfalls in negotiating contracts. A particularly pertinent example is on data sharing, both securing assurances of ethical and anonymous sharing of assessment data, and clarity about ultimate ownership of the data. Participants in the network can benefit from a shared data pool, but all need to be confident both that the data will be handled appropriately and that ultimately it belongs to them, not the vendor. “We have baked into the latest requirements the ability to claw back data – we didn’t have this before, stupid, right?” says Christian. “But you learn as the needs arise.”

Difference and competition

In the UK context, the sector needs reassurance that diversity will be accommodated – there’s a wariness of anything that looks like it might be a one-size-fits-all model. While the political culture in Norway is undoubtedly more collectivist than in the UK, Norwegian higher education institutions have distinct missions, and they still compete for prestige and to recruit the best students and staff.

SIKT acknowledges these differences through a detailed consultation process in the creation of national tenders – a “pre-project” on the list of requirements for any technology platform, followed by formal consultation on the final list, overseen by a steering group with diverse sector representation. But at the end of the day to realise the value of joining up, there does need to be some preparedness to compromise, or to put it another way, to find and build on areas of similarity rather than over-refining on what can often be minor differences. Having a coordinating body like SIKT convene the project helps to navigate these issues. And, of course, some institutions simply decide to go another way, and pay more for a more tailored product. There is nothing stopping them from doing so.

As far as SIKT is concerned, competition between institutions is best considered in the academic realm, in subjects and provision, as that is what benefits the student. For operations, collaboration is more likely to deliver the best results for both institutions and students. But SIKT remains agnostic about whether specific institutions have a different view. “We don’t at SIKT decide what counts as competitive or not,” says Christian. “Universities will decide for themselves whether they want to get involved in particular frameworks based on whether they see a competitive advantage or some other advantage from doing so.”

The medium term horizon for the UK sector, based on current discussions, is a much more networked approach to the purchase and utilisation of technology to support learning and teaching – though it’s worth noting that there is nothing stopping consortia of institutions getting together to negotiate a shared set of requirements with a particular vendor pending the development of national frameworks. There’s no reason to think the learning curve even needs to be especially steep – while some of the technical elements could require a bit of thinking through, the sector has a longstanding commitment to sharing and collaboration on high quality teaching and learning, and to some extent what’s being talked about right now is mostly about joining the dots between one domain and another.

This article is published in association with UNIwise. For further information about UNIwise and the opportunity to collaborate contact Tim Peers, Head of Partnerships.