As with any new service that uses individuals’ data to draw conclusions, it’s important to be transparent on what’s under the bonnet and explain how results are generated.
Life-changing decisions could be made on the suggestions generated, and by explaining the data science we want to make sure Clearing Plus justifies the trust that will be placed in it, and reassure both students and admissions teams that UCAS will be closely monitoring how it works in practice.
How it works
From early July, those not holding an offer or place can see their individual list of matched courses in Track (their online UCAS account) by clicking a button. From there, they can easily send an expression of interest to their chosen universities. After a conversation, the student can decide whether to officially add them to their application. As ever, admissions teams have the final say over who they admit onto their courses.
Clearing Plus works by suggesting courses to students that are typically favoured by similar applicants, and that they are eligible for.
Two critical factors are involved:
- Available courses and a university’s own recruitment criteria.
- A match score of students and courses based on historical acceptances.
The first of these is very simple to imagine. University of X wants to recruit to their physics course, and therefore submits physics to Clearing Plus, stipulating that it is only visible to applicants with a confirmed A level grade B in maths. They will then receive the details of all unplaced applicants who have clicked on their course to register interest. Applicants won’t see the course if they don’t have the required B (or higher) grade, so admissions teams can have confidence in those registering interest. This means that the applicant’s achieved regulated grade is used, as it would be in any other year.
Participation and relevancy
The widening participation opportunities are obvious. Admissions teams can also choose to use POLAR and SIMD as part of their criteria to effectively reach underrepresented applicants, helping them achieve a diverse student population, and support this important agenda for all of us working in higher education.
The second of these is slightly harder to conceptualise and is commonly referred to as ‘the algorithm’. The output of the algorithm is a match score (between 0 and 1) representing the relevancy of each course to an applicant. It informs the order that available courses will be displayed to each student – a good match would be top of the list.
The match score is derived from the following pieces of information:
- The grade/subject profile of the applicant at Level 3 or equivalent (to begin with A levels, BTECs, Scottish Highers, Access to HE Diplomas, and International Baccalaureates will be used, which will be expanded in the future).
- Any of the applicant’s main scheme course choices.
These pieces of information are used to create a ‘cluster’ which groups a student with peers of similar characteristics from previous cycles, so the historical outcomes of ‘people like them’ can be seen. We’ve been asked if the algorithm allows for ‘mixed qualifications’, which it does as its the combination of qualifications used to create the applicant cluster. For example, if a student with both A level and BTEC grades enters Clearing, they will see the most strongly related courses that have a good record of accepting their combination (or one very similar to it).
Alongside this, every course has been grouped into ‘course clusters’ using the same pieces of information:
- The proportion of applicants with each grade/subject profile at Level 3.
- The proportion of applicants with specific other applications in the main scheme.
Each combination of applicant cluster and course cluster has a match score. This means each individual applicant and specific course also has a match score. The advantage of clusters is that relevant recommendations can be made without attempting to exactly replicate previous cycles. Pertinent links can be made that may not have been thought of before because the data can show that “people like you were accepted to courses like this”.
Courses are grouped with other courses with a similar intake in the profile of students (regardless of the size of university or college). The match score is also agnostic of the number of applicants, with the likelihood of similar applicants being offered and accepting a place a key factor in the matching process.
We are naturally aware of the questions people have about algorithms and the bias they can introduce or perpetuate. Clearing Plus could be seen as reinforcing existing patterns of acceptances, such as men being more likely to choose STEM subjects. However, by basing matches on clusters of students who have been previously placed on courses, using factors mentioned earlier (e.g. grades and not sex), students will discover courses which may not have been on their radar in the past, but are qualified to succeed on. With all parts of the admissions process, we’ll be monitoring, measuring, and reporting on how Clearing Plus works to expand student choice.
This matching process is more in line with other online services and industry standards that applicants are used to in their daily lives, but crucially is one that could have the most impact on their lives to date, setting them up for their step into higher education, and possibly future careers.
This article is published in association with UCAS.