Oxford | Customer Stories

About the University of Oxford

The University of Oxford has been nationally and internationally recognised for its reputation in research and teaching excellence. It was ranked first in the world in the Times Higher Education (THE) World University Rankings for 2017, 2018 and 2019. There are nearly 24,000 students enrolled in its graduate and postgraduate programmes, 43% of which are international students.

The Medical Sciences Division of the University of Oxford is an internationally recognised centre of excellence for biomedical and clinical research and teaching, and it is the largest of the four academic divisions within the University. In 2019, the Medical Sciences Division was ranked first in the world for medicine (clinical, pre-clinical, and health) in THE World University Rankings.

Why

The Medical Sciences Division of the University of Oxford started the collaboration with Inspera in 2018, and the first trial was conducted in April the same year.

Inspera Assessment offers a large variety of question types, which incorporate tools such as images, equations, audio and video. The medical sciences assessments were to be designed with answer options that ensured students understood why they were selecting that particular answer, as the team of teachers wanted to test the depth of understanding, rather than simply knowledge recall.

A question bank (a database of all the available online assessment questions for a subject) supports the examiners' job of setting questions. The academic staff responded positively to both the functionality and design offered by Inspera Assessment.

In addition, a research and development (R&D) team at Inspera worked closely with the Oxford Medical Sciences Division to advance the learning analytics tools available in the platform.

How

During the spring of 2018, trials conducted at the Medical Sciences Division revealed a functional gap that was essential for the integrity and improvement of the divisions’ end-of-term examinations. The gap was related to the lack of instant reports on student marks (fine-grained distribution) and of distractor analysis to support decision making by academic staff.

Inspera established that there was a very good match between the Inspera Assessment product roadmap and the reports required. Therefore, Inspera took this requirement into the product roadmap with no cost to the Medical Sciences Division. An Inspera team that included a project manager, two R&D team members, and DevOps resources, worked together with the division in a compressed project to meet deadlines imposed by the exam schedule.

Inspera and the Medical Sciences Division’s team agreed on a testing phase and initiated the migration of data needed to perform the agreed objective computer-marked assessments in 2019.

The reporting functionality was released in the summer of 2018. The code base for this feature has now been generalised so that its benefits are also available to other customers in closed beta, making it part of Inspera’s analytics offering.

The Results

Over the past fifteen years, the Medical Sciences Division of the University of Oxford has built up expertise in designing and delivering objective computer-marked assessments (largely multiple-choice). From early on, the goal was to improve marking objectivity, the availability of questions, and assessment times. Every year, the Medical Sciences Division of the University of Oxford runs more than 160 online assessments for over 17,000 participants.

When entering into partnership with Inspera in 2018, the division requested and helped develop a new analytics feature. The feedback from both teachers and students has been positive. The journey towards full implementation of online assessment is an ongoing process with far-reaching ambitions for the University of Oxford.

Looking Ahead

The Digital Education Strategy consultation with academic staff and students has identified increasing interest in trialling the use of technology for assessments. In 2017-18, the University of Oxford undertook a small-scale trial of e-exams, based on formative exams. The e-exams phase 2 has been reviewed and approved by the Education IT Board, and the Project Initiation Documentation has now been passed to the IT Committee for further consideration. If funded, the phase 2 trial will build up the university’s expertise and confidence in running e-exams. It will have a particular focus on scale when a large number of students sit for collections exams at the same time.

In the meantime, the Medical Sciences Division continues to expand the number of departments using online assessment and is trialling online essay questions in Summer 2020.

Learn more about how progressive universities in the UK have adopted digital assessment: