Research Project: The changing global attitudes towards digital technology and high-stakes summative assessment
COVID has made a huge impact on the education systems across the globe, and numerous studies have been undertaken to understand how learning has been impacted, but until now, no research has been conducted to understand how COVID has changed assessment internationally. This is an opportunity for you to share your perspective and take part in a global research project.
National responses to assessment during the COVID pandemic have been mixed. A small number of countries were able to capitalize on their strong and positive position having already started pilots or programmes to move towards digital assessment. Other countries which relied mostly on paper-based approaches to assessment have found it harder to switch to digital technologies for assessment during the pandemic and have resorted to other models such as teacher assessed grading. We know this from various pockets of reporting and media coverage, but these stories are often shared by people outside of the assessment community such as the press or those critical of the education system. What is certainly not shared is how assessment will be handled going forward. Will countries go back to the old ways? Or will they embrace the new?
What is clear, is that the global assessment community needs to understand the full international picture and ask the question, Has COVID changed our attitudes towards moving to digital assessment?
To help understand the global situation, RM has launched a major research project with the support of the IAEA (International Association for Educational Assessment) to gather these global attitudes and to understand how the landscape has changed. Speaking about the project, Melanie Thomson from RM stated:
“We know from our work with awarding bodies and assessment organisations around the World that the drivers and challenges in the journey to moving from paper to digital assessment varies between countries. The impact that the Covid-19 pandemic had on education systems in many parts of the World has really changed the conversation around how we assess learners, particularly in a traditional exams context. At RM we want to understand the changing needs of the education and assessment markets we serve, and play an active role in helping our customers shape the future of assessment.”
By working with the IAEA on this project, RM and their research partners, Shift Insight, plan to produce a detailed and in-depth research report which provides a global perspective on the digital adoption landscape for high-stakes summative assessment. The information within the report could then be used by individuals across the globe to inform local policy and promote more international collaboration. Speaking about the IAEA’s contribution, Dennis Opposs stated:
“One of IAEA’s purposes is about international cooperation amongst educational assessment organisations. We always think it is helpful for educational assessment organisations to see if there’s something they can learn from people elsewhere in the World.”
During the IAEA’s 2021 online conference, there was significant interest in this topic, however, without the data to support the discussion, it was difficult to fully understand how the situation will progress over time. Talking about the 2021 IAEA Conference, Dennis observed:
“One of the sessions at that conference was about allowing participants to gain a greater understanding of how different examination organisations from around the world have dealt with the pandemic and how they plan to deal with similar events in the future. Not surprisingly the future of digital assessment was one of the issues that were raised at that session. RM’s survey is a really useful follow-up. It’s a great opportunity for the association’s members to take just a few minutes to contribute their views on digital assessment.”
Following on from this apparent need for the data, the project intends to gather as many perspectives as possible from across the globe via a survey and interview process. The research will look both at the measures employed during the pandemic and their success, as well as whether any national assessment programmes will see an increase in their use of digital technologies, and if not, why not?
Transformation is happening right now, with countries such as New Zealand already offering digital assessments for their NCEA exams . In the UK AQA has just announced plans to pilot adaptive digital assessment for GCSEs , it is hoped that this research will uncover similar projects elsewhere in the world and understand the motives and goals behind these projects.
Not all nations face the same challenges and opportunities, and therefore, it’s important to understand the direct and indirect barriers and benefits.
On the question of how the research will be shared, RM’s Melanie Thomson stated:
“RM will be publishing the research findings in full in a research report which will be shared openly with IAEA members and available online for the wider community to access too. We will also seek to present the insights from this research at relevant events and conferences during 2022, including the IAEA annual conference.”
With research projects that handle sensitive matters such as national education, individuals are often concerned about providing personal insights as their opinions may clash with political or institutional perspectives. By using a third-party professional research partner, RM, and the IAEA hope that people will be more willing to share their expert opinions.
On the subject of research methodology and anonymity, Lisa Mai, from Shift Insight stated:
“The survey is currently live. During the survey, respondents can indicate if they wish to take part in the follow-up interview stage. We want to reassure people that we only report on survey and interview findings on an aggregate level, and not on a case level. When including direct quotes from interviews, we make sure these are redacted so they contain no information that could make people identifiable.”
How to get involved
The research project including the survey and interviews started at the end of 2021 and will continue in early 2022. If you would like to get involved and share your views and experiences on the use of digital technology in assessment then please complete the survey, or email Lisa Mai: [email protected]
Watch Again – The 2021 Wrap Up – Exploring connections between cognitive enhancing drugs & online assessment with Dr Ellie Dommett
During this end-of-year wrap up, we heard from Dr. Ellie Dommett as she explored the connections between cognitive enhancing drugs and the increasing use of online assessment.
Following the presentation and Q&A, eAA CEO, Matt Wingfield, looked back at the highlights from 2021 and announced a series of exciting events coming to the assessment community in 2022.
Listen to the presentation
New podcast from the eAA series: Assessment and COVID-19, Episode 5, The Irreversible Direction of Travel with the British Council
Episode 5, The Irreversible Direction of Travel. Insights from the e-Assessment Association Community
In the fifth and final episode of a new podcast series by the eAA we welcome guests from the e-Assessment Association Community and discuss the impact of COVID-19.
eAA board member, Gareth A Hopkins from City & Guilds, interviews Steve Adams, Director Examinations East Asia Region, and Paul Muir, Head of Computer Based Testing (CBT), both from the British Council.
In this episode, Gareth explores the ripple effect of COVID-19, from its origins within China, it’s journey through the region, and how the British Council has responded to the challenges presented.
With his boots on the ground in East Asia, Steve Adams explains how from his base in Beijing, China, he and his team first heard of COVID-19 and watched it ripple through the region. Steve, provides an extremely useful insight into how the region has responded, which will provide invaluable information for assessment organisations elsewhere in the world who are preparing for the process of recovery. Listen and learn as Steve, discusses how his team adapted and started to prepare new policies for testing such as queue management, centre hygiene, disclaimers, social distancing, and refund policies for people that are not feeling well.
In addition, Paul provides a global perspective of the British Councils approach to e-assessment and high-stakes exam delivery and explains his views on how on-demand testing and remote invigilation will be able to help organisations going forward.
Also in this episode, Gareth, Steve, and Paul discuss the different cultures of testing across the globe including how AI is being embraced in the e-active region of East Asia.
You can hear more from Paul Muir at the e-Assessment Question Conference on June 30th at 11 am BST, during the session called ‘Assessment on a Global Scale’.
If you would like more information about the British Council’s New Directions Conference then please visit: https://www.britishcouncil.sg/new-directions