Photo / Supplied
By John Gerritsen, of RNZ
The Qualifications Authority is considering using computer systems to monitor students for possible cheating while they sit online NCEA exams.
It says the artificial intelligence systems could make it easier for small schools to offer exams.
Universities used the systems, also known as artificial proctors, for some of their online exams last month with varying degrees of success.
The Qualifications Authority's deputy chief executive of digital assessment transformation, Andrea Gray, said it looked at options for online oversight earlier this year.
"There are systems that record screen activity and there are systems that record physical activity, so a student's movements and what's happening in the environment, and some do both, but there are also real-time monitoring systems and those which set up an exception report, so 'that student moved at 4.03, here have a look at it'," she said.
Gray said online oversight could be especially helpful for kura kaupapa Māori.
She said the schools sometimes could not meet NZQA's requirements for providing supervisors or storing exam papers securely, so their students had to sit their exams at the nearest secondary school.
"The opportunity with remote supervision is that the human supervisor can be supported by the digital tools to have a digital exam being run from a kura and that means those students can sit their exams where they're in a familiar environment."
The deputy tumuaki of Te Runanga Nui o Ngā Kura Kaupapa Māori and tumuaki of Te Kura Kaupapa Māori o Ngā Mokopuna in Whanganui-a-Tara (Wellington), Rawiri Wright, said he would be discussing online oversight this week.
He said it appeared to be a good idea for kura and their students.
"We at Ngā Mokopuna, we would certainly welcome that because our number one examination centre is in the city and that's going to mean that we don't have to transport students to and from, we'll be able to do everything on-site, it'll be a lot more comfortable for the students," he said.
"For remote kura, they're going to jump at the opportunity because some of them have to travel quite significant distances to get to an examination centre."
The Qualifications Authority said 20 English-medium schools and 50 kura had to work with other schools because they were not registered as exam centres. It said 16 kura were exam centres.
It said decisions on whether a school or kura could become an exam centre were based on candidate numbers, proximity to another centre and whether they had the infrastructure to support an exam.
Feedback will be sought
Gray said the Qualifications Authority wanted to talk next year with students about what they thought about online oversight.
"We plan to talk with Māori and Pacific students in particular about what would make that an acceptable and reasonable experience, having remote supervision supported by a person. We're also looking at trialling some tools to see how they work in practice," she said.
"We need to understand what it feels like if you're a student with a machine checking what you're doing. I think that's going to be something that some students will respond very well too, other students may feel anxious about and so if they feel anxious we would have to then think about what we would put in place to make that viable."
Gray said the authority would also talk with universities and professional bodies that had used online oversight.
Universities use systems
Victoria University tested an online system in nine Commerce exams but ran into technical problems, while at Massey University 1200 students completed more than 1880 exams under the virtual eye of an online oversight system.
Massey University said: "Six cases were tagged as possible integrity matters requiring further investigations. They were assessed by the university's Academic Integrity Officers and not all of them were determined to be integrity violations," it said.
"The university commissioned an evaluation of staff and students' experiences following these exams and there was a high level of confidence in the support we provided prior, to ensure both staff and students were familiar with the extra proctoring steps."
Meanwhile, Gray said the Qualifications Authority was not planning to do away with human supervisors.
"There's a number of dimensions as to why there's a human supervisor there. At the moment in the paper-based exams it's partly about checking that they're not breaching the exam rules, but there's also a pastoral care component to that and at the moment we do not envisage reducing that pastoral care component," she said.
NZME snares crown for the second year in a row.
Comments