Category Archives: Dissemination

OP4RE in New Tank Exclusif

Category : Dissemination

Silvester Draaijer and Daniel Haven comment on online proctoring of remote examinations, as a tool for long-term change and the OP4RE-project in News Tank Exclusif.

The Erasmus+OP4RE research project is dedicated to studying the deployment of remote examination monitoring solutions. “This European consortium makes it possible to move the boundaries: we create documentation on practices for institutions and the professionals concerned.”

Silvester frames the origin of the project. “OP4RE is an Erasmus+ project which started in 2016. Its objective is to use technological advances to improve citizens’ access to higher education and to seek to modernise education and training. In this sense, remote monitoring of exams helps to improve access to a wide variety of targets for existing and potential students, by providing them with opportunities to study from a distance and take their exams from a distance. This is the concept of “any time, anywhere” for taking  an exam.”

Proctor Exam was involved in this project from the beginning. Other members, forming the strategic board of this project, are, : the Free University of Amsterdam, the Erasmus University of Rotterdam, University of Hertfordshire, Hasselt University, Fontys University of Applied Sciences, Wilhelm Büchner University of Applied Sciences, FIED (Fédération interuniversitaire d’enseignement à distance), in addition to 20 Associate Partners from across Europe.

The project is still in the experimental stage. Several countries are developing initiatives on the subject to meet a need that is identified and awaiting a response.

Daniel Haven states: “Quite clearly, the countries with the most advanced markets are those where a company offering a remote test monitoring service is located. We see this with the example of the Netherlands, but it is also the case with Spain, which has Smowl. A company that is present works the market, informs it of trends and pursues a communication logic to support the structuring of the offer. In France, it is a little different, it is the FIED that plays this role.”

ProctorExam is the only Edtech company that is a strategic partner of the European consortium OP4RE. It’s Daniel’s opinion that the market is facing the need to build its long-term vision to take into account digital transformation.

It costs 10€ to have a supervisor supervise one hour of a student’s exam. Therefore, justifying your investment for mass use is difficult. Don’t you think that remote monitoring of exams is destined to remain in a niche market? Silvester Draaijer: “This is a question that was raised in our working group, even if OP4RE does not have the  solution to answer this problem in the immediate future, because it also depends on market players.”

What about fraud? In Silvester Draaijer’s opinion, remote monitoring of exams is more fraud-resistant than traditional monitoring, due to the control process itself.  The simultaneous recording of the various video channels, including that of the student’s computer screen, makes it possible to ensure that the candidate’s activity is recorded during and after the test.

A potential barrier concerns confidentiality in the processing of personal data. This is the subject of the group’s working seminar in Paris, on 05/10/2018. “Remote monitoring creates the processing of personal and sensitive data that must be analysed and monitored. It is in this sense that we will work with these specialists in the subject, who themselves are in contact with the Cnil. Imagine all the scenarios used to define the processing operations. We also invited a consultant from PricewaterhouseCoopers, who specializes in data legislation. The work on impact assessments under the DGPS should make it possible to standardise practices in the European Union, bearing in mind that we must also take into account certain legal provisions that are specific to each Member State because of the margin left since the entry into law of the European Regulation.

Another working issue for OP4RE concerns data transit situations between countries within and outside the EU, or with students from outside Europe. At the moment, we must imagine all the possible scenarios of use in order to define the approach to take  as precisely as possible.”

Within the European consortium it is possible to develop new boundaries and to create documentation on practices for institutions and the professionals concerned.


OP4RE presentations on conferences

Category : Dissemination

  • Daniel Haven (ProctorExam) presented on 25 October at the TesLA conference on e-assessment market trends.
  • Silvester Draaijer and Sabine Bottin presented the OP4RE project at the LERU Online Blended Learning Conference of 9 November 2018.
  • For the upcoming international Technology Enhanced Assessment conference 2018 (TEA2018), the OP4RE project had four successful submissions. The first submission is a practice poster by Gwendoline Somers and Silvester Draaijer about Coping with students’ anxiety and concerns when using online proctoring for the first time. The second submission is a practice poster by Silvester Draaijer, Arno Lodder, Jessica Hrudey and Youssef Fouad ‘A lawful basis for online proctoring’. Further a practice paper by Amanda Jefferies, Karen Barton, Andrew Pyper, Jonathan Meere, Amanda Yip, Stilianos Vidalis and Sulanie Peramunagama ‘Support online distance learners taking assessments: reviewing the options for remote invigilation’. Finally, a study by Nicolette van Halem, Chris van Klaveren and Ilja Cornelisz about barriers using online proctoring was accepted. We believe that the experiments that are conducted as part of the OP4RE project are gradually resulting in valuable outcomes for the wider scientific and practice assessment community.
  • On the 27th  LEARNTEC (https://www.learntec.de/en/) conferene Michael Fuchs (WBUAS) will present the OP4RE topic. Topic: Rechtssichere Online-Prüfungen zu Hause, in English: Legally compliant online exams at home.


Workshop at the NVAO peer learning event

Category : Dissemination

Risbo is invited by the NVAO (the Dutch Flemish Accreditation Organisation) to provide a workshop on Online Proctoring at the Peer learning Event in Antwerp on Monday November 12th 2018. Present will be about 30 policy staff from the Netherlands and Flanders, the perfect audience to present our OP4RE project and ask for feedback. In the workshop the following issues are discussed with the audience:

  • Which EU and national privacy legislation applies to online exam makers and surveillance institutions?
  • Are more safety procedures required for an online exam compared to a regular exam?
  • Which accreditation frameworks are there for online learning and assessment?
  • What are the most practical procedures to promote the accreditation of online assessment?
  • For which target group does online surveillance offer a practical, valuable solution?
  • What do educational institutions need to do to increase the accessibility and ease of use of online proctoring?

 


Online proctoring approved by German Aviation Authorities

Category : Dissemination

The German Aviation Authorities approved using a type of online proctoring for assessments. The ProctorExam platform is the first to be approved.

More information on this topic:

  • https://proctorexam.com/partnership-inked-proctorexam-copteruni/
  • https://www.dein-drohnenpilot.de/erste-online-pruefung-fuer-den-drohnenfuehrerschein/
  • https://www.drones-magazin.de/news/copteruni-zertifiziert/
  • https://www.interempresas.net/Tecnologia-aulas/Articulos/222068-La-Escuela-de-Aviacion-alemana-CopterUni-firma-una-alianza-con-ProctorExam.html

 


Newsletter 9

Category : Dissemination

Following our third transnational meeting in Paris, we provide you with an update on the OP4RE project.

Dissemination and output

For the upcoming international Technology Enhanced Assessment conference 2018 (TEA2018), the OP4RE project had four successful submissions. The first submission is a practice poster by Gwendoline Somers and Silvester Draaijer about Coping with students’ anxiety and concerns when using online proctoring for the first time. The second submission is a practice poster by Silvester Draaijer, Arno Lodder, Jessica Hrudey and Youssef Fouad ‘A lawful basis for online proctoring’. Further a practice paper by Amanda Jefferies, Karen Barton, Andrew Pyper, Jonathan Meere, Amanda Yip, Stilianos Vidalis and Sulanie Peramunagama ‘Support online distance learners taking assessments: reviewing the options for remote invigilation’. Finally, a study by Nicolette van Halem, Chris van Klaveren and Ilja Cornelisz about barriers using online proctoring was accepted. We believe that the experiments that are conducted as part of the OP4RE project are gradually resulting in valuable outcomes for the wider scientific and practice assessment community. You can still register for the TEA2018 conference.

Daniel Haven (ProctorExam) also presented on 25 October at the TesLA conference on e-assessment market trends. And lastly, Silvester Draaijer and Sabine Bottin will present the OP4RE project at the LERU Online Blended Learning Conference of 9 November 2018.

Next to these presentations and postersessions, Daniel Haven of ProctorExam and Silvester Draaijer were interviewed by the French online newssite NewsTank. In the interview they discussed the future of online proctoring in higher education, based on the experiences gained in the OP4RE project. The experimentations show that for a number of applications, online proctoring can gain a substantial share of ‘the market’ for examination in the upcoming 5 to 10 years. Though the technology actually already works, a relatively slow uptake will take place. This is because of the many cultural and organisational changes that are needed to accept and support this form of proctoring. Also, in the context of the EU, the complex and often ambiguous GDPR regulations with regards to special categories of data and specific legal exceptions. It will take time, development of practices (as is one of the goals of the OP4RE project) and recognition of practices to move forward. The article can be found here (behind subscription wall unfortunately).

Update on the intellectual outputs

The work carried out within the framework of IO3 on bring your own device, in the recent months has consisted of several actions. First, as part of the FIED network, the Universities of Caen Normandy and Sorbonne University continued to compare their remote monitoring approaches. This has led to several publications (at Presses Universitaires du Québec, EADTU conference, TEA2018 conference) and two presentations at the the Online, Open and Flexible Higher Education Conference, OOFHEC2018, in Aarhus 10-12 of october 2018. Secondly, a major safety certification work within the framework of the GDPR was carried out at Caen University and this work was shared with OP4RE partners during the transnational meeting in Paris. Finally, FIED is still in the process of discussing the establishment of a framework contract with the French company Managexam to provide simplified access to a remote test monitoring service for FIED members. The idea of making it easier for higher education institutions to experiment and access remote monitoring to improve the flexibility in their distance education.

The German Aviation Authorities approved using a type of online proctoring for assessments. This is interesting for the OP4RE project. It is a precedent in Germany for any government body using online proctoring (read more). In October the team of the Wilhelm Büchner University (IO 5 on privacy) conducted a second online proctoring experiment. The test simulated an exam with seven students. Two proctors monitored the exams online and in real time with the software of our project partner ProctorExam. The ProctorExam team provided technical support during the test. The online exams used were digital versions of real exams used at Wilhelm Büchner University.

The aim of the experiment was to test the use of the software in the live monitoring process under realistic conditions. In the long run, on site paper based exams and off site online exams should be made comparable, giving students the opportunity to choose between those two options.

Risbo, working on IO 1 about accreditation, is invited by the NVAO (the Dutch Flemish Accreditation Organisation) to provide a workshop on Online Proctoring at the Peer learning Event in Antwerp on Monday November 12th 2018. Present will be about 30 policy staff from the Netherlands and Flanders, the perfect audience to present our OP4RE project and ask for feedback. In the workshop the following issues are discussed with the audience:

  • Which EU and national privacy legislation applies to online exam makers and surveillance institutions?
  • Are more safety procedures required for an online exam compared to a regular exam?
  • Which accreditation frameworks are there for online learning and assessment?
  • What are the most practical procedures to promote the accreditation of online assessment?
  • For which target group does online surveillance offer a practical, valuable solution?
  • What do educational institutions need to do to increase the accessibility and ease of use of online proctoring?

Risbo has also started organizing various pilots. For example, they want to offer a mathematics test with online proctoring for international students, and they set up a pilot project regarding decentralized selection of students with the faculty of Medicine. In recent years, Erasmus MC organized the decentralized selection examinations for potential medical students from Aruba, Bonaire, Curacao, St. Eustatius, St. Maarten and Saba on the spot. Potential students from these islands came together at one place where the exam was taken on paper, under the supervision of employees of the Erasmus MC. In 2019, Erasmus MC and Risbo want to ensure that these examinations are taken with Online Proctoring.

Early in the 2017-18 academic year an initial discussion took place to determine the most likely scenarios for challenging the security of an online provider of proctoring between the OP4RE team member from the University of Hertfordshire Cybersecurity group and the ProctorExam Chief Technical Officer. They followed the approach known as the TAME methodology to assess cyber threats. As a result a set of scenarios was devised for the penetration testing of the ProctorExam systems which typified the kind of hacking which a student or their associate might make. The ProctorExam systems withheld the attack and none of the attempts were successful in hacking into the systems or delivering a Denial of Service.

The IO2 team have continued through to develop a set of the typical risks which online proctoring situations might be faced with during the taking of an assessment and in discussions with other teams we have proposed opportunities for mitigation. This area of our work is under wider discussion currently.


Save the date!!

Category : Dissemination

On the 28th of June 2019 the OP4RE project will organize a multiplier event at the University of Hertfordshire, UK. Interested to participate? Leave your contact details here.


Schedule Transnational Meeting 3

Category : Dissemination

A third Transnational meeting will be hosted by FIED on October 5th 2018 at the French Ministery of Higher Education. The floor plan of the ministery can be found here: Plan Ministère.

The schedule for the meeting is as follows:

05-10-2018
Location French Higher Education Ministery
25 Rue de la Montagne-Sainte-Genevieve, Paris
09:00 09:20 Greetings and coffee
09:20 09:30 Some words of greetings by DGESIP/MiPNES
(Mission pour la Pédagogie et le Numérique dans l’Enseignement Supérieur)
Marie-Françoise Crouzier
09:30 10:00 General information about the project plan, budget and working days Silvester Draaijer (VU)
10:00 10:10 Intellectual Output 1 Risbo B.V.
10:10 10:20 Intellectual Output 2 University of Hertfordshire
10:20 10:30 Intellectual Output 3 FIED
10:30 10:40 Intellectual Output 4 Vrije Universiteit Amsterdam
10:40 10:50 Intellectual Output 5 Wilhelm Büchner Hochschule
10:50 11:15 Upcoming dissemination + discuss Multiplier Event Gwendoline Somers (UHasselt)
University of Hertfordshire
11:15 11:30 Small break
11:30 12:30 Privacy/Security and discuss the current status of the Privacy Document Youssef Fouad (PWC)
Infhotep
Arno Lodder (VU)
12:30 14:30 Lunch
14:30 15:30 Privacy Impact Assessment – continued and Cross Border Flow of Information Youssef Fouad (PWC)
Infhotep
Arno Lodder (VU)
15:30 16:00 TeSLA, Voice Biometrics Solutions Silvester Draaijer (VU)
Whispeak
16:00 16:30 Final round of questions

 

Agenda Transnational Meeting 3 2018-10-05


Newsletter 8

Category : Dissemination

June 28th, 2018

The project is continuing in a steady pace. More and more proctored exams are being organised by the partners. We are gaining more experience which contributes to the development of guidelines, rulebooks etc.

In this regard, Fontys University of Applied Sciences developed an instruction video for students, to inform them about what it is like to take an online proctored exam, how it works, which data are recorded,… You’ll find this videos on our website. They conducted several small scale pilots (with a large scale pilot coming up, with over 100 participating students). One thing they have learned, is that it is essential to properly prepare students regarding what to expect and how the system operates. They have seen that this prevents a lot of possible issues and makes the experience much more relaxed for students, given that basically almost all their questions regarding the system have been answered before they start the ProctorExam procedure.

On Thursday April 12th, Silvester Draaijer and Robin van der Wiel presented the OP4RE project and the concept of online proctored exams to the VU University’s student panel. As an introduction to the topic, the students watched a video made by ProctorExam in order to understand how the system works. Students quickly started thinking critically about online proctoring and asked questions such as “is someone going to watch all of the video footage?”, “how is my video footage processed?” and “why are toilet breaks not allowed during the online proctored exam?”. Read more about this on our website.

At Hasselt University some new proctored exams were set up. Three students of Rehabilitation Sciences and Physiotherapy, on foreign internship, took one of their exams of the master programme via ProctorExam. For these students, taking a ProctorExam abroad provided both time- and financial savings. In addition, the master of Statistics organised a try-out exam via ProctorExam for one of their courses, both for on-campus as distance students. In this way they already gained a first experience with distance exams. Both groups were enthusiastic about the opportunities ProctorExam offers.

In previous Newsletters the OP4RE project announced to develop an online mathematics proficiency (eligibility) test in partnership with the Dutch e-learning company SOWISO. SOWISO developed the platform PassYourMath for this purpose. The offering of this test as a pilot has started at the beginning of May 2018. The development of this initiative shows that online proctoring serves the goal of increasing access to higher education well and shows the feasibility of the applied procedures and technologies. In the upcoming year the pilot will be scaled up. Interested in more?

The project partners from Risbo had a good meeting with the NVAO about online proctoring and accreditation. Continuing the previous conversations, in May the colleagues from Risbo met with NVAO (Accreditation Organisation of the Netherlands and Flanders) at the Erasmus University Rotterdam, the VU attended via Skype. The NVAO is interested in the developments in online education especially as the current shifts from within the field of education are challenging the existing approaches of the establishment principle and macro efficiency principles. Read more about this meeting on our website. 

In March 2018 the University of Hertfordshire project team, in the person of Dr. Stilianos Vidalis and his associates, set up the means to test the potential for illegal penetration of the ProctorExam website. During a 24 hour period, intense and persistent attempts were then made to access the ProctorExam servers illegally but no unauthorised access was possible, the denial of service attack was not successful and no information leakage was detected. Want to know more about this? Check our website.


Online proctoring at Hasselt University

Category : Dissemination

In the UHasselt magazine of June 2018, a short article was dedicated to online proctoring at Hasselt University.
This article describes the OP4RE project and briefly presents the state of affairs at Hasselt University.

Article only available in Dutch.

UHasselt Magazine, June 2018 (3).


OP4RE talks with NVAO about accreditation          

Category : Dissemination

Continuing our previous conversations, in May we met with NVAO (Accreditation Organisation of the Netherlands and Flanders) at the Erasmus University Rotterdam, the VU attended via Skype. The NVAO is interested in the developments in online education especially as the current shifts from within the field of education are challenging the existing approaches of the establishment principle and macro efficiency principles. Online education is still seen as an addition to campus-based education, this is legally defined by law. Fully online offered educational programs can in the meanwhile not be accredited. Even an online offered master program via MOOC the testing takes place on campus.

Creating change in the current approach to education is possible. In case there is sufficient support from educational institutes who are developing innovative initiatives, changes in the field of education can take place. New programs and courses are approved by commissions. The NVAO is involved in the case of the program, whereas with courses external commissions are involved such as Quanu. It is advisable to check the expertise of the commission connects the course content.

Further, there are conventions about developments in education on European level. In the course of this year a report from the ENQUA is likely to be published. For now, the NVAO suggests to check the TeSLA project for current developments in Europe.

Both Risbo and NVAO want to continue the pleasant cooperation continue these conversations about the current developments that are emerging form the educational field. Thus, OP4RE is invited for an e-learning day in November during which developments in online education will be discussed, the Dutch ministery is invited to attend.