Jury prize @ the FIED International colloquium

Category : Dissemination

At the FIED international colloquium held in Paris on 13 and 14 December 2017 the OP4RE project was presented at a round table discussion attended by Silvester Draaijer, Daniel Haven, Sabine Bottin-Rousseau and Pierre Beust.
It should also be noted that a video competition entitled “My innovation in distance learning” was organised prior to the colloquium, the prizes of which were awarded during the colloquium.
The experimentation of remote monitoring of home examinations carried out in Caen within the framework of OP4RE’s IO3 won the jury prize of this competition.
Watch the video here.

Update on IO 5: Privacy

Category : Dissemination

Outline of IO5 – Privacy

In order to be compliant with respect to privacy in international online proctored remote examinations, it is needed to have ‘lawyer proofed’, EU compliant contract templates, all kind of agreement forms and guidelines for examinees and tester. These templates are intended to be part of the Intellectual outputs of the OP4RE project, but also to convince all future relevant stakeholders, such as accreditation agencies and data protection officers of the value and legitimacy of online proctoring.

Current situation

The first step of the team responsible for IO5, which info (inside which documents) we need in order to fulfill our goals. Therefore two privacy impact assessments have been performed. The identified documents are risk acceptance forms, data classification and processing agreements, privacy policies. Furthermore guidelines and templates for legal notices, consent texts, and privacy statements are required.

The next step was to collect information from different sources, such as data protection experts, EU regulations, and already existing material from all OP4RE partners as best practice templates. Now, we are in the middle of the info consolidation phase.

Planning of year 2

The finalization of documents for review is followed by a fine tuning by all OP4RE partners. In parallel, the experiments with online proctoring at the various partners of the OP4RE project will be expanded.

Update on year 1 of IO3: Bring your own device/ off-campus examination protocol

Category : Dissemination

Pierre Beust & Sabine Bottin-Rousseau, of FIED (Fédération Interuniversitaire de l’Enseignement à Distance), wrote a report on the progress and the activities on IO3 about bring your own device and off-campus examination protocols.

An update on IO 4

Category : Dissemination

Last Wednesday 6 December 2017, the first large-scale experiment for an online proctored exam was conducted at the Vrije Universiteit Amsterdam. The goal of the study was to investigate to what extent students would successfully go through the stages of setting up the student computers at home and take a trial exam in light of optimizing the student experience.

The target group consisted of about 600 first year Bachelor students for a course in Statistics. The group was divided at random in two groups. Group one took the trial exam at the central exam hall of the university. Group two took the trial exam at home. The preliminary results of this experiment show that students prepare their hardware (computer, webcam, screen recording, microphone, mobile phone) at very late stages before the actual exam. For a number of students, this leads to problems during the log-in process of the proctoring session. As this number was quite high, it turned out that assisting these students by the VU proctors using the integrated chat-possibilities of the proctoring platform was difficult. Especially because in the tense and short period in which the exam could be started, communicating clearly, understanding the problem and provide solutions was not satisfactory for both students and proctors. The experiment showed that students need to be guided and urged in earlier stages to check all their equipment. Maybe guidelines should be developed in which the responsibility for a technical successful exam is transferred to the students at a certain stage before an actual exam. This experiment provided the OP4RE project already with important learning experiences  that will enable the design of fit-for-purpose guidelines and rulebooks.

Update on IO 1

Category : Dissemination

Imagine Bachelor and Master degrees being completed online. Envision students enrolled in online degree programs, taking validated assignments and exams from home or any other location of choice. Increasingly mobile and flexible online offered education asks for more flexible and off-campus examination procedures in the near future.

In the past months, Risbo has taken  steps towards this goal, by starting with collecting of information on current laws and regulations about (inter)national privacy, fraud and security. Meetings with experts in the field of education accreditation like the Dutch-Flemish Accreditation Organisation (NVAO), and the Privacy Officer at the Erasmus University Rotterdam- who is an expert on privacy, fraud and security – have well informed our research.

Early 2018 will start off with the actual testing of online assessment. Students will take proctored assignments and exams within MOOCs and within Educational Programmes. For these pilots, Risbo is excited to collaborate with the IHS and RSM who have both developed  MOOCs. Other departments at de Erasmus University have shown interest to collaborate as well. Eventually, these pilots contribute to the collective development of a guideline for educational institutions who are interested in online proctoring in the near future.

Risbo/Erasmus University Rotterdam is looking forward to the first outcomes and will keep you posted in the upcoming year!

IO2: An update on security and anti-fraud legislation protocols

Category : Dissemination

The work at the University of Hertfordshire has continued from the activities outlined in the annual report written for 2016-17 for IO2, with a focus on developing and refining a risk assessment document for online proctoring.

Currently the team is researching with a group of campus-based and trained proctors employed by our university with the aim of developing a set of guidelines for training online proctors. The team has designed a variety of methods for investigating proctoring approaches for invigilating online examinations. These are:

  1. Showing a ‘Record and Review’ scenario to a group of current proctors, followed by a guided discussion in a focus group to discuss the points they would raise as potentially suspicious behaviour from students. This was a largely reflective and qualitative study undertaken in August/September 2017
  2. A blended mixed methods approach using a campus-taught module with an online assessment is planned for early 2018. This will use a live student authentication session followed by a Record and Review mode for the assessment, with the same group of proctors retrospectively reviewing the process and identifying any potential ‘pinch points’.
  3. Thirdly, a complete ‘Live proctored’ session will be reviewed by our group of campus-trained proctors, this is planned for later in 2018.

Using recorded ‘live scenarios’ helps us to further understand what the trained and experienced invigilators/proctors in a campus-based situation are looking for when invigilating an assessment and thus where the threats to secure online assessment which is free of cheating might be.

White Paper: Privacy in Online Proctoring

Category : Dissemination

Youssef Fouad, legal adviser of ProctorExam on personal data protection, published a white paper about Privacy in Online Proctoring.

LERU 2017, Milan

Category : Dissemination

From 7-10 November 2017 Sabine Bottin-Rousseau attended the working group on e-learning of the LERU conference. She gave a presentation about the project and experiences at UPMC with online proctoring.

Newsletter 6

Category : Dissemination

Newsletter 6 – November 6th 2017

On October 2nd 2017 we organized our 2nd Transnational meeting at Wilhelm Büchner University of Applied Science (Darmstadt, Germany). It was a constructive meeting on which we discussed the past project year and our plan for the next year. In particular, we have seen that the first experiments with online proctoring were conducted with various degrees of success and that these results enable us to set-up more large scale experiments in the upcoming 2 years.

Some of our project members also went to conferences to present and talk about the OP4RE project. Silvester Draaijer presented on 9 October at the TEA 2017 Conference in Barcelona the paper “Online Proctoring for Remote Examination: A State of Play in Higher Education in the EU”. Sabine Bottin-Rousseau and Pierre Beust went from October 16-19 to ICDE in Toronto to present their paper about “Online Proctoring: Experimentation of Remote Examination in E-learning programs”. They also published an article about France and the Pajama-Friendly Exam. Amanda Jefferies of the University of Hertfordshire presented a paper with the title ‘Trialling Online Proctoring for E-assessments: Early Outcomes from the Erasmus+ OP4RE Project’ at the ECEL 2017 of 26-27 October 2017 in Porto, Portugal. Silvester Draaijer will present the first findings of the OP4RE project at the upcoming Dutch SURF Onderwijsdagen on 7 and 8 November. For more information about these papers, we refer to the OP4RE website.

After the presentation at the TEA Conference, Silvester Draaijer, together with representatives of the Erasmus TeSLA project and Smowltech entered into a round table discussion. In particular, themes were discussed concerning the question of whether online proctoring should be more secure than face-to-face proctoring. How secure is face-to-face proctoring? The conference attendants agreed with the identified target groups of candidates (exchange students, sport students, students with disabilities, prospective international students) that are in line with the long term intended outcomes of the Erasmus programme to increase access to higher education.

Also, issues were discussed regarding technologies for integration and how TeSLA functionalities could work in combination with online proctoring. Also, discussions focussed on the differences in cultures in South America and the United States in contrast to Europe. In particular, it seems that in in South America, because of the wider geographical spread of the student population and less stringent requirements regarding data protection and privacy, digital identification mechanisms such as facial recognition and storing video footage can be much easier applied.

Step by step, we are adding articles to our website. Recently we added some articles about proctoring. A first article gives us a look behind the scenes of the team of proctors of ProctorU. A second interesting article gives some tips and tricks, a number of things regarding online proctoring, such as technologies, procedures, advantages, disadvantages and the like. Take a look at our website for more information.

At this moment we are planning a date for a 2nd Reach out session. We will keep you posted.

OP4RE @ ECEL 2017

Category : Dissemination

On the 16th European Conference on eLearning (ECEL 2017), held in Portugal on the 26-27 October 2017 our partners from the University of Hertfordshire presented a paper about “Trialling Online Proctoring for e-Assessments: Early Outcomes From the Erasmus+ OP4RE Project”.

Paper: Jefferies, A., Barton, K., Meere, J., Peramungama, S., Pyper, A., & Yip, A. (2017) ‘Trialling Online Proctoring for E-assessments: Early Outcomes from the Erasmus+ OP4RE Project’ in Peres, P. and Mesquita,  A. (eds)  Proceedings of 16th European Conference for E-Learning (ECEL), Porto, ACPI pp. 221-228