• 0

Reflections TEA Conference 2017

Category : Dissemination

Session Silvester Draaijer, Amanda Jefferies and Gwendoline Somers

Online Proctoring for Remote Examination: A State of Play in Higher Education in the EU

Silvester Draaijer, project leader of the OP4RE project, presented the paper ‘Online Proctoring for Remote Examination: A State of Play in Higher Education in the EU’ during the international Technology Enhanced Assessment conference of 8 and 9 oktober 2017.

After the presentation, Silvester Draaijer, together with representatives of the Erasmus TeSLA project and Smowltech entered into a round table discussion. The discussion were conducted in a number of small groups in which several themes were discussed. In particular, themes were discussed concerning the question of whether online proctoring should be more secure than face-to-face proctoring. How secure is face-to-face proctoring? Further, conference attendants agreed very much with the identified target groups of candidates that are in line with the long term intended outcomes of the Erasmus programme to increase access to higher education.

Also, issues were discussed regarding technologies for integration and how TeSLA functionalities could work in combination with online proctoring. Also, discussions focussed on the differences in cultures in the Southern European Countries and the United States in contrast to Europe.

– Silvester Draaijer

The pre-conference proceedings with the paper included can be found here: http://www.teaconference.org/en/contributions-submissions/pre-conference-proceedings/

The Powerpoint presentation can be found here: https://drive.google.com/file/d/0B0rrO_BjDmhjbXFmMUZEdDZ5b1E/view?usp=sharing


  • 0

OP4RE @ ICDE, Toronto

Category : Uncategorized

Sabine Rousseau and Pierre Beust are giving a presentation at ICDE, Toronto, 16-19th of October 2017. ICDE is The World Conference on Online Learning: Teaching in The Digital Age – Re-Thinking Teaching & Learning. Regarding changing models of assessment, they will be presenting some experiments remote examination in e-learning programs.

Online Proctoring : Experimentation of Remote Examination in E-learning programs

Our paper will deal with the change in examination conditions for students registered in remote learning courses. The remote learning evaluation on e-learning platforms (LMS) can carry out individual and collective activities but these activities aren’t supervised. For exams, examination conditions and identity verification must be as reliable as if the examination were taking place at the institution. Today, in most of the cases, students registered in remote learning course must always travel to the university to sit their exams. In some cases, the universities have foreign partners who can organize for the exams to take place near the student’s location (which can still be costly in terms of the workload for the organizations and not being able to offer it to a larger number of students, and also in terms of fees for the students). Students can’t understand no longer the incoherence between educational activities and home support on the online platforms and the exams that must be sat at the institution. We observed that many remote students only chose to sit their exams in the end of the second semester in the “second chance” exams session which, consequently, ends up being their only exam period, breaks the rules of fairness for the students. This is easy to understand for students who live far from the university and particularly for foreign students and/or students who work. To have to travel to an institute can be expensive (taking leave from work, transport, hotel costs, accommodation…). For some students, this constraint can even be the reason why they don’t register for the course, even when it is offered online. This problem makes remote learning unattractive to potential students.

Different ways of providing remote exams are now available and can solve this problem with educational alignment. These methods must be tested and evaluated in terms of their cost, their security, their resistance to fraud, the induced stress for the students and the conditions that are put in place. We must explore alternative methods for carrying out exams remotely. We are currently experimenting with examination conditions supervised by a webcam at the student’s house and screen sharing for students studying in two universities, members of the French Association of E-learning (Fédération Interuniversitaire de l’Enseignement à Distance – FIED). These are : – The Caen University in Normandy. – The Pierre & Marie Curie University of Paris The Caen’s experiment deals with students in a master degree in a health management program. The Paris’s experiment deals with all distant programs, in mathematics and physics, from bachelor to master, for specific categories of students only for this first year of experiment.

These experiments take place in the Erasmus+ European Project “Online Proctoring For Remote Examination” (OP4RE). We will give in the paper the first results obtained from our experiments and their outcomes. We will present the results of survey that were done before and after taking the exams to evaluate the impact of the stress, and the encountered difficulties. We will then discuss about how succeed in generalizing our experiments.


  • 0

OP4RE @ the International Technology Enhanced Assessment (TEA) Conference 2017

Category : Dissemination

The #OP4RE team has submitted a proposal  Online Proctoring for Remote Examination: A State of Play in Higher Education in the EU for The 2017 International Technology Enhanced Assessment Conference in Barcelona. Silvester Draaijer will present this on the 5th and 6th of October.

On 6 October, Silvester Draaijer will present from 10:00-11:00 together with a presentation of the TeSLA project. From 11:30 to 13:00 hours, a round-table will be held in which members of the Erasmus+ OP4RE project and H2020 TeSLA project and other will discuss current issues in online proctoring.

More information can be found at: http://www.teaconference.org/en/programme/

 


  • 0

Online proctoring experimentation at the university of Caen

Category : Uncategorized

After online courses, online exams? The University of Caen (Normandy) experimented for two years with online proctoring of exams. Pierre Beust, director of the university multimedia education center and member of the OP4RE project, discusses their experiences and challenges for the EducPros conference on Thursday, October 19, 2017, aimed at digital transformation.
The University of Caen  focuses on students in distance learning. Since the early 2000s, thanks to e-learning, these courses have undergone a huge change of paradigm and method. While e-learning has grown, its evaluation is still a problem. Often students, enrolled in these courses, must pass the examinations at the institution where they are registered. For some of these students, it’s just impossible to get to the university …
In 2015-2016 the first experiments were conducted with remote evaluation of students through online proctoring. 189 examinations were conducted in three different experiments. The proctoring was done through Proctor U, an American company.
The first results are positive. The pass rates for these exams are similar to the pen and paper exam. No cases of fraud were found and 90% of students said that passing the exam through online proctoring is less stressful than a “normal” exam.
Curious about more? Read the full article in English or in French.


  • 0

Online Proctoring is a Growing Trend: Here is Everything You Should Know About It

The deskresearch phase unveiled both interesting scientific, professional as well as general information and documents. Take a look at this one.

Talview website published an interesting article in which they outline a number of things regarding online proctoring.

The article nicely sums up things such as technologies, procedures, advantages, disadvantages and the like.

See more at: http://blog.talview.com/a-complete-guide-to-online-remote-proctoring


  • 0

Behind the Webcam’s Watchful Eye

The deskresearch phase unveiled both interesting scientific, professional as well as general information and documents. Take a look at this one.

The Chronicle of Higher Education published an interesting article about the proctors at ProctorU: Behind the Webcam’s Watchful Eye, Online Proctoring Takes Hold. Author Kolowich provides a lively description of what is going on in rooms full of proctors, what they do and how proctors are proctored to do a good job.

See more at: http://www.chronicle.com/article/Behind-the-Webcams-Watchful/138505#sthash.KtyW57ZK.dpuf


  • 0

Newsletter 5

Category : Newsletter

On May 9th 2017 we organized our first online reach-out session. It was a rich learning experience, both on content level as on organizational level. The technology let us down, but we’ll take this as a working point to our next reach-out session. We hope to welcome more of our associated partners the next time.

The reach-out started with an explanation of the design of the OP4RE project and of the content of the Start Report. After this explanation of the OP4RE by project coordinator Silvester Draaijer, Daniel Haven, from ProctorExam, showed their proctoring tool. After this introduction, 3 partners explained about their first experiences with online proctoring. First Michiel van Diesen (Fontys, the Netherlands) shared their experience with online proctoring. Then Pierre Beust (FIED, France) highlighted the experiments of home proctor exams at the University of Caen. From Belgium we invited VIVES University College, department of Distance Education. They have a long tradition of distance learning and they work with ProctorExam to deliver some 1000 of online exams annually. In order to support this amount of online tests to be taken, VIVES has dedicated staff to plan, administer and proctor the exams. For more information and presentations, we refer to the OP4RE website.

In the coming months we will continue to work on intellectual outputs and more experiments will be set up. As we go on, we experience that we differ from our planning, due to the fact that the IOs regarding Accreditation and Privacy do not lend themselves very well for strict linear project planning. Maybe some shifts will be made during the second Transnational Meeting on October in Darmstadt. Concerning the previously mentioned issues with privacy and data protection, we continue our quest. The exact rules and practices to comply with high sensitive personal digital data are far from clear yet. Further, ProctorExam has made a new partnership with the “Associatie voor Examinering”, which was already an Associate partner of the OP4RE project. We start more intensive discussions with them for collaboration.

 


  • 0

Online Proctoring Systems Compared

Category : Security

In March 2013, David Foster Caveon of Caveon and  Harry Layman of The College Board published an article comparing in quite some depth various online proctoring systems. On the last pages they present some overall findings in which they distinghuis what system would be needed for the height of the stakes of the exams. Very insightful.

Further, they report about the percentage of recorded proctoring misbehavior incidences that are typically encountered during proctoring sessions. In the OP4RE project this will be taken as a benchmark.

You can read the complete report here:

 

https://ivetriedthat.com/wp-content/uploads/2014/07/Caveon-Test-Security.pdf 


  • 0

Reach out session 1 – 9th of May 2017

Category : Reach out sessions

On May 9th 2017 we organized our first online reach-out session. We invited our associated partners. It was a rich learning experience, both on the content as on the organizational level. The technology let us down, but we’ll take this as a working point to our next reach-out session.

We started with an explanation of the design of the OP4RE project and of the content of the Start-report. This report is the official“start” of our project. We looked into the current state of affairs regarding the online proctoring of remote examinations in participating countries. From this desk research a lot of questions have emerged, which we are currently taking on in the project. After this explanation of the OP4RE project coordinator Silvester Draaijer, Daniel Haven, from Proctor Exam, showed us their proctoring tool. Proctor Exam joins the OP4RE project.

Then we got an explanation of 3 partners about their first experiences with online proctoring. First Michiel van Diesen (Fontys, the Netherlands) shared their experience with online proctoring. Then Pierre Beust (FIED, France) highlighted the experiments of home proctor exams at the University of Caen. For the proctoring they use Proctor U. In year 1 (2015-2016): 55 students participated. Blended learning and home proctoring were proposed in addition to classical examinations. In year 2 (2016-2017) 50 students in a professional Master degree in the area of health with 2 or 3 exams participated. They were full distance learning students, spread all over the world. Home proctoring was organized instead of classical exams. From Belgium we invited VIVES. In Belgium, they were the first (and as far as we know the only) institution for higher education, which started with the proctoring of exams. VIVES has a long tradition of distance learning. About 15% of the students follow a distance learning programme (on a total of approximately 13.000 students). Students in distance programmes can take their exams in the exam center in Kortrijk or online via proctoring. For the proctoring, VIVES works with ProctorExam, one of the partners of the OP4RE project.

Attachments:


  • 0

OP4RE @ e-Assessment Question 2017

Category : Uncategorized

On the 22nd of March  Daniel Haven and Amanda Jeffries presented on the e-Assessment Question 2017 conference about Delivering secure online proctored remote assessments: the erasmus+ funded OP4RE project.