In this video tutorial, we will go over how to use remote proctoring feature within Oasis. So I have two browsers open, one logging as support, which has admin access, another one logging as Thomas Wong, which is a learner. So I'm going to set up a brand new exam from very beginning as a high stake proctored exam. So go to courses and click on add course. Note that you have to select assessment exam in order to use the remote proctoring feature. So let's give it a name. Let's call it, for example, a very important certification exam. Okay, let's just call it cert exam, all right. And I'm just going to reuse some of the questions that's already in the item bank that we already have in this system. So I'm just going to select a couple of questions from here. And I'm just going to skip a lot of these setup information because that's not what we're focusing on. But I do need to make sure that assessment exam is selected. This step is kind of important because it's a high stake exam, it doesn't make sense to do it in learning mode. So you want to make sure that you do it in exam mode. In addition, I'm just going to say two questions because I'm going to keep it fairly short. You could make the certificate exam to have a passing grade if you want. Let's say it's a 50% passing grade and no reset. Let's make it 80%. This is right now, I have not done anything different than a normal assessment exam. When you first set it up, you essentially set up assessment exam. And let's just give it a two minute limit and then click on save and continue. We're going to populate the questions in a little bit. And because it's a high stake exam, you probably don't want the user to print the exam or the answer book. And so we have set up the exam. Like I said, I haven't done anything different from a regular exam. So what we're going to do now is I'm just going to grab these two IDs because those are the two questions I'm going to use. So let's just grab the IDs so we can easily use them. So now what we're going to do is go back to the course and let's add these two questions to the course. So I'm going to go to the exam portion, populate questions, and I'm just going to paste it here. Make sure that you click on confirm add. So like I said, up to this point, it's still just a regular assessment exam. Now is when I'm going to turn it into a remote proctor. I go to advanced option, I click on edit, and then check the box here for use online proctor. We're going to talk about a few other things in a little bit, but right now I'm just going to turn this on and I'm going to click on update. So one thing you'll notice that it will tell you that because you have turned on online proctoring, there are certain instructions you must give to the user. And that instruction is actually managed here. So we have some boilerplate information that you could give to the user, but you can definitely make changes to this boilerplate instructions. But I'm not going to make any changes. I'm just going to go back and I'm going to publish the exam. So here we go. This is talking about the fact that it's not, the questions are distribution skewed, which is pretty obvious because we only have two questions. So it's obviously not going to have a good distribution. And because it's high stake exam, let's just turn off a lot of things so that people can't really use any of the tools. You can turn it on if you want. And then we can display the score at the end and then we can skip some of the stuff. Like I said, we're not focusing on the exam element of it, only the high stake proctored element of the exam. So now this is set up. So now let's experience it as a learner. So I'm going to minimize this screen and this screen is a learner screen. So I'm just going to take this exam. So here it goes. I'm going to start the exam now. So once I started the exam, right away I see this message. And remember, this is the message that I was saying earlier and I'm just going to dock it over here to show, hold on, there we go. But under the exam, under events options, this acknowledgement page is what's being displayed. And you can make changes if you want to change any wording you want the user to see. So it's completely customized. If you don't do anything, you get what comes by default. So now what I'm going to do is I'm going to click on acknowledge. And then there's a few equipment checks. This is sort of the different part of the system that normally don't get engaged unless it's a high stake exam. So the user must have a webcam and if they don't have a webcam, they cannot proceed. So I'm going to click on webcam and there's some instructions to tell the user what to do, but they had to click on allow. So now what happens is the system is going to use the webcam to check brightness. So I'm going to click on check. So this is me doing the recording and it's going to make sure that the room is white lit. If the room is too dark, the system will not continue. So we're going to click on continue. The next step is basically taking a picture of the user and make sure the user's face is in the circle. So when we take a picture, what's actually happening is to take a picture of the user so that that face is being tracked during the course of the exam so that the user does not, if another user come into the screen, will know about it. So that's sort of the reason why we want to grab a picture of the user and the user must be comfortable with the fact that they are being recorded. So I'm going to click on next. The next one is the government issued ID. So I have an Illinois driver's license. I'm just going to put here, take a picture. So what's important here is it actually uses Amazon-based artificial intelligence to compare the picture the user took with the ID and make sure that it is the same person. So now that the webcam is turned on and checked, now we're going to record the screen. And it's important to record user screen just in case user use different browsers, multiple browsers open and able to see doing research online while doing the exam, which is not what you want. So you're going to say, hey, give me permission for the screen. And the user had to select the screen and click on share, similar to what the instruction is telling the user. So now the user have given permission to the webcam and permission to the screen sharing. Then they can click on continue. So as you can see, this is the experience of the learner while they're taking the exam in high stake proctoring mode. And the users clearly sees that he's being recorded because as you can see, my mouse is moving. He can see he's being recorded because it's him on the corner. They can double click on it to make it smaller, but either way it is, it should be very obvious that the user is being recorded. Then the user will just answer the question. So here's some very simple question, two plus two is equal to four. And because we turn on timers, the timer is being displayed. And the while I'm talking, the sound in the background is actually being recorded. Now what I'm going to do is I'm going to do something that the user probably doesn't want to do normally, which is take my cell phone and put it next to my face. So this basically is a behavior that a cheater would do, right? When if they had the phone a friend, so to speak. In addition, if there's any suspicious activity, such as the user leaving the room, which means the user no longer in front of the computer, but left or another person entering the screen, then that will be suspicious behavior. And I will show what happens when that takes place. So now I'm going to click on two as the one plus one equal to two and click on submit. So now I'm going to submit the exam. And as far as a learner is concerned, the experience has finished. So now what I'm going to do is I'm going to switch browser to the admin browser. So this is the admin browser. And what we're going to do is without the admin have to proactively wait, an email will be fired off to the admin when the exam has completed and when the recording of the proctor has been analyzed by artificial intelligence. But if you don't want to wait for that notification, you can go to the progress and you will see that the recording is still being analyzed. So what we're going to do now is we're going to pause the video until the exam recording has been finished, analyzed by the Amazon artificial intelligence. So I just received the email saying that the exam has passed and it looks like my behavior of using the cell phone was actually not detected because he says that there is no suspicious behavior detected. And that's just because there is certain logic within the artificial intelligence that will basically look at the image and look at everything that the user do in front of the camera and take everything into consideration and decide whether there is suspicious behavior or not. So the admin get that email and they can also just refresh on this screen and you will see that no suspicious behavior detected. They can click on the exam recording and they will be able to actually see the recording of the actual user taking the test. And I suspect the reason that he was not detecting the phone is because I was moving my hand and the phone was sort of in my hand and it was a little bit difficult to detect the phone. So as you can see, the remote proctoring is probably not going to be as perfect as a real person proctoring, but if a user have walked into the screen or if the person have left the screen, it would definitely have got flagged. So as you can see, this is essentially the entire process of a user taking the exam being recorded and the entire time the user is being recorded, the video is actually being analyzed by Amazon AI and actually you can see exactly what they did by playing this video. In addition, you can sort of go through frame by frame to see what the user have done. You can see both what's in front of the camera and what is on the user's screen so that you can see exactly what they did and you can sort of slide through the image that's being captured. So this is sort of a very high level of how to do a remote proctored exam.

remote proctoring

Oasis

high-stakes proctored exam

equipment checks

Amazon AI technology