So as we can see, the AI behind remote proctoring may not always be perfect. So if you want to have a manual step within the overall process, you could. And this is just because over time you will get better, and sometimes you want to manually flag things as cheating to give the system a chance to learn the behavior of your audience and then make that artificial intelligence better over time. So what we're going to do is I'm just going to use the same exam, but I'm going to reset my progress so that we can do this example again. Okay, so now what we're going to do is we are going to come over here, go to the exam, and for the option, even though we turned on online proctoring, what we are also will do is we are actually going to say you require manual review. So what does this mean when you say manual review? This is what it would mean. So we're going to go to the beginning and let's take the exam one more time. So the process is identical all the way to the end. So I'm going to click on check. I've already had permissions given to my browser, so I didn't have to give to it again. And then I'm just going to wait for computer to confirm that the environment is bright enough. Make sure my face is in the screen. I click on save, take a picture. Okay, and then what I'm going to do is I'm also going to just provide my ID one more time. Okay, so now what I can do is I can start taking the exam. So here we go. So, so far, the learner experience actually does not change at all. So I'm just going to go all the way to the end. Submit. So, so far, the learner experience has is everything has reached the end and no problem. What the admin experience is going to be is let's switch to the admin side. This time, the admin will get a chance to receive a email, but the user's record is not going to be considered done until the admin flag it as cheating or no cheating. So what we're going to do is we're probably have to wait a little bit for this. It is still being analyzed. So actually, I'm just going to go here. So as you can see, it's the recording is already uploaded, but it is still being processed, but you can flag someone as cheating or not cheating. Otherwise, what happens is, so let's go here. So let's say you have a lot of user taking this exams over time. What you can do is, so let's go to exams, go to this exam. And go to, so if you go to the, because we added a step to say you have to record, you have to manually review. If I go to the exam and I click on exam recording, there's going to be a review status that says this is not reviewed, right? So basically what you can do is you can go in here and you can flag as cheating or not cheating. And if I flag it as cheating, what happens, the system is going to look at the recordings and they use those recording as a sort of a feed, a practice data to, so that in the future, if someone who does something similar to what the recording does, it's going to more likely to flag them as cheating. Oh, by the way, here is the portrait and the driver's license in case you need to grab it. So now what happens is, if I go, so you can see that it's flagged as cheating. And if I go to the actual exam, so let's just get there. And I go to the exam recording, it's going to have a list of everyone who has reviewed and a list of people who have not reviewed. And then it's up to you to decide what to do with the user if the user is detected as cheating. Notice that just because you flag someone as cheating does not necessarily do anything to their score, but you definitely have the ability to go in there and then reset their exam if that's what cheating means for your particular organization. So that is how having a checkbox to say, require menu check mean. It's just that you have a report to allow you to easily go in there and to flag user to see if someone is cheating or not. And then once again, the way to get to it, you can also click on the exam, click on the exam that's high stake and then click on exam recording and there's a review status.

remote proctoring

manual review

AI system

online proctoring

cheating