Detecting Fraudulent Student Communication in a Multiple Choice Online Test Environment

Online evaluation systems, pervasive nowadays, are known to be susceptible to higher fraud risks. This work proposes a novel and robust method to detect potential fraud acts in online multiple-choice question (MCQ) exams. For the first time, the communication probability between the examinees is statistically assessed based on the concordance of responses and answer time against null expectations and is subsequently used to identify potential fraud behavior. The model is sensitive to the direction of communication acts, distinguishing content consumption from production, as well as multiwise communication channels. Online remote tests from engineering courses at Tecnico Lisboa are used as a case study. We show that the cumulative contribution of concordant responses between students, when recurrent, offers a way of signaling fraud behavior. Separating content production from consumption reveals the underlying student role played in potential fraud acts. Collusion behavior is assessed against null models of fraud and conformity, and therefore being statistically framed and offering a solid criterion to guide tutors in ascertaining fraud and discouraging communication.

Automated summary

This study proposes a novel and robust method to detect potential fraud acts in online multiple-choice question exams. By statistically assessing the communication probability between examinees based on the concordance of responses and answer time, potential fraud behavior can be identified. The model distinguishes content consumption from production and considers multiwise communication channels. It offers a solid criterion to guide tutors in ascertaining fraud and discouraging communication.