A CNET reporter tested various AI cheating apps and detectors and concluded that the vast majority of these tools are essentially useless [1].
This finding suggests a significant gap between the marketing of academic integrity tools and their actual performance. As educational institutions increasingly rely on software to police student work, the failure of these tools could lead to wrongful accusations of academic dishonesty.
The testing occurred in late 2023 across various online platforms and app stores [1]. The author aimed to determine the reliability and usefulness of tools designed to detect AI-generated content in academic settings [1].
According to the reporter, AI detection is still in its early stages and prone to false positives [1]. The author said that many of the apps rely on simple keyword matching, which can be easily bypassed by sophisticated AI models [2].
The reporter tested a range of AI cheating apps and detectors to assess their effectiveness [1]. Despite the variety of tools available on the market, the results indicated that most fail to provide a reliable method for identifying AI-authored text [1].
The author said that the current state of the technology makes it difficult for educators to trust these tools as a primary means of verification. Because sophisticated models can evade simple keyword checks, the tools often fail to catch advanced AI usage, while potentially flagging human-written work [2].
“"The vast majority of these tools are essentially useless,"”
The inability of detection software to accurately distinguish between human and AI writing creates a precarious environment for students and educators. If schools rely on unreliable software for disciplinary actions, they risk penalizing students based on flawed technology. This highlights a systemic lag where the generative capabilities of AI are evolving faster than the tools designed to detect them.
