Winner: Duolingo with Securing the Future of High-Stakes Testing: The Duolingo English Test’s Human-in-the-Loop AI Ecosystem
Imagine a high-stakes exam that you can take anywhere in the world, on your own computer, at any time. To ensure this process is safe and fair without a human watching live, we built a security system that acts as a digital assistant for our reviewers.
Instead of just recording a video for manual review later, our system uses AI to process the test session data after it is completed. It detects specific patterns, such as if the rhythm of typing suggests an answer was copied from a chatbot rather than written naturally, or if eye movements indicate the use of hidden notes. The AI does not make the final decision; instead, it highlights these specific moments for a human expert to review. This allows our reviewers to focus their attention on the relevant segments rather than watching hours of video. This combination protects the test against cheating while ensuring that honest test takers receive a fair and convenient assessment experience.
