Helping AI text detectors keep up with changing conditions

https://news.mit.edu/sites/default/files/images/202611/MIT-movingtarget-01-press.jpg

A teacher who believes a student’s term paper may have been written by a large language model (LLM) can use a tool for detecting artificial intelligence-generated text to help confirm their suspicions. But the teacher may want to think twice before putting all their trust in the detector.

Researchers from MIT and Cornell University showed that such detection tools, which are AI models themselves, can be fooled by AI-generated text disguised to appear as if it were written by a human. Detectors can also fail to identify AI text due to natural shifts in writing habits over time or the emergence of new LLMs.

In a new paper, the researchers demonstrated how a special training technique makes an AI detector more accurate and resilient to deception, even as human and AI writing constantly changes.

They employed a method called test-time adaptation, which allows a deployed detection model to learn...

Copyright of this story solely belongs to news.mit.edu. To see the full text click HERE

Read more