Study: AI text detectors discriminate against non-native English speakers
Seven AI writing detection tools 'frequently' misclassify non-native English writing as generated by AI systems, according to a study by Stanford University researchers. The findings raise questions about the accuracy and reliability of AI writing detection tools in general, as well as about their potential to discriminate against non-native English speaking students, academics and job applicants. The researchers ran English essays written by non-native English speakers through seven popular GPT detectors to see how well the AI detection systems performed. Over half were classified as AI-generated. By contrast, over 90 percent of essays written by native English-speaking eighth graders in the US were classified as human-generated by the same systems. System 🤖 Unknown Operator: Developer: Countr y: USA; Global Sector: Education; Business/professional services Purpose: Detect AI writing Technology: NLP/text analysis; Neural network; Deep learning; Machine learning Issue: Accuracy/reliability; Bias/discrimination - language
- Date it happened
- 2023-07-01
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.