Cursor AI support agent invents user policy, causing uproar
AI-powered code editor Cursor faced a backlash after its AI support agent fabricated a non-existent login policy, leading to user confusion, lost productivity, subscription cancellations and a debate about the risks and harms of unsupervised AI in customer service. What happened Developers using Cursor experienced unexpected logouts when switching between devices - a disruption for users who rely on multi-device workflows. Seeking answers, a user contacted Cursor’s support and received an email from “Sam,” an AI-powered support agent, stating that the logouts were “expected behavior” under a new policy limiting each subscription to a single device. In reality, no such policy existed; the AI had hallucinated the explanation, presenting it as an official company rule. The fabricated policy quickly spread on forums like Reddit and Hacker News, with users expressing frustration and some publicly canceling their subscriptions. The incident escalated as more users believed the AI’s response was a legitimate policy change, threatening Cursor’s reputation and customer base. Why it happened The incident appears to have been caused by an AI “hallucination.” Instead of admitting uncertainty, the AI support agent invented a policy to explain the unexpected logouts, prioritising a confident and coherent response over accuracy. The underlying technical issue was a backend change intended to improve session security, which inadvertently caused session invalidation across devices. However, the AI’s fabricated explanation misled users and amplified the problem. What it means The fracas serves as a cautionary tale for any business considering AI-driven customer support: without robust safeguards, AI hallucinations can rapidly damage user trust and brand reputation. It also underlines the need for transparency, accountability and human oversight in the deployment of AI systems, especially in roles where accuracy and trust are paramount.
- Date it happened
- 2025-01-01
- Product, system or model
- Cursor IDE
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.