Incidents gathered from public reporting around the world. Each one links to the articles it came from. None of it is a finding that anyone broke the law.
Reports people file about their own experience are not shown here and never will be without their agreement. Tell us what happened to you.
44 incidents closest to “Accenture Benefits Management System” · matched on meaning · public reporting
Collected voice and facial biometrics from job applicants during video interviews without consent
1 source article · read the reporting →
The system screened out Black and other applicants, denying them job opportunities.
1 source article · read the reporting →
Job applicants were automatically screened out by AI, allegedly discriminating against older, minority, and disabled applicants.
1 source article · read the reporting →
Workday's AI hiring tools screened and rejected job applications from Derek Mobley and other Black applicants, women, people over 40, and people with disabilities.
1 source article · read the reporting →
当AI接管安博竞技登录网站：一次提示注入如何动摇品牌信誉与用户信任 - ttplus.cn
An AI system took over the Anbo Athletic login website. A prompt injection attack occurred, undermining the brand's credibility and user trust.
1 source article · read the reporting →
Selected employees for layoff, disproportionately affecting those with disabilities or on medical leave
1 source article · read the reporting →
CVS reached a tentative settlement of a proposed class action by a Massachusetts job applicant who said his 2021 HireVue video interview was analysed with Affectiva's AI to track facial expressions without notice, amounting to a lie detector test banned by state law. He could not opt out or challenge the assessment, and was not hired.
1 source article · read the reporting →
Cigna, one of the largest health insurers, used an algorithm called PXDX to automatically deny medical claims. The system flagged mismatches between diagnoses and procedures, and company doctors signed off on denials in batches without reviewing patient files. One patient, Nick van Terheyden, was denied coverage for a $350 vitamin D test that his doctor had ordered. Former employees said the system saved Cigna billions of dollars but left patients with unexpected bills.
10 source articles · read the reporting →
The system screened job applicants and rejected them, allegedly discriminating based on age and sex.
1 source article · read the reporting →
Workday Gains an Edge in AI Hiring Bias Fight: California Brief - Bloomberg Law News
1 source article · read the reporting →
AI screening system determined which job applicants to advance to the next stage of recruitment.
1 source article · read the reporting →
The system screened and ranked job applicants, leading to rejections for individuals over 40.
1 source article · read the reporting →
Daniel Swanson, a 24-year IBM manager in Austin, sued IBM in federal court, saying he was fired at 48 and then rejected for other roles because IBM's AI-driven HR screening software was programmed to favour younger workers. IBM denies the claims.
1 source article · read the reporting →
米連邦地裁がWorkdayの主張を退け、AI採用訴訟の継続を認める - Межа. Новини України.
A federal court in San Francisco declined Workday's request to dismiss a lawsuit alleging its AI-powered hiring software discriminates against applicants with disabilities and other protected groups. Judge Rita Lin ruled that California anti-discrimination law may apply and allowed claims that the software screens candidates using proxy indicators such as employment gaps to move forward. Workday maintains its tools evaluate only qualifications and do not make hiring decisions.
1 source article · read the reporting →
Верховный апелляционный суд ЮАР рассмотрел дело об алгоритмах Sassa - UA.NEWS
The Supreme Court of Appeal heard an appeal on 25 August about Sassa's digital application system for the SRD grant. The system only accepts online applications and uses automated bank account checks that may deny grants to people whose accounts receive deposits that are not regular income. The Global Center on AI Governance submitted that automated decisions must uphold constitutional rights and be fair, non-discriminatory, and suited to South Africa's informal economy.
1 source article · read the reporting →
The New York State Nurses Association alleges that Montefiore Health System plans to lay off 12 utilization review nurses and replace them with AI-powered software from Datavant. The union warns that the move could compromise patient care by having AI review insurance denials without clinical judgement. Montefiore denies the claims, stating they are investing in technology for better outcomes. The plan has sparked a town hall and calls from elected officials to halt the layoffs.
3 source articles · read the reporting →
The Portland Water Bureau used a machine learning system in a randomised control trial to identify customers for its financial assistance programme. The system selected Columbia Sportswear CEO Tim Boyle, a billionaire and one of the city's largest residential water consumers, for a 40% water bill discount. Boyle declined the discount, stating it should go to someone who needs it. The bureau is testing whether the SERVUS algorithm can accurately identify customers' ability to pay.
1 source article · read the reporting →
Internal IBM documents reveal that its Watson for Oncology system often provided erroneous cancer treatment advice, including 'multiple examples of unsafe and incorrect treatment recommendations'. The problems were attributed to training on a small number of synthetic cases and the expertise of a few specialists rather than real patient data or established guidelines. The system was promoted to hospitals and physicians worldwide. It is unclear whether any patients were harmed as a result.
2 source articles · read the reporting →
The Centers for Medicare & Medicaid Services (CMS) clarified that health insurers cannot use algorithms or AI to deny care to Medicare Advantage members. This follows lawsuits alleging UnitedHealth and Humana used an AI tool, nH Predict, to wrongfully deny post-acute care to elderly patients. The tool reportedly produced rigid estimates ignoring individual patient needs, leading to premature denials. CMS warned that non-compliance could result in penalties and increased audits.
10 source articles · read the reporting →
The Council of Europe Human Rights Commissioner reported that Estonia's social security system used AI to establish incapacity levels and remove benefits from elderly people without human involvement. The system allegedly made decisions automatically, leading to complaints from NGOs.
8 source articles · read the reporting →
The UK government is reportedly using artificial intelligence to make decisions on welfare benefits and immigration applications. The system automates decisions previously made by human caseworkers. Concerns have been raised about the fairness and transparency of such automated decisions.
10 source articles · read the reporting →
A rural worker in Brazil, Josélia de Brito, had her pension application through the Meu INSS app automatically denied after the AI system misidentified her as a man. The INSS deployed the system to speed up benefit decisions, but experts say it struggles with complex rural cases. The case is cited as evidence that automation may exclude vulnerable people with limited digital access.
4 source articles · read the reporting →
The Robodebt system, an automated debt recovery system used by Centrelink, calculated welfare debts using averaged income data from the ATO, leading to invalid debts. A class action was filed in November 2019 and settled in November 2020. The settlement provided refunds of over $751 million in invalid debts collected and $112 million in compensation to approximately 400,000 group members. The Australian government also dropped claims for over $1 billion in invalid debts.
10 source articles · read the reporting →
Ibrahim Diallo, a software engineer in California, was automatically terminated by an HR system after a script triggered by a missed contract renewal revoked his access and disabled his key card. Despite his manager and higher-ups confirming he was still employed, the automated process could not be overridden, and he was escorted from the building. It took three weeks for the company to resolve the issue by rehiring him as a new employee, after which he quit. The incident highlights the risks of fully automated termination systems without human override.
10 source articles · read the reporting →
