AI weeds out older and minority job applicants, lawsuit against Workday claims
Job applicants were automatically screened out by AI, allegedly discriminating against older, minority, and disabled applicants.
- Company involved
- Workday
- AI system involved
- Workday AI recruiting tools
1 source article · read the reporting →
ACLU Says in FTC Complaint That Aon’s AI Tools Discriminatory
The system screened out job applicants based on personality tests, video interviews, and cognitive assessments, affecting autistic, neurodivergent, and people of color.
- AI system involved
- ADEPT-15, gridChallenge
1 source article · read the reporting →
Intuit, HireVue Accused of AI Job Bias Against Deaf Woman
The ACLU filed complaints with state and federal agencies on behalf of a deaf, Indigenous employee of Intuit who was denied a promotion after an automated HireVue video interview. The tool did not caption all audible questions and could not accurately transcribe her speech, which the complaint says disadvantaged her because of her disability and race.
- Company involved
- Intuit
- AI system involved
- HireVue video interview
1 source article · read the reporting →
Resume prompt injection tricks AI hiring - moneywise.com
AI screening system determined which job applicants to advance to the next stage of recruitment.
1 source article · read the reporting →
Lawsuit claims discrimination by Workday’s hiring tech prevented people over 40 from getting hired | CNN Business
The system screened and ranked job applicants, leading to rejections for individuals over 40.
- Company involved
- Workday
- AI system involved
- HiredScore AI
1 source article · read the reporting →
Linda, 37, Profiled by the Employment Agency’s AI: ‘Degrading’
Linda, 37, profilerad av Arbetsförmedlingens AI: ”Nedvärderande” - Aftonbladet
Linda Hellman, 37, was profiled by the Swedish Public Employment Service’s AI tool without her knowledge. She felt the experience was degrading and criticized the tool as misleading and unreliable. She has been unemployed for nearly a year and is part of the ‘Rusta och matcha’ program, but has not found a job despite applying for an average of 28 jobs per month.
- Company involved
- Arbetsförmedlingen
- AI system involved
- Arbetsförmedlingens statistiska bedömningsstöd
1 source article · read the reporting →
Did IBM embed age discrimination in its AI-driven job screening software?
Daniel Swanson, a 24-year IBM manager in Austin, sued IBM in federal court, saying he was fired at 48 and then rejected for other roles because IBM's AI-driven HR screening software was programmed to favour younger workers. IBM denies the claims.
- Company involved
- IBM
- AI system involved
- HR screening software
1 source article · read the reporting →
South Africa's Supreme Court of Appeal Considers Sassa Algorithm Case
Верховный апелляционный суд ЮАР рассмотрел дело об алгоритмах Sassa - UA.NEWS
The Supreme Court of Appeal heard an appeal on 25 August about Sassa's digital application system for the SRD grant. The system only accepts online applications and uses automated bank account checks that may deny grants to people whose accounts receive deposits that are not regular income. The Global Center on AI Governance submitted that automated decisions must uphold constitutional rights and be fair, non-discriminatory, and suited to South Africa's informal economy.
- Company involved
- South African Social Security Agency (Sassa)
- AI system involved
- Sassa digital application system
1 source article · read the reporting →
Deloitte report for N.L. healthcare contains likely AI-generated false citations
Newfoundland and Labrador's $1.6 million Health Human Resources Plan, authored by Deloitte, contains at least four citations to research papers that do not exist, likely generated by artificial intelligence. The errors were discovered after the report was published by the Department of Health and Community Services in May. Researchers named in the false citations confirmed their work was misattributed and the papers are nonexistent. The provincial government and Deloitte have not responded to questions about the report.
- Company involved
- Deloitte
- AI system involved
- Azure OpenAI
3 source articles · read the reporting →
SA Health aged care AI trial generated 12,000 false alarms, missed real fall
A trial of AI-powered CCTV in two South Australian aged care facilities produced over 12,000 false alerts in a year, causing staff alert fatigue. The system, intended to detect falls and abuse, was overly sensitive and misidentified normal movements as incidents. At least one genuine resident fall went unresponded to because staff were overwhelmed. South Australia's health minister described the rollout as 'botched'.
- Company involved
- SA Health
5 source articles · read the reporting →
Rotterdam's Welfare Fraud Algorithm Discriminated by Gender and Ethnicity
The city of Rotterdam deployed a machine learning algorithm built by Accenture to flag welfare recipients for fraud investigation. The system used personal data including gender, language, and subjective caseworker notes to generate risk scores, leading to investigations that disproportionately targeted women and migrants. An external review found the algorithm discriminatory and inaccurate, prompting the city to suspend its use in 2021. The system's opacity made it nearly impossible for those flagged to challenge the decisions.
- Company involved
- City of Rotterdam
6 source articles · read the reporting →
Services Australia voiceprint system fooled by AI voice clone
A Guardian Australia investigation found that the voiceprint system used by Services Australia's Centrelink and the Australian Taxation Office can be bypassed using an AI-generated voice clone. A journalist created a clone of their own voice from four minutes of audio and used it with a customer reference number to access their Centrelink self-service account. The system is used by millions of Australians for identity verification over the phone. Services Australia stated that it continually assesses risks and applies additional tests if unusual circumstances are detected, but did not commit to changing the technology.
- Company involved
- Services Australia
- AI system involved
- Voiceprint
1 source article · read the reporting →
AI-generated Centrelink phishing emails target 270,000 Australians
More than 270,000 fake emails impersonating Services Australia and Centrelink were detected over four months in a broad phishing campaign. Cybersecurity firm Mimecast reports that cybercriminals are using artificial intelligence to create highly convincing clones of legitimate government communications about benefits. The attack targets vulnerable people and can lead to identity theft, data theft, malware, or ransomware.
- Company involved
- Services Australia
4 source articles · read the reporting →
CMS warns insurers against using AI to deny Medicare Advantage care
The Centers for Medicare & Medicaid Services (CMS) clarified that health insurers cannot use algorithms or AI to deny care to Medicare Advantage members. This follows lawsuits alleging UnitedHealth and Humana used an AI tool, nH Predict, to wrongfully deny post-acute care to elderly patients. The tool reportedly produced rigid estimates ignoring individual patient needs, leading to premature denials. CMS warned that non-compliance could result in penalties and increased audits.
- Company involved
- UnitedHealth, Humana
- AI system involved
- nH Predict
10 source articles · read the reporting →
LAUSD shelves AI chatbot after vendor AllHere collapses
Los Angeles Unified School District turned off its 'Ed' AI chatbot on June 14, 2024, after the vendor AllHere furloughed most staff due to financial collapse. The chatbot, which cost $3 million, was designed to provide students and parents with academic guidance and school information. A former AllHere employee alleged that student data was improperly shared with third parties and processed overseas, raising privacy concerns. The district stated it will ensure privacy protections and plans to eventually restore the chatbot.
- Company involved
- Los Angeles Unified School District
- AI system involved
- Ed
5 source articles · read the reporting →
Flawed AI System for Predicting Teen Pregnancy in Salta Raises Concerns
In 2018, the Governor of Salta, Argentina, announced a pilot program using artificial intelligence to predict which adolescent girls would become pregnant, claiming 86% accuracy. Researchers at the Laboratorio de Inteligencia Artificial Aplicada found serious methodological errors, including data leakage that inflated accuracy and the use of inadequate survey data. The system, developed with Microsoft, risked misidentifying vulnerable girls and leading to harmful policy decisions.
- Company involved
- Ministerio de Primera Infancia de Salta
4 source articles · read the reporting →
DOGE's Flawed AI Tool Threatens Veterans Affairs Services
The Department of Government Efficiency developed an AI tool to identify unnecessary VA contracts, but it used outdated models and lacked context, leading to misclassification. At least 24 contracts were canceled, affecting cancer research and nurse care tools. The VA acknowledged the tool's role but stated all contracts undergo human review. Experts criticized the use of AI for such complex decisions.
- Company involved
- Department of Veterans Affairs
- AI system involved
- Muncher
2 source articles · read the reporting →
Estonia used AI to remove benefits from elderly without human involvement
The Council of Europe Human Rights Commissioner reported that Estonia's social security system used AI to establish incapacity levels and remove benefits from elderly people without human involvement. The system allegedly made decisions automatically, leading to complaints from NGOs.
8 source articles · read the reporting →
Durham Police uses Experian Mosaic data in HART AI risk tool
Durham Constabulary developed the Harm Assessment Risk Tool (HART), a machine learning algorithm that assesses the recidivism risk of offenders. The tool uses 34 data categories including criminal history, age, gender and two types of postcode, one sourced from Experian's Mosaic marketing segmentation system. Big Brother Watch alleges that using such commercial consumer behaviour data to inform custody decisions risks prejudice and disproportionate targeting of deprived neighbourhoods. The force has stated it is refreshing the model with an aim to remove one of the postcode predictors.
- Company involved
- Durham Constabulary
- AI system involved
- Harm Assessment Risk Tool (HART)
9 source articles · read the reporting →
UK government using AI for benefits and immigration decisions
The UK government is reportedly using artificial intelligence to make decisions on welfare benefits and immigration applications. The system automates decisions previously made by human caseworkers. Concerns have been raised about the fairness and transparency of such automated decisions.
10 source articles · read the reporting →
INSS AI Denies Rural Worker's Pension After Misidentifying Her as a Man
A rural worker in Brazil, Josélia de Brito, had her pension application through the Meu INSS app automatically denied after the AI system misidentified her as a man. The INSS deployed the system to speed up benefit decisions, but experts say it struggles with complex rural cases. The case is cited as evidence that automation may exclude vulnerable people with limited digital access.
- Company involved
- Instituto Nacional do Seguro Social (INSS)
- AI system involved
- Meu INSS
4 source articles · read the reporting →
Deloitte to refund Australian government after AI-generated report errors
Deloitte used generative AI (Azure OpenAI GPT-4o) to help produce an independent assurance review for Australia's Department of Employment and Workplace Relations. The report, published in July 2025, contained multiple errors including non-existent academic references and a fabricated court case. After the errors were flagged, Deloitte acknowledged the AI use and agreed to refund the final instalment of the A$439,000 contract. The report was corrected, but its substance and recommendations remained unchanged.
- Company involved
- Deloitte
- AI system involved
- Azure OpenAI GPT-4o
5 source articles · read the reporting →
AMS algorithm lacks transparency and may discriminate against job seekers
The Austrian Public Employment Service (AMS) uses an algorithm to classify job seekers into categories A, B, and C, determining their access to benefits and training. Scientists from TU Wien, WU Wien, and University of Vienna have criticised the algorithm for lacking transparency, as only two of 96 model variants have been published. They allege that the system may discriminate against women and people with migration background, and that job seekers are not informed about how the algorithm works or given a chance to appeal.
- Company involved
- AMS (Arbeitsmarktservice Österreich)
- AI system involved
- AMS-Algorithmus
10 source articles · read the reporting →
Austrian court lifts ban on AMS job-chance prediction algorithm
The Austrian Federal Administrative Court overturned a ban by the Data Protection Authority on the AMS algorithm, which predicts job chances of unemployed people. The system, trained on historical data including age, gender, and nationality, categorises individuals as high, medium or low chance of re-employment. Critics argue it discriminates against women and mothers, and that the data is now outdated due to the COVID-19 pandemic. The court ruled that the algorithm is lawful as long as a human advisor makes the final decision on training support.
- Company involved
- Arbeitsmarktservice (AMS)
- AI system involved
- AMS-Algorithmus
5 source articles · read the reporting →