Illinois DCFS ends unreliable predictive analytics program for child abuse risk
The Illinois Department of Children and Family Services ended its Rapid Safety Feedback program, which used data mining to predict child abuse risk, after the agency's director called the technology unreliable. The system, developed by Eckerd Connects and Mindshare Technology, assigned risk scores to children but failed to flag several high-profile child deaths. The program was also criticised for overwhelming caseworkers with alerts and for potential bias against poor children of colour. DCFS decided not to renew the contract.
- Company involved
- Illinois Department of Children and Family Services
- AI system involved
- Rapid Safety Feedback
10 source articles · read the reporting →
DOJ examines Allegheny County child welfare AI screening tool for disability bias
The Justice Department is scrutinizing the Allegheny Family Screening Tool, an AI system used by Allegheny County, Pennsylvania, to assess risk for families reported for child welfare concerns. A father with an intellectual disability, represented by attorney Robin Frank, filed a complaint alleging the algorithm discriminates against families with disabilities by using disability-related data points. The county denies awareness of concerns and says the tool helps predict risk, but critics argue it hardens bias. The DOJ's Civil Rights Division is investigating.
- Company involved
- Allegheny County Department of Human Services
- AI system involved
- Allegheny Family Screening Tool
5 source articles · read the reporting →
Amazon Buy Box algorithm accused of overcharging UK consumers by £1 billion
Consumer champion Robert Hammond has filed a collective proceedings order application against Amazon in the UK Competition Appeal Tribunal. The claim alleges that Amazon's Buy Box algorithm manipulated search results to favour products more profitable for Amazon, obscuring cheaper alternatives and causing approximately 49.4 million UK consumers to overpay by more than £1 billion between October 2015 and June 2020. The algorithm determined the first-ranked item in the Buy Box, which consumers accepted over 80% of the time. The case is pending, and similar investigations by the Italian Competition Authority and the UK Competition and Markets Authority are ongoing.
- Company involved
- Amazon
- AI system involved
- Buy Box algorithm
5 source articles · read the reporting →
UK government's Spotlight algorithm denies funding to independent cinemas
The UK government's Culture Recovery Fund used an automated due diligence tool called Spotlight, designed by the Cabinet Office, to process grant applications. The algorithm is accused of excluding smaller, community-focused independent cinemas and arts organizations in favour of larger institutions, a practice the article describes as automated cultural elitism. The National Audit Office has confirmed the criteria, and Arts Council England is investigating cases of potential fraud, while many venues report struggling to survive.
- Company involved
- UK Government Cabinet Office
- AI system involved
- Spotlight
6 source articles · read the reporting →
“Listen Up” if Your AI Policy Does Not Cover AI Recording Issues –Another Class Action Lawsuit Filed Over Third Party…
AI system recorded and analyzed calls between a dental company and its patients
- Company involved
- dental company
1 source article · read the reporting →
State Farm hit with lawsuit over AI bias, discrimination and unpaid insurance claims - beinsure.com
Denied or canceled insurance policies and delayed claim payments to policyholders, disproportionately affecting Black and nonwhite, disabled, and abuse survivor policyholders.
- Company involved
- State Farm
1 source article · read the reporting →
