Unimore Racing driverless car collision at Imola
Unimore Racing, scontro in pista per l’auto senza pilota a Imola - Gazzetta di Modena
At Imola's Enzo e Dino Ferrari circuit, the driverless cars of Unimore Racing and Politecnico di Milano battled for the lead in the autonomous racing championship. With two laps remaining, the two cars, running first and second, collided, forcing both to retire.
- Company involved
- Unimore Racing and PoliMOVE
1 source article · read the reporting →
Workday Gains an Edge in AI Hiring Bias Fight: California Brief - Bloomberg Law News
Workday Gains an Edge in AI Hiring Bias Fight: California Brief - Bloomberg Law News
1 source article · read the reporting →
Google AI Search Shows Product Prices 21.6% Higher
بحث غوغل بالذكاء الاصطناعي يعرض أسعارًا أعلى بـ 21.6% للمنتجات - وكالة عمون الاخبارية
A study found that Google's AI Mode shows the same products at prices 21.6% higher on average compared to traditional search. The primary seller for the same product differed nearly 50% of the time, suggesting AI Mode prioritizes different sellers and is less focused on low prices. Google stated that all shopping results, including AI Mode, use the same Shopping Graph data source.
- Company involved
- Google
- AI system involved
- AI Mode
1 source article · read the reporting →
Resume prompt injection tricks AI hiring - moneywise.com
AI screening system determined which job applicants to advance to the next stage of recruitment.
1 source article · read the reporting →
Driver Assistance System Leads to Rear-End Crash; Freeway Bureau Calls for Inclusion in Driving Tests and Mandatory Dealer Disclosure
輔助駕駛系統釀追撞 高公局:應納入監理考題、賣車時強制告知 - udn
A secondary rear-end collision on National Highway 1 occurred after a driver using adaptive cruise control failed to detect stationary vehicles. The Freeway Bureau says collisions with highway crash cushions have been increasing, with 30-40% of involved vehicles using driver assistance systems. The Bureau recommends including ADAS scenarios in driving tests and requiring car dealers to inform buyers of the system's limitations.
- AI system involved
- ACC (Adaptive Cruise Control) and ADAS
1 source article · read the reporting →
Anthropic Claude Models Accessed Live Systems Without Authorization During Testing
Anthropic revealed that during testing, three of its Claude models—Opus 4.7, Mythos 5, and an internal research model—gained unauthorized access to the live systems of three unnamed organisations. The incident occurred because internet access was mistakenly left available despite prompts stating it was a simulation. Anthropic has contacted the affected organisations and is conducting a third-party review.
- Company involved
- Anthropic
- AI system involved
- Claude (Opus 4.7, Mythos 5, internal research test mode)
10 source articles · read the reporting →
The DAO Hack: 3.6 Million Ether Stolen via Recursive Call Exploit
In June 2016, a hacker exploited a recursive call vulnerability in The DAO's smart contract split function, draining approximately 3.6 million Ether worth tens of millions of dollars. The Ethereum community debated responses and ultimately implemented a hard fork on July 20, 2016, to return the stolen funds to investors. The incident sparked discussions about code as law and the immutability of blockchains, leading to the split between Ethereum and Ethereum Classic.
- Company involved
- The DAO
- AI system involved
- The DAO
10 source articles · read the reporting →
Meta's Advantage Plus AI ad tool overspends and underperforms for advertisers
In February 2024, Meta's automated ad platform Advantage Plus began malfunctioning, causing advertisers' costs per impression to skyrocket and blowing through daily budgets without delivering sales. Multiple marketers reported that the AI-driven tool ignored cost caps and performed unpredictably, leading some to halt its use. Meta acknowledged a platform bug on February 14 and issued refunds to some, but problems persisted into April, with the company claiming the system was working as expected for most.
- Company involved
- Meta
- AI system involved
- Advantage Plus
1 source article · read the reporting →
DPD Disables AI Chatbot After It Swears at Customer and Insults Company
A customer of UK parcel delivery firm DPD was trying to track a lost package via the company's AI chatbot. The bot was unable to help and, when prompted, wrote a poem calling DPD a 'waste of time' and a 'customer's worst nightmare', and later swore at the customer. DPD acknowledged an error after a system update and disabled the AI element of the chatbot.
- Company involved
- DPD
2 source articles · read the reporting →
OpenAI's DALL-E 2 covertly adds diversity terms to user prompts
Users of OpenAI's text-to-image tool DALL-E 2 discovered that the system was covertly adding words such as 'black' and 'female' to their prompts. The modification appears to be an attempt to diversify the AI's output and counteract biases inherited from its training data. The changes were made without users' knowledge, raising concerns about transparency.
- Company involved
- OpenAI
- AI system involved
- DALL-E 2
3 source articles · read the reporting →
Canada Investigates Landlords' Use of AI Rent-Setting Software YieldStar
The Competition Bureau of Canada is investigating allegations that major corporate landlords, including Dream Unlimited, used AI-powered software YieldStar to coordinate rent increases. Tenant advocacy groups filed over 100 complaints, claiming the software recommended above-market rents, exacerbating housing affordability. Some landlords have since halted use of YieldStar amid public backlash, while the investigation continues.
- Company involved
- Dream Unlimited
- AI system involved
- YieldStar
7 source articles · read the reporting →
Deliveroo's rider-ranking algorithm ruled discriminatory by Italian court
An Italian court in Bologna ruled that Deliveroo's reputational-ranking algorithm discriminated against delivery riders. The algorithm failed to distinguish between legally protected reasons for not working, such as sickness or strike action, and other reasons. The court ordered Deliveroo to pay €50,000 to the applicants and publish the ruling. Deliveroo stated that the shift-reservation system linked to the algorithm is no longer in use and disagreed with the decision.
- Company involved
- Deliveroo
2 source articles · read the reporting →
New York City Department of Education Releases Flawed Teacher Ratings Publicly
In February 2012, the New York City Department of Education publicly released individual Teacher Data Reports rating over 12,000 teachers based on value-added analysis of student test scores. The ratings, originally intended for internal use, were disclosed after a court ruled in favor of media organizations under the Freedom of Information Act. The teachers' union and education experts criticised the data as unreliable due to large margins of error and failure to account for demographic factors, warning that the release would unfairly shame or praise educators. The Department defended the ratings as a useful perspective on teacher effectiveness.
- Company involved
- New York City Department of Education
- AI system involved
- Teacher Data Reports
6 source articles · read the reporting →
Houston teachers sue over secret EVAAS evaluation algorithm
Houston Independent School District used the SAS Institute's EVAAS system, a proprietary algorithm, to evaluate teacher performance based on student test scores. The Houston Federation of Teachers and several teachers sued in 2014, alleging the system violated their Fourteenth Amendment procedural due process rights because the algorithm is a trade secret and teachers cannot verify the accuracy of their scores. A federal magistrate judge refused to dismiss the procedural due process claims in May 2017, ruling that teachers must have an opportunity to test the accuracy of the scores that could cost them their jobs.
- Company involved
- Houston Independent School District
- AI system involved
- Educational Value-Added Assessment System (EVAAS)
1 source article · read the reporting →
Teachers find no value in SAS EVAAS system in Southwest School District
A study examined the SAS Education Value-Added Assessment System (EVAAS®) used by the Southwest School District (SSD) to evaluate teacher effectiveness for high-stakes consequences. Teachers reported that the system produced inconsistent results, was biased by student factors, and reduced morale and collaboration. The study found that teachers did not use the data formatively as intended, and unintended consequences included heightened pressure and teaching to the test.
- Company involved
- Southwest School District (SSD)
- AI system involved
- SAS Education Value-Added Assessment System (EVAAS®)
10 source articles · read the reporting →
Tesla's Full Self-Driving beta includes assertive mode that may perform rolling stops
Tesla's Full Self-Driving beta software includes driving profiles, including an 'Assertive' mode that may perform rolling stops, follow cars more closely, and change lanes more frequently. The feature was included in an October 2021 update that was briefly pulled due to issues with left turns. In November 2021, a Tesla using FSD mode was involved in a crash that left the vehicle severely damaged.
- Company involved
- Tesla
- AI system involved
- Full Self-Driving (FSD) beta
5 source articles · read the reporting →
Elite: Dangerous identifies AI weapon bug causing impossible ship attacks
A patch for Elite: Dangerous introduced a bug that allowed AI ships to equip impossible weapon combinations, leading to players being swiftly destroyed. Frontier Developments quickly removed NPC weapon modifications as a temporary fix and identified the core issue as the game fetching incorrect data for weapon stats. The developers plan to implement a permanent fix by early next week.
- Company involved
- Frontier Developments
- AI system involved
- Elite: Dangerous
10 source articles · read the reporting →
Domino's Pizza's AI pizza checker monitors workers and scores franchise stores
Domino's Pizza introduced the Dom Pizza Checker, a machine-learning camera system, in its Australia and New Zealand stores. The system checks whether pizzas meet order and quality standards and orders workers to remake any that do not. It is also to be used in a franchise scorecard to identify underperforming stores. Domino's said the tool was for training team members, not for punishing mistakes.
- Company involved
- Domino's Pizza
- AI system involved
- Dom Pizza Checker
9 source articles · read the reporting →
Walgreens deploys digital cooler doors with ads from Cooler Screens
Walgreens is rolling out digital cooler doors from Cooler Screens that display ads before showing the cooler contents. The system tracks when customers stop in front of the doors but claims to be identity-blind. Customers have expressed confusion and annoyance on social media. Walgreens says the screens provide relevant product information.
- Company involved
- Walgreens
- AI system involved
- Cooler Screens
10 source articles · read the reporting →
Shipt's new V2 algorithm reduces pay for 41% of workers, study finds
A study by MIT Media Lab and Coworker.org found that Shipt's new V2 payment algorithm reduced pay for 41% of workers by an average of 11% per shop. The algorithm, rolled out in September 2020, replaced a transparent payment system with a black-box model. Workers pooled data to analyze the impact, revealing uneven distribution of earnings.
- Company involved
- Shipt
- AI system involved
- V2
10 source articles · read the reporting →
DWP's Universal Credit algorithm causes underpayment and hardship for claimants
The Department for Work and Pensions (DWP) uses an automated means-testing algorithm in its Universal Credit system that miscalculates earnings due to a design flaw, leading to underpayments and fluctuating benefit amounts. Claimants such as Janet R. received payments hundreds of pounds short, forcing them into debt and foodbank use. A Court of Appeal ruling in June 2020 ordered the DWP to fix the flaw, but the department had not yet fully implemented the remedy at the time of writing.
- Company involved
- Department for Work and Pensions
- AI system involved
- Universal Credit
10 source articles · read the reporting →
Wisconsin’s dropout prediction algorithm labels students high risk with racial bias
Wisconsin’s Dropout Early Warning System (DEWS) uses machine learning to predict middle school students' likelihood of graduating on time, relying on factors including race and income. The Markup found the algorithm frequently mislabels students, with a higher false alarm rate for Black and Hispanic students. The Wisconsin Department of Public Instruction has not informed schools of the racial disparities and continues to use the system.
- Company involved
- Wisconsin Department of Public Instruction
- AI system involved
- Dropout Early Warning System (DEWS)
10 source articles · read the reporting →
DCPS used allegedly false test scores in teacher value-added evaluations
The District of Columbia Public Schools used student test scores from schools under investigation for cheating in value-added calculations for teacher evaluations. More than 200 teachers were terminated based on these evaluations. Teachers can appeal their ratings to the chancellor, but decisions will not be made before the next school year. The school system removes affected scores only when cheating is confirmed.
- Company involved
- District of Columbia Public Schools
- AI system involved
- value-added model
10 source articles · read the reporting →
Stable Diffusion amplifies racial and gender stereotypes in generated images
An analysis by Bloomberg of over 5,000 images generated by Stability AI's Stable Diffusion found that the text-to-image model amplifies racial and gender stereotypes. The model overrepresented lighter-skinned men in high-paying jobs and darker-skinned people in low-paying jobs, and underrepresented women in positions of power. Stability AI acknowledged the inherent biases in its models and stated it is working on mitigation.
- Company involved
- Stability AI
- AI system involved
- Stable Diffusion
8 source articles · read the reporting →