AI-Generated Fake Photo of Orlando West High School Fire Causes Outrage and EMS Warning
A fake AI-generated photo depicting Orlando West High School in Soweto on fire was circulated online, prompting an investigation by Johannesburg Emergency Management Services. EMS spokesperson Kagiso Phasha confirmed the image was a hoax and warned that such pranks cause unnecessary expenditure and divert critical resources. The incident has sparked outrage and a stern warning that those responsible will face legal consequences.
2 source articles · read the reporting →
Amazon hid rising injury rates at robotic warehouses
Internal records obtained by Reveal show Amazon misled the public about worker safety, with serious injury rates at its fulfilment centres rising 33% from 2016 to 2019. Robotic warehouses had significantly higher injury rates than traditional sites, and injuries spiked during Prime Day and Cyber Monday, contrary to Amazon's claims. The company's own safety reports show it failed to meet reduction targets, while workers report that robots increased production quotas to unsustainable levels.
- Company involved
- Amazon
- AI system involved
- Amazon robotic fulfilment system
2 source articles · read the reporting →
Waze App Routed Drivers Toward LA Wildfire Zones
During the December 2017 Los Angeles wildfires, the Waze navigation app reportedly directed drivers towards roads with light traffic that were empty because fires were burning nearby. The Los Angeles Police Department asked residents to avoid such apps. Waze responded by closing approximately 443 road segments in consultation with the L.A. Department of Transportation and stated that its crisis response team worked to update maps in real time. No injuries were reported, but the incident exposed the risks of relying on real-time routing algorithms during natural disasters.
- Company involved
- Waze
- AI system involved
- Waze
10 source articles · read the reporting →
U.S. Geological Survey’s ShakeAlert System Sends False Earthquake Alert to Cellphones
Last week, the ShakeAlert early earthquake warning system managed by the U.S. Geological Survey issued a false alert for a magnitude-5.9 earthquake near Dayton, Nevada. The automated system sent critical alerts to cellphones hundreds of miles away, urging people to drop and hold on to something sturdy. The USGS blamed a technical glitch for the false alarm, and California lawmakers have demanded answers regarding the cause and the system’s verification safeguards.
- Company involved
- U.S. Geological Survey
- AI system involved
- ShakeAlert
2 source articles · read the reporting →
NSW Reconstruction Authority data breach exposes 2031 people's info via ChatGPT
A former temporary staff member of the NSW Reconstruction Authority uploaded personal information of 2031 Northern Rivers Resilient Homes Program applicants to ChatGPT without authorisation. The data included names, contact details, dates of birth, and sensitive health information. The breach occurred between 12 and 15 March 2025. The authority has notified affected individuals, reported the breach to the NSW Privacy Commissioner, and implemented measures to prevent future unauthorised use of AI tools.
- Company involved
- NSW Reconstruction Authority
- AI system involved
- ChatGPT
2 source articles · read the reporting →
AI-generated Centrelink phishing emails target 270,000 Australians
More than 270,000 fake emails impersonating Services Australia and Centrelink were detected over four months in a broad phishing campaign. Cybersecurity firm Mimecast reports that cybercriminals are using artificial intelligence to create highly convincing clones of legitimate government communications about benefits. The attack targets vulnerable people and can lead to identity theft, data theft, malware, or ransomware.
- Company involved
- Services Australia
4 source articles · read the reporting →
Baltimore County Schools Relocate Students After AI Gun False Alarm
On November 7, 2025, an AI security system called Omnilert reported a possible gun at Parkville High School in Baltimore County, Maryland. Students were relocated while police searched the school, but no threat was found. The incident follows a similar false alarm at Kenwood High School in October, where Omnilert mistook a bag of chips for a gun, leading to students being handcuffed. Baltimore County Public Schools has promised annual training on protocols for responding to Omnilert alerts.
- Company involved
- Baltimore County Public Schools
- AI system involved
- Omnilert
1 source article · read the reporting →
Facebook's spam filter blocks vital wildfire safety warnings, endangering lives
Facebook's automated spam detection system has been flagging and removing posts containing critical wildfire safety information, including updates from volunteer groups and official agencies. The removals, which began increasing in June 2024, have affected residents in California and other western states during a severe wildfire season. Users report not being notified of the removals, and appeals have gone unanswered. Facebook says it is investigating the issue.
- Company involved
- Facebook
3 source articles · read the reporting →
Apple Intelligence feature flags scam messages as priority alerts
Apple's 'Apple Intelligence' notification summarisation feature, introduced in late 2024, is reportedly prioritising scam messages on iPhones, iPads, and Macs. Users have reported that the AI struggles to differentiate fraudulent emails from genuine alerts, with one user seeing a scam email claiming he owed $465 flagged as a priority. Experts warn that the summarisation removes context, potentially making scams more effective. Apple has stated it plans to update the feature to clarify when summaries are AI-generated.
- Company involved
- Apple
- AI system involved
- Apple Intelligence
5 source articles · read the reporting →
Royal Free London publishes audit into Streams app data processing
The Royal Free London NHS Foundation Trust published an audit into its use of the Streams app, following an investigation by the Information Commissioner's Office (ICO) in July 2017. The Streams app alerts clinicians to patients at risk of acute kidney injury. The audit, conducted by Linklaters, concluded that the trust's use of Streams was lawful and complied with data protection laws, although areas for improvement were identified. The ICO later recognised that the trust had completed all required actions.
- Company involved
- Royal Free London NHS Foundation Trust
- AI system involved
- Streams
10 source articles · read the reporting →
Guy's and St Thomas' NHS Trust warns of AI-generated fake doctor weight loss videos
Guy's and St Thomas' NHS Foundation Trust issued an alert after AI-generated videos on social media falsely showed its doctors endorsing weight loss patches. The videos, found on Facebook and TikTok, are fraudulent and the trust is working to have them taken down. A financial crime expert said the scam aims to sell a herbal product by bypassing rational responses. The BBC contacted the company behind the products but received no response.
1 source article · read the reporting →
Google Flu Trends underestimates US flu outbreak
Google Flu Trends, an automated system using search query data to estimate flu activity, failed to predict the severity of the 2012-2013 US flu outbreak, underestimating the impact. The algorithm's predictions diverged from actual surveillance data, raising concerns about relying on web-based methods for disease tracking. The article reports the discrepancy as a failure of the model.
- Company involved
- Google
- AI system involved
- Google Flu Trends
10 source articles · read the reporting →
Nurse at St. Rose Dominican Hospital Averts AI-Sepsis Alert Error
A nurse at St. Rose Dominican Hospital in Henderson, Nevada, refused to follow an AI-generated sepsis alert that would have given an elderly dialysis patient IV fluids, which could have caused a life-threatening complication. The alert, part of the hospital's electronic system, prompted a charge nurse to order the fluids despite the patient's compromised kidneys. A physician intervened and ordered dopamine instead, averting harm. The incident highlights concerns about AI tools overriding clinical judgment.
- Company involved
- St. Rose Dominican Hospital
1 source article · read the reporting →
Center for Auto Safety petitions NHTSA over Nissan Rogue AEB false activations
The Center for Auto Safety petitioned NHTSA to investigate false activations of the Automatic Emergency Braking (AEB) system on 2017-2018 Nissan Rogue vehicles. The system reportedly engages abruptly when no obstruction is present, causing near misses and forcing following drivers to take evasive action. Nissan issued a Technical Service Bulletin to dealers but has not conducted a safety recall. The petition seeks a formal investigation and a determination that the defect poses an unreasonable risk to safety.
- Company involved
- Nissan
- AI system involved
- Automatic Emergency Braking (AEB)
5 source articles · read the reporting →
Apple iPhone crash detection triggers false 911 calls from skiers in Colorado
Apple's crash detection feature on iPhone 14 and Apple Watch automatically calls 911 when it detects a sudden stop, but on ski slopes it misinterprets falls as car crashes. Dispatch centers in Colorado ski towns received dozens of false calls daily, diverting resources from real emergencies. Apple acknowledged the issue and said it is working on a fix, but the problem persists.
- Company involved
- Apple Inc.
- AI system involved
- Crash detection and fall detection on iPhone 14 and Apple Watch
10 source articles · read the reporting →
Cense exposed 2.5 million records of auto accident victims online
On July 7, 2020, a security researcher discovered 2.5 million records containing personal and medical data of auto accident victims exposed online. The records, belonging to New York-based AI company Cense, included names, insurance policy numbers, claim numbers, and medical diagnosis notes. The data was labeled as staging data, possibly intended for temporary storage before being loaded into an AI system. After the researcher sent a responsible disclosure notice, Cense restricted public access to the database.
- Company involved
- Cense
- AI system involved
- Cense
5 source articles · read the reporting →
Woman sues Google over unsafe walking directions
Lauren Rosenberg alleges that Google Maps provided walking directions that led her onto a busy road without sidewalks in Park City, Utah, where she was struck by a motorist and suffered severe injuries. She filed a lawsuit against Google Inc. in U.S. District Court in Utah, seeking over $100,000 in damages. The mobile version of Google Maps did not display a safety warning that was present on the computer version.
- Company involved
- Google Inc.
- AI system involved
- Google Maps
10 source articles · read the reporting →
Cruise robotaxi hits San Francisco fire truck, one injured
A Cruise self-driving car collided with a San Francisco Fire Department truck that was responding to an emergency. The incident occurred on August 17, 2023, in the Tenderloin district. One passenger sustained non-severe injuries and was taken to hospital. Cruise acknowledged the crash and offered support to the rider.
- Company involved
- Cruise
- AI system involved
- Cruise self-driving car
10 source articles · read the reporting →
Environment Agency's automated flood warnings cause false alarms and late alerts
The Environment Agency in England has made its automated flood warning system permanent despite inaccuracies. The system, trialled during strikes, issues alerts based on sensor thresholds without human review. Residents have reported false alarms, such as a warning of severe flooding on the River Severn that never materialised, and late warnings, including an alert for the River Wye that arrived 24 hours after peak water levels and after a home was already flooded. The agency acknowledges the feedback and says it will review the system.
- Company involved
- Environment Agency
- AI system involved
- Automated flood warning system
10 source articles · read the reporting →
UnitedHealth used ALERT algorithm to limit mental health coverage, regulators found
ProPublica reports that UnitedHealth Group's Optum subsidiary used the ALERT algorithm to flag mental health patients and therapists as outliers, leading to therapy coverage denials. Regulators in California, Massachusetts and New York alleged this breached the federal Mental Health Parity and Addiction Equity Act, and UnitedHealth agreed to restrict the system in those jurisdictions. The company denies wrongdoing and says its programmes are compliant. Affected patients, including Medicaid enrollees, were left to pay out-of-pocket or go without care.
- Company involved
- UnitedHealth Group
- AI system involved
- ALERT
5 source articles · read the reporting →
Chicago class action challenges ShotSpotter's discriminatory stop-and-frisk deployments
ShotSpotter, a gunshot detection system used by the Chicago Police Department, generates alerts that lead to police deployments and stop-and-frisk stops. Analyses show over 90% of alerts are unfounded, and the system is deployed only in predominantly Black and Latinx districts. A class-action lawsuit against the City of Chicago alleges the system fuels unconstitutional and discriminatory policing, including false accusations against individuals like Michael Williams.
- Company involved
- City of Chicago
- AI system involved
- ShotSpotter
7 source articles · read the reporting →
ICO investigates Microsoft's Recall feature for privacy risks
The UK Information Commissioner's Office (ICO) has issued a statement on 22 May 2024 regarding Microsoft's Recall feature. The ICO is making enquiries with Microsoft to understand the safeguards in place to protect user privacy, expecting transparency and necessity in data processing. This follows concerns that the feature may not adequately consider data protection from the outset before being brought to market.
- Company involved
- Microsoft
- AI system involved
- Recall
10 source articles · read the reporting →
Baltimore schools monitor student laptops for suicide signs using GoGuardian Beacon
Baltimore City Public Schools uses GoGuardian Beacon software to monitor student laptops for signs of suicide. Since March 2021, the system has flagged 786 alerts, with nine students taken to emergency rooms. Privacy advocates warn the monitoring could lead to disciplinary actions, outing of LGBTQ students, and disproportionately affect disadvantaged students. School officials defend the practice as a safeguard.
- Company involved
- Baltimore City Public Schools
- AI system involved
- GoGuardian Beacon
10 source articles · read the reporting →
Eventbrite algorithm recommended illegal opioid sales to addiction recovery seekers
Eventbrite's recommendation algorithm promoted thousands of listings selling illegal prescription drugs like oxycodone and Xanax alongside addiction recovery events. The listings, which appeared in search results and related events, directed users to unlicensed online pharmacies. Eventbrite acknowledged the issue and removed the listings after WIRED alerted them.
- Company involved
- Eventbrite
- AI system involved
- Eventbrite recommendation algorithm
4 source articles · read the reporting →
