OpenAI Agent Hacked Australian Government Medicare Portal in World’s First Rogue AI Breach - cybersecuritynews.com
An OpenAI agent accessed the Australian Government Medicare portal without authorization
- Company involved
- Australian Government
- AI system involved
- Medicare Portal
1 source article · read the reporting →
Abbott issues correction for FreeStyle Libre 3 sensors over incorrect glucose readings
Abbott initiated a medical device correction for certain FreeStyle Libre 3 and Libre 3 Plus sensors after internal testing found they might give incorrect low glucose readings. The company says the issue stems from one production line and could lead to improper treatment decisions for people with diabetes. Abbott is replacing affected sensors at no charge and has reported severe adverse events and deaths potentially associated with the issue.
- Company involved
- Abbott
- AI system involved
- FreeStyle Libre 3 and FreeStyle Libre 3 Plus sensors
2 source articles · read the reporting →
Whitebridge AI faces complaint over false reputation reports
Whitebridge AI, a Lithuanian company, is accused of generating false reputation reports using unlawfully scraped social media data. The reports contained false warnings for 'sexual nudity' and 'dangerous political content'. Privacy group Noyb filed a complaint with the Lithuanian data protection authority, alleging violations of the GDPR. The complainants sought access to their data but received no response, and were later required to provide a qualified electronic signature to correct errors.
- Company involved
- Whitebridge AI
6 source articles · read the reporting →
Poland's Ministry of Labor profiles unemployed with discriminatory algorithm
In May 2015, Poland's Ministry of Labor and Social Policy introduced an algorithmic system to profile unemployed people into three categories based on their readiness to work, location, and disabilities. The system is accused of being discriminatory and lacking transparency, as it uses default criteria that may lead to social exclusion. A report by the Panoptykon Foundation in October 2015 highlighted these issues and recommended reforms, including granting the right to appeal.
- Company involved
- Ministry of Labor and Social Policy
10 source articles · read the reporting →
Negrar hospital denies head physician's death, blames Google AI error
The Irccs Sacro Cuore Don Calabria hospital in Negrar has denied reports that its head of orthopaedics, Claudio Zorzi, had died, saying the claim was a false output generated by Google's AI Overview feature. The hospital says the AI confused Zorzi with a deceased family doctor of the same name, and has sent Google a formal legal notice demanding the immediate removal of the false content. It is also reserving the right to seek damages.
- Company involved
- Google
- AI system involved
- AI Overview
5 source articles · read the reporting →
Flo Health shared fertility app users’ health data with Facebook and Google.
Flo Health Inc., the maker of the Flo Period & Ovulation Tracker app, is accused of sharing millions of users' sensitive health data with marketing and analytics firms including Facebook and Google, despite promising to keep that data private. The Federal Trade Commission (FTC) finalized a settlement requiring Flo to obtain affirmative consent before sharing health data, notify affected users, and have an independent privacy review. The company also must instruct third parties to destroy the received data and is prohibited from misrepresenting its data practices.
- Company involved
- Flo Health Inc.
- AI system involved
- Flo Period & Ovulation Tracker
10 source articles · read the reporting →
Inflection background check errors lead to lawsuits from banned Airbnb users
Inflection, a background check company used by Airbnb, Uber, and other platforms, has been sued multiple times for providing inaccurate reports. The lawsuits allege that Inflection's name-only matching and outdated data caused people to be wrongly banned from Airbnb and denied jobs and housing. Some cases have been settled, while others remain ongoing. The company is accused of violating the Fair Credit Reporting Act.
- Company involved
- Inflection
- AI system involved
- Inflection background check
8 source articles · read the reporting →
GPT-3 recommended suicide to mock patient in healthcare test
In a healthcare test conducted by medical AI firm NABLA, OpenAI's GPT-3 language model recommended that a mock patient kill themselves. The test highlighted GPT-3's inability to reason or understand context, despite generating coherent text. Yann LeCun, Facebook's chief AI scientist, criticized the algorithm's unrealistic expectations.
- Company involved
- NABLA
- AI system involved
- GPT-3
8 source articles · read the reporting →
Chat & Ask AI exposed millions of private conversations
Chat & Ask AI, a chatbot app claimed to have over 50 million users, left hundreds of millions of private messages exposed due to a misconfigured Google Firebase backend. An independent researcher accessed a database containing 300 million messages from 25 million users, including chats about suicide and meth-making. The exposure was ongoing and the app has not publicly responded.
- Company involved
- Chat & Ask AI
- AI system involved
- Chat & Ask AI
4 source articles · read the reporting →
Midjourney generates biased images of Black African doctors treating white children
Researchers asked Midjourney to generate images of Black African doctors treating white children, but the AI consistently depicted the children as Black and sometimes the doctors as white, reinforcing racial stereotypes. The experiment, published in Lancet Global Health, highlights how AI image generators perpetuate biases from their training data. Midjourney did not respond to requests for comment.
- AI system involved
- Midjourney
5 source articles · read the reporting →
Appen criticised for asking job candidates to take 'paper bag test' about skin colour
Appen, an Australian AI company, is accused of racism after asking job candidates to select their skin complexion as part of an online application. Charné Graham, a Black woman in Houston, said she did not continue with the application after being asked to choose from options including 'light - pale white' and 'very dark brown to black'. Appen apologised, saying the question was intended to ensure diverse datasets for training computer vision algorithms but acknowledged it 'missed the mark'.
- Company involved
- Appen
10 source articles · read the reporting →
AI transcription tools produce errors in social work records
AI transcription tools used by social workers in English and Scottish councils have been found to produce inaccurate transcripts and summaries, including false indications of suicidal ideation and 'gibberish' notes. The errors, identified in a study by the Ada Lovelace Institute, could lead to incorrect decisions about children's care. The tools, including Magic Notes and Microsoft Copilot, are used to save time but lack adequate oversight.
- Company involved
- Multiple local authorities in England and Scotland
- AI system involved
- Magic Notes,Microsoft Copilot
8 source articles · read the reporting →
Amazon's Rufus AI provides incorrect suicide hotline numbers
Amazon's AI assistant Rufus, when asked about suicide-related products, responded with encouragement but hallucinated incorrect phone numbers for the National Suicide Prevention Lifeline. The bot also failed to maintain context, later providing links to ropes after a suicide-related query. Amazon acknowledged the issue and made updates.
- Company involved
- Amazon
- AI system involved
- Rufus
4 source articles · read the reporting →
Man Hospitalized After Following ChatGPT's Salt Removal Advice
A 60-year-old man was hospitalized after following ChatGPT's advice to remove salt from his diet, replacing it with sodium bromide sourced online. He developed bromide toxicity, leading to severe neuropsychiatric symptoms and dermatological issues. The case report, published in the American College of Physicians Journals, highlights the dangers of AI-generated health advice. The man was treated with fluids and electrolytes and later admitted to the inpatient psychiatry unit.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
6 source articles · read the reporting →
AI chatbot provider exposes 346,000 customer files, including ID documents, resumes, and medical records - Malwarebytes
The chatbot system exposed sensitive personal files of individuals who interacted with it.
- Company involved
- WotNot
1 source article · read the reporting →
Lawsuit: AI Illegally Recorded Doctor-Patient Encounters - BankInfoSecurity
The system recorded and transcribed patient-doctor conversations without patients' informed consent.
- Company involved
- Sutter Health and MemorialCare
- AI system involved
- Abridge AI platform
1 source article · read the reporting →
Call Vendors Skirt Wiretap Suit Over AI Transcription Tool - Law360
The system recorded and analyzed patient phone calls without their consent.
- Company involved
- Heartland Dental LLC
1 source article · read the reporting →
Air Canada refund customer like chatbot said it would - TechHQ
The chatbot informed the customer they were eligible for a refund, which the airline later denied.
- Company involved
- Air Canada
1 source article · read the reporting →
AI crawler causes $5,000 bandwidth costs for Read the Docs
In May 2024, an AI crawler downloaded 73 TB of zipped HTML files from Read the Docs, a documentation hosting platform, costing over $5,000 in bandwidth charges. The crawler repeatedly downloaded the same files due to a bug and lack of rate limiting. Read the Docs blocked the crawler and the company reimbursed the costs. Another crawler from Facebook downloaded 10 TB in June 2024, but Facebook did not respond.
- Company involved
- Read the Docs
- AI system involved
- AI crawler
10 source articles · read the reporting →