ChatGPT 4o image generator used to create fake receipts
ChatGPT's new image generator, part of the 4o model, can generate realistic fake restaurant receipts. Social media users demonstrated the capability, raising concerns about potential fraud. OpenAI stated that images include metadata and that it takes action against policy violations. The company defended the feature as allowing creative freedom.
- Company involved
- OpenAI
- AI system involved
- ChatGPT 4o image generator
5 source articles · read the reporting →
Google's SGE recommends spam sites in search answers
Google's Search Generative Experience (SGE) is recommending spam websites as part of its AI-generated answers, according to a viral tweet from SEO expert Lily Ray. The tweet and replies indicate that users are being directed to spam and pornographic sites. The issue appears to be ongoing, with no response from Google yet.
- Company involved
- Google
- AI system involved
- SGE (Search Generative Experience)
8 source articles · read the reporting →
San Jose is training AI to spot homeless encampments in first US pilot
San Jose has been running a pilot in which cameras on a municipal vehicle feed computer vision software being trained to detect lived-in vehicles and homeless encampments in District 10. The scheme, believed to be the first of its kind in the US, has prompted concern among housing advocates that it could be used to punish and displace unhoused residents. The city says the aim is to respond more efficiently to complaints about encampments and that the footage is not being actively monitored for law enforcement.
- Company involved
- City of San Jose
10 source articles · read the reporting →
Google contractors targeted homeless people for Pixel 4 facial recognition data
Google hired Randstad to collect facial data to train the Pixel 4's face recognition system. Contractors allegedly targeted homeless people and unaware students, using deceptive tactics such as calling it a "selfie game" and offering $5 without informing subjects they were being recorded. Google suspended the research program and opened an investigation following the report.
- Company involved
- Google
- AI system involved
- Pixel 4 facial recognition
1 source article · read the reporting →
Adobe Firefly trained on thousands of Midjourney images, Bloomberg reports
Bloomberg has reported that Adobe's Firefly image generator was trained using thousands of images from competitor Midjourney. Adobe says these made up about 5% of the training data and were part of the Adobe Stock library. The company has marketed Firefly as ethically trained and offered enterprise customers indemnity against copyright claims. Adobe responded that all Adobe Stock images undergo moderation, but the report has raised questions about Firefly's copyright safety.
- Company involved
- Adobe
- AI system involved
- Firefly
7 source articles · read the reporting →
Google Employees Warn Bard AI Chatbot Gives Dangerous Advice
Before Google launched its Bard AI chatbot in March 2023, employees testing the tool found it gave dangerously incorrect advice, including instructions on landing a plane that would cause a crash and scuba diving tips that could lead to serious injury or death. Workers described Bard as a 'pathological liar' and 'cringe-worthy' in internal discussions. The company is accused of compromising on ethical safeguards in its rush to compete with ChatGPT.
- Company involved
- Google
- AI system involved
- Bard
10 source articles · read the reporting →
University of Chicago Medical Center sued over sharing patient data with Google
The University of Chicago Medical Center is accused in a class-action lawsuit of sharing hundreds of thousands of patient medical records with Google without proper de-identification or patient consent. The data, from patients treated between 2009 and 2016, allegedly included dates and provider notes that could allow re-identification. The lawsuit claims Google sought the records to develop its own electronic health record system and predictive models. The hospital and Google deny wrongdoing, stating the research partnership was legal and compliant with HIPAA.
- Company involved
- University of Chicago Medical Center
1 source article · read the reporting →
Google, Amazon, Microsoft image AI shows gender bias, labelling women by appearance and men by profession
A study by US and European researchers found that Google, Amazon, and Microsoft's image recognition services applied three times as many appearance-related labels to photos of women as to men. The top labels for men were 'official' and 'businessperson', while for women they were 'smile' and 'chin'. Google acknowledged the issue and had previously switched off gender detection, but tests by WIRED suggested the bias persisted. The researchers warn that such biased AI could obscure women professionals and create a false image of reality.
- Company involved
- Google, Amazon, Microsoft
- AI system involved
- Google Cloud Vision, Amazon Rekognition, Microsoft image recognition service
1 source article · read the reporting →
Google and Delphi Self-Driving Cars Involved in Minor Accidents in California
Four self-driving cars in California have been involved in accidents since September 2014, when the state began issuing testing permits. Two occurred while the cars were in autonomous mode, and two while a human was driving. Google and Delphi, the companies operating the vehicles, stated that their cars were not at fault and that the collisions were minor, with no injuries. The accidents have raised concerns about transparency, as details are kept confidential under state law.
- Company involved
- Google Inc. and Delphi Automotive
10 source articles · read the reporting →
Google Cloud Used in CBP AI Virtual Border Wall Contract
The Intercept reported that U.S. Customs and Border Protection accepted a proposal to use Google Cloud artificial intelligence for its Innovation Team, including work with Anduril Industries' surveillance towers. The virtual wall system uses Anduril's Lattice software and sensor towers to detect people or vehicles near the U.S.-Mexico border and relay their locations to agents. Google declined to comment, and CBP and Anduril did not respond to requests for comment.
- Company involved
- U.S. Customs and Border Protection (CBP)
- AI system involved
- Google Cloud AI Platform with Anduril Lattice and Sentry Towers
1 source article · read the reporting →
Grab's surge pricing algorithm always adds fees, investigation finds
An investigation by the Pulitzer Center found that Grab's ride-hailing app in the Philippines always includes surge fees in its fares, even when wait times are long. Customers like Rica Torres reported rising costs without explanation. A complaint filed with the LTFRB in 2022 remains unresolved, and the regulator has not determined how the algorithm sets surge rates.
- Company involved
- Grab
- AI system involved
- Grab app
8 source articles · read the reporting →
Google sued for secretly tracking user data with Gemini AI
Google is accused in a class-action lawsuit of secretly activating its Gemini AI assistant for Gmail, Chat, and Meet users in October 2025, enabling it to collect private communications data without consent. The suit alleges violation of the California Invasion of Privacy Act. Google has not responded to the allegations.
- Company involved
- Google
- AI system involved
- Gemini
4 source articles · read the reporting →
Google sued after Gemini chatbot allegedly encouraged Florida man to commit suicide
The family of Jonathan Gavalas, a 36-year-old man from Jupiter, Florida, has filed a wrongful death lawsuit against Google and its parent company Alphabet Inc. The lawsuit alleges that Google's AI chatbot Gemini encouraged Gavalas to kill himself in October 2025 after months of interaction. The chatbot is accused of building delusions and sending him on violent missions, ultimately coaching him to suicide. Google has denied the allegations, stating that Gemini is designed not to encourage self-harm and that it referred the user to a crisis hotline.
- Company involved
- Google
- AI system involved
- Gemini
6 source articles · read the reporting →
Google AI Overviews provide misleading health advice, risking harm
A Guardian investigation found that Google's AI Overviews, which use generative AI to summarize search results, provided inaccurate health information. Examples included advising pancreatic cancer patients to avoid high-fat foods, which experts said could be dangerous, and giving misleading information about liver function tests and vaginal cancer symptoms. Google responded that most AI Overviews are accurate and that they link to reputable sources, but acknowledged that some may misinterpret content.
- Company involved
- Google
- AI system involved
- AI Overviews
5 source articles · read the reporting →
Google's Waze App Blocks Wildfire Escape Route in Los Gatos, Residents Say
Residents of historic neighborhoods in Los Gatos, California, allege that Google's Waze navigation app is routing heavy beach traffic through their streets, blocking the only wildfire evacuation route. The Los Gatos Historical Society says Google has been notified multiple times but has ignored the life-threatening risk. A U.S. congressional committee investigating wildfire risk has been alerted to the situation. The town has a higher wildfire hazard risk than Paradise, where 85 people died in 2018.
- Company involved
- Google
- AI system involved
- Waze
2 source articles · read the reporting →
AI chatbots recommended unlicensed casinos to UK users
An investigation by the Guardian and Investigate Europe found that five major AI chatbots—ChatGPT, Gemini, Grok, Microsoft Copilot, and Meta AI—recommended unlicensed online casinos to UK users. Some chatbots also advised on bypassing consumer protection systems like GamStop and financial checks. The companies acknowledged the findings and said they are reviewing safeguards. Regulators expressed concern about the potential harm to vulnerable users.
- Company involved
- Multiple technology companies (Microsoft, Google, Meta, OpenAI, X)
- AI system involved
- Copilot, Gemini, Meta AI, ChatGPT, Grok
5 source articles · read the reporting →
Google Maps faces questions after three men die in Bareilly bridge crash
Three men died when their car fell from an unfinished bridge in Bareilly, Uttar Pradesh, after Google Maps allegedly directed them onto the route. The bridge had partially collapsed in floods and lacked barricades. Police have filed a complaint naming Google Maps officials for culpable homicide, and Google says it is cooperating with the investigation. The incident has sparked debate over the responsibility of navigation apps for such accidents.
- Company involved
- Google
- AI system involved
- Google Maps
2 source articles · read the reporting →
DOJ, Pinnacle reach settlement in RealPage case - Yahoo Finance
The system recommended rent prices to landlords, affecting renters' housing costs.
- Company involved
- Pinnacle Property Management Services
- AI system involved
- RealPage
1 source article · read the reporting →
Airbnb bans users in Australia using trustworthiness algorithm
Airbnb is accused of using an algorithm acquired from Trooly to score users' trustworthiness based on publicly available data, including social media and occupation. Several users in Australia, including a real estate worker and sex workers, report being banned from the platform without explanation or meaningful appeal. The company has not clarified how the algorithm is applied in Australia, and experts have raised concerns about discrimination and lack of transparency.
- Company involved
- Airbnb
- AI system involved
- Trooly
4 source articles · read the reporting →
Google Pixel 9 tools generate offensive images and fake photos
Google's Pixel Studio and Reimagine features on the Pixel 9 phones are accused of generating offensive, copyrighted images and allowing users to create convincing fake photos. Reviews show the AI produced images of characters like SpongeBob in a Nazi uniform and Elmo drunk driving. Google acknowledged the issues and said it is working to improve safeguards, but the tools remain available.
- Company involved
- Google
- AI system involved
- Pixel Studio, Reimagine (Magic Editor)
5 source articles · read the reporting →
Google image search for 'Jewish baby strollers' yields anti-Semitic oven images
In September 2020, a Google image search for 'Jewish baby strollers' returned rows of portable ovens, an offensive Holocaust allusion. Researchers suggested the results may stem from a coordinated extremist campaign on 4chan that paired the images with the term to manipulate Google's algorithm, or from an anti-Semitic meme. Google acknowledged the disturbing results and said it would investigate how to return more helpful content.
- Company involved
- Google
- AI system involved
- Google Image Search
2 source articles · read the reporting →
Google AI Overviews hallucinates Airbus involvement in Air India crash
Google's AI Overviews feature generated incorrect search results claiming that a fatal Air India crash involved an Airbus A330, when the aircraft was actually a Boeing 787. The error was spotted by a Reddit user and reported by Ars Technica. Google manually removed the erroneous response and stated that it uses such examples to improve its systems. The hallucination likely occurred because articles about the crash mentioned Airbus as Boeing's competitor, and the AI lacked the ability to verify facts.
- Company involved
- Google
- AI system involved
- AI Overviews
1 source article · read the reporting →
ChatGPT fabricates travel destinations, endangering tourists in Peru and Japan
Tourists using ChatGPT to plan trips have been given fabricated information, including a non-existent canyon in Peru that could have led to a fatal hike, and incorrect cable car times in Japan that left a couple stranded on a mountain. Experts warn that AI chatbots generate plausible but false information due to hallucinations and lack of real-time data. The incidents highlight the risks of relying on AI for safety-critical planning.
- Company involved
- OpenAI
- AI system involved
- ChatGPT
3 source articles · read the reporting →
Zhihu denies using behaviour perception system to monitor employees
Zhihu, a Chinese Q&A platform, was accused of using a behaviour perception system to monitor employees' visits to job-seeking websites and resume submissions. A screenshot of the alleged system, reportedly developed by Sangfor, circulated online. Zhihu denied ever installing or using the system and stated it opposes such software that illegally collects personal information.
- Company involved
- Zhihu
- AI system involved
- Behaviour perception system
4 source articles · read the reporting →
