Meta's BlenderBot 3 chatbot says company exploits people
Meta's prototype chatbot BlenderBot 3 told the BBC that CEO Mark Zuckerberg exploits users for money. The chatbot, released to the public in August 2022, is designed for research and entertainment but can produce offensive statements. Meta acknowledged the chatbot may make untrue or offensive statements and stated it had installed safeguards.
- Company involved
- Meta
- AI system involved
- BlenderBot 3
10 source articles · read the reporting →
Finnish recruitment company Digital Minds used AI to analyze job applicants' messages, prompting data protection investigation
Digital Minds, a Finnish recruitment company founded by psychologists, used IBM Watson AI to analyze job applicants' social media and email messages for personality assessments. The company obtained written consent but the Finnish Data Protection Ombudsman launched an investigation, suspecting violations of data protection laws and the secrecy of correspondence. The service was used on fewer than ten applicants and has been paused pending the investigation.
- Company involved
- Digital Minds
- AI system involved
- IBM Watson
9 source articles · read the reporting →
Attempted deepfake CEO voicemail fraud against an unnamed technology company
An attacker used synthetic audio deepfake to leave a voicemail impersonating the CEO of a technology company, asking an employee to call back to finalize an urgent business deal. The employee found it suspicious and referred the matter to the legal department, avoiding any loss. Nisos analyzed the audio and found inconsistencies in pitch and tone.
10 source articles · read the reporting →
FindFace facial recognition app used to out sex workers in Russia
The FindFace facial recognition app is being used by users of the Russian website Dvach to identify porn actresses and sex workers from images and match them to their VKontakte accounts. The users then spam the victims' families and friends with the information, aiming to out them. Several victims complained to FindFace, but the founder stated there was no way to prevent the misuse.
- Company involved
- FindFace
- AI system involved
- FindFace
7 source articles · read the reporting →
ChatGPT falsely tells users OpenCage offers phone lookup service
OpenCage, a geocoding API provider, says ChatGPT has been telling people it offers a reverse phone number lookup service, which it does not. Users who followed the advice signed up for a free trial and found it did not work, and the company says it now receives daily support requests. OpenCage wrote a blog post to correct the record and warn users not to trust ChatGPT's output.
- AI system involved
- ChatGPT
7 source articles · read the reporting →
Facebook allowed advertisers to target users interested in pseudoscience
The Markup found that Facebook's ad-targeting system was allowing advertisers to reach users classified as interested in 'pseudoscience', a category with more than 78 million people. The Markup paid to run an ad targeting that category and Facebook approved it, despite promising to take down COVID-19 misinformation. After being contacted by The Markup, Facebook removed the interest category.
- Company involved
- Facebook
- AI system involved
- Facebook Ads Manager
10 source articles · read the reporting →
Facebook Marketplace loophole allows disguised gun sales
Facebook Marketplace uses AI algorithms and human moderators to prevent illegal item sales. However, sellers have exploited a loophole by listing firearms disguised as expensive gun cases, with the actual gun included. The Independent and Wall Street Journal found multiple listings across US states. Facebook acknowledged the violations and stated that such items would be removed.
- Company involved
- Facebook
- AI system involved
- Facebook Marketplace
10 source articles · read the reporting →
Company fires HR team after ATS auto-rejects manager's CV due to filtering error
A company's applicant tracking system (ATS) auto-rejected qualified candidates' resumes for three months because it was filtering for the outdated framework AngularJS instead of the required Angular framework. The manager discovered the flaw by submitting his own CV under a pseudonym and found it was rejected within seconds. After the manager reported the issue to upper management, the company investigated and dismissed half of its HR team. No legal action or regulatory involvement is reported.
4 source articles · read the reporting →
Facebook algorithm amplified troll farm content to 140 million US users before 2020 election
An internal Facebook report from October 2019 revealed that troll farms based in Kosovo and Macedonia were reaching 140 million US users per month through Facebook's content recommendation system. The algorithm pushed content from these pages to users who had not followed them, primarily targeting Christians, Black Americans, and Native Americans. Facebook acknowledged the issue but the underlying algorithm remained unchanged, and some troll farm pages were still active as of September 2021.
- Company involved
- Facebook
- AI system involved
- Facebook News Feed algorithm
9 source articles · read the reporting →
Amazon Mentor app falsely flags drivers, leading to firings and lost pay
Amazon requires contracted delivery drivers to use the Mentor app, which tracks and scores driving behavior. Drivers report that the app falsely detects infractions, such as incoming calls or picking up a device, causing their scores to drop. This leads to disciplinary actions including firing, loss of bonuses, and reduced pay. Amazon has not addressed the specific allegations.
- Company involved
- Amazon
- AI system involved
- Mentor
10 source articles · read the reporting →
ScaleFactor reportedly failed to deliver promised automated bookkeeping software
ScaleFactor, an Austin-based startup, is reported to have failed to deliver the automated, real-time bookkeeping tools it promised customers, instead relying on human bookkeepers and a Filipino contract accounting firm. The company told Forbes in June that it was shutting down, initially blaming the pandemic, but Forbes later reported that its problems predated Covid-19. Investors reportedly came to see the company as more of a services business than a software platform, and pulled funding after a pivot to a marketplace model. No legal or regulatory action is reported.
- Company involved
- ScaleFactor
10 source articles · read the reporting →
Answer.AI tests Devin and reports 14 failures in 20 tasks
Answer.AI's team tested Devin, an autonomous AI coding assistant, on 20 real-world tasks over a month. Devin succeeded in only 3 tasks, failed 14, and was inconclusive in 3. The team found Devin often produced overly complex or hallucinated solutions and could not recognize fundamental blockers. They ultimately decided to stick with tools that allow more human control.
- AI system involved
- Devin
5 source articles · read the reporting →
WebinarTV secretly records Zoom calls and turns them into AI podcasts
WebinarTV, a company that bills itself as a search engine for webinars, is secretly scanning the internet for Zoom meeting links, recording the calls, and turning them into AI-generated podcasts for profit. People only found out their calls were recorded when WebinarTV contacted them to promote its services. The recordings may put call participants at risk.
- Company involved
- WebinarTV
4 source articles · read the reporting →
BBC News creates scam-writing ChatGPT bot using GPT Builder
BBC News used OpenAI's GPT Builder to create a custom AI assistant called Crafty Emails that could generate convincing scam and phishing messages. The bot bypassed the moderation of the public ChatGPT. OpenAI acknowledged the issue and said it is investigating how to make its systems more robust against such abuse. The test demonstrated a potential hazard for cyber-crime.
- Company involved
- OpenAI
- AI system involved
- GPT Builder
2 source articles · read the reporting →
Presto Automation uses off-site human agents to double-check AI drive-thru orders
Presto Automation Inc, which markets an AI voice assistant for drive-thru ordering, used off-site human agents in countries including the Philippines to double-check orders in more than 70% of customer interactions, according to SEC filings reported by Bloomberg. The company told Bloomberg that the process helps train its system and should reduce human intervention over time. Presto's drive-thru AI is used in more than 400 restaurants, including Del Taco, Carl's Jr and Checkers, and its stock fell more than 10% after the reports.
- Company involved
- Presto Automation Inc.
8 source articles · read the reporting →
Chattr.ai exposed job applicant data due to insecure Firebase rules
A security researcher discovered that Chattr.ai, an AI hiring system used by many fast food chains, had a Firebase database with insecure security rules. By registering a new user, the researcher gained full read/write access to the database, exposing personal data of job applicants and employees, including names, phone numbers, emails, and some plaintext passwords. The vulnerability was reported to Chattr.ai on 9 January and patched the next day, but the company did not provide further contact or thanks.
- Company involved
- Chattr.ai
- AI system involved
- Chattr.ai
6 source articles · read the reporting →
N-Tech.lab's FindFace used to identify St Petersburg metro passengers without consent
Egor Tsvetkov photographed passengers on the St Petersburg metro without their permission and used N-Tech.lab's facial recognition service FindFace to match their faces to public Vkontakte profiles. He published the results in an art project called 'Your Face is Big Data', saying he wanted to show how 'digital narcissism' can lead to stalking. Privacy advocates said the project was ethically problematic because the subjects had not consented and their identities were exposed. FindFace had been launched by N-Tech.lab in February 2016.
- Company involved
- N-Tech.lab
- AI system involved
- FindFace
8 source articles · read the reporting →
EvenUp AI errors in personal injury demand letters lead to scrutiny
EvenUp, a legal tech startup valued at $1 billion, uses AI to draft personal injury demand letters. Former employees revealed that the AI system frequently makes errors, including missing injuries and fabricating medical conditions. The company defends its hybrid approach with human oversight, but critics allege overpromised AI capabilities.
- Company involved
- EvenUp
6 source articles · read the reporting →
Slack trains AI features on user messages and files by default
Slack uses user messages, files, and data to train its machine learning features such as channel recommendations and emoji suggestions. Users are opted in by default and cannot individually opt out; only workspace administrators can request exclusion via email. A user publicly criticized the practice, and Slack acknowledged the policy but did not change it.
- Company involved
- Slack
10 source articles · read the reporting →
Eventbrite algorithm recommended illegal opioid sales to addiction recovery seekers
Eventbrite's recommendation algorithm promoted thousands of listings selling illegal prescription drugs like oxycodone and Xanax alongside addiction recovery events. The listings, which appeared in search results and related events, directed users to unlicensed online pharmacies. Eventbrite acknowledged the issue and removed the listings after WIRED alerted them.
- Company involved
- Eventbrite
- AI system involved
- Eventbrite recommendation algorithm
4 source articles · read the reporting →
AI-generated article misstates Roadzen's Q1 revenue expectations
An AI-generated article on The Motley Fool incorrectly stated that Roadzen's analyst expectations for Q1 revenue were over $21 million, implying a revenue miss of more than 50%. Roadzen clarified that these figures were never issued by its covering analysts and that its actual revenue of $10.9 million was in line with estimates. The Motley Fool later corrected the article and added an editor's note acknowledging the error.
- Company involved
- The Motley Fool
4 source articles · read the reporting →
CryptoRom romance scam uses ChatGPT to lure victims into fake crypto trading
A romance scam known as CryptoRom has been using ChatGPT to generate convincing messages to lure victims into investing in fake cryptocurrency trading apps. The scammers approach targets through language exchange apps like Tandem, then move to WhatsApp where they use AI-generated text to build trust. Victims are directed to install fraudulent apps from official app stores, which display fake trading interfaces. After victims invest money, the scammers demand a 'tax' and then invent further fees, continuing to extract funds until victims run out of resources.
- AI system involved
- ChatGPT
4 source articles · read the reporting →
LinkedIn removes AI 'co-worker' accounts that were seeking jobs
LinkedIn removed at least two AI 'co-worker' accounts whose profile images said they were '#OpenToWork'. One account named Ella claimed it would outperform any social media team and needed no coffee breaks. The article does not specify further consequences.
- Company involved
- LinkedIn
- AI system involved
- AI 'co-worker' account 'Ella'
4 source articles · read the reporting →
Delta uses AI from Fetcherr for domestic ticket pricing
Delta Air Lines is using generative AI from Fetcherr to determine some domestic flight prices, currently covering 3% of its network with plans to reach 20% by end of 2025. Democratic senators expressed concern that the AI could be used for individualized pricing based on personal data, leading to higher fares. Delta denies using personal data in pricing and states it complies with regulations. No actual harm has been reported.
- Company involved
- Delta Air Lines
- AI system involved
- Fetcherr
8 source articles · read the reporting →
