North Korean hackers use ChatGPT to make deepfake military IDs
Suspected North Korean state-sponsored hackers used ChatGPT to generate realistic deepfake military ID images as part of a sophisticated phishing campaign against South Korean defence and research targets. What happened Hackers from the Kimsuky group bypassed ChatGPT’s safeguards via prompt engineering to produce fake South Korean military identification cards that were attached to spear-phishing emails impersonating official defense institutions. Sent to journalists, researchers and human rights activists, the emails contained links and attachments with malware designed to extract sensitive data from devices. While the exact number of victims is unclear, the incident highlights how deepfake documents increase the credibility and impact of phishing attacks, risking personal, organisational, and national security . Why it happened The hackers were able to manipulate ChatGPT prompts to generate prohibited government ID imagery, despite built-in restrictions. North Korean cyber units like Kimsuky are known for evolving tactics to evade international sanctions and obtain intelligence. What it means The incident demonstrates how ChatGPT can be manipulated to produce convincing forgeries, escalating the sophistication of impersonation and phishing threats worldwide. It raises important questions about ChatGPT's governance and the resilience of its digital infrastructure. System 🤖 ChatGPT Developer: Op enAI Country: South Korea Sector: Govt - defence Purpose: Create fake mil itary identity images Technology: Chatbot; Generative AI Issue: Security
- Date it happened
- 2025-07-01
- Organisation involved
- Kimsuky
- Product, system or model
- ChatGPT; GPT-4o
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.