GenNomis AI art generator accused of producing explicit child images

South Korean AI platform GenNomis has been accused of facilitating the creation of AI-generated explicit images, including child sexual abuse material (CSAM), following the exposure of an unsecured database containing nearly 94,000 files. What happened Cybersecurity researcher Jeremiah Fowler discovered an unprotected database linked to GenNomis, revealing explicit AI-generated images that included depictions of minors and celebrities portrayed as children. The database contained over 47 GB of data, including user prompts and generated images, raising serious concerns about the misuse of generative AI tools for creating harmful content. The platform and its parent company, AI-Nomis, went offline shortly after the discovery was reported. Why it happened The data breach occurred due to inadequate security measures, with the database lacking encryption or password protection. GenNomis' g uidelines prohibit the creation of illegal content such as CSAM but its tools openly allowed users to create unrestricted images, including face-swapping and deepfake content. What it means For those directly impacted - such as individuals depicted in non-consensual deepfake imagery - the incident represents a grave violation of privacy and dignity. Indirectly, the finding highlights broader societal risks posed by unregulated generative AI technologies, including the proliferation of CSAM and exploitation through deepfake pornography. The case emphasises the urgent need for stronger legal frameworks and technological safeguards to prevent the misuse of AI tools for harmful purposes.

Date it happened

2025-01-01

Product, system or model

Nudify

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.