ChatGPT training emits 502 metric tons of carbon

GPT-3 released over 500 metric tons of carbon during its training according to researchers, raising concerns about the environmental impacts associated with developing large language models. R esearchers at open-source AI community Hugging Face calculated that GPT-3 , the model that powers ChatGPT , emitted around 502 metric tons of carbon, far more than other large language models. GPT-3’s vast emissions can likely be partly explained by the fact that it was trained on older, less efficient hardware, the researchers ar gued . T he researchers had first estimated the whole life cycle carbon emissions of BLOOM, its own own large language model, calculating that it had led to 25 metric tons of carbon dioxide emissions - a figure that doubled when the emissions produced by the manufacturing of the computer equipment used for training, the broader computing infrastructure, and the energy required to run BLOOM once it was trained - were taken into account. Environmental impacts of artificial intelligence The environmental impacts of artificial intelligence (AI) may vary significantly. Many deep learning methods have significant carbon footprints and water usage. Source: Wikipedia 🔗 System 🤖 BL OOM 🔗 ChatGPT GPT-3 Operator: Alexandra Sasha Luccioni, Sylvain Viguier, Anne-Laure Ligozat Developer: OpenAI Country: Global Sector: Multiple Purpose: Generate text Technology: Chatbot; Generative AI; Machine learning Issue: Envi r onment

Date it happened

2022-11-01

Organisation involved

Alexandra Sasha Luccioni, Sylvain Viguier, Anne-Laure Ligozat

Product, system or model

ChatGPT

This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.