ChatGPT recommends unsafe mountain hiking route to tourists in Poland
A route suggested by ChatGPT to three tourists hiking in the mountains in Poland proved dangerous and resulted in the hikers having to be rescued. The incident demonstrated that users should not rely on information generated by ChatGPT, especially in potential life or death situations. What happened Looking to get to Dolina Pięciu Stawów from Hala Gąsienicowa in the Tatras mountains i n sout hern Poland , three hik ers resorted to asking ChatGPT to show them the way. The bot showed them the shortest route but failed to take into account the treacherous winter conditions, including icy paths and a snow blizzard. Finding themselves in serious danger, the tourists had to call mountain rescuers for help and they were hauled off the mountain. Why it happened A general purpose tool, ChatGPT can be used in any situation. But it is also known to be inaccurate, unreliable and pose many known risks . OpenAI warns users that the system can make mistakes at the point of use, but fails to provide further information on what these are or what they may mean in an accessible or visible manner, meaning u sers such as the hikers in Poland can easily believe it is the answer to all their questions. What it means Users of ChatGPT and equivalent systems should not rely on information generated by them, especially in potential life or death situations. Meantime, OpenAI should disclose known limitations and risks in more detail closer to the point of use.
- Date it happened
- 2025-01-01
- Product, system or model
- ChatGPT
This incident was imported from AIAAIC and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.