Google’s Gemini threatened one user (or possibly the entire human race) during one session, where it was seemingly being used to answer essay and test questions, and asked the user to die. Because of its seemingly out-of-the-blue response, u/dhersie shared the screenshots and a link to the Gemini conversation on r/artificial on Reddit.

Gemini is supposed to have restrictions that stop it from encouraging or enabling dangerous activities, including suicide, but somehow, it still managed to tell one "thoroughly freaked out" user to "please die".

One user on social media commented, "Boy it sure seems like this new AI thing might be not such a great idea."

Google’s Gemini chatbot can now remember things like info about your life, work, and personal preferences. As flagged by posters on X, a “memory” feature has begun rolling out to certain Gemini users,

Google’s AI chatbot Gemini gave a threatening response to a Michigan college student, telling him to “please die.” The artificial intelligence program and the student, Vidhay Reddy, were engaging in a back-and-forth conversation about aging adults and their challenges.