One user on social media commented, "Boy it sure seems like this new AI thing might be not such a great idea."

Google’s AI chatbot Gemini gave a threatening response to a Michigan college student, telling him to “please die.” The artificial intelligence program and the student, Vidhay Reddy, were engaging in a back-and-forth conversation about aging adults and their challenges.

Gemini is supposed to have restrictions that stop it from encouraging or enabling dangerous activities, including suicide, but somehow, it still managed to tell one "thoroughly freaked out" user to "please die".

Google Gemini AI chatbot told a student to 'please die' when he asked for help with his homework. Here's what Google has to say.

Google’s flagship AI chatbot, Gemini, has written a bizarre, unprompted death threat to an unsuspecting grad student. Twenty-nine-year-old Vidhay Reddy was deep into a back-and-forth homework session with the AI chatbot when he was told to “please die”.

A student seeking homework help from Google's Gemini chatbot faced shocking threats, raising concerns about AI safety and accountability.

AI chatbots put millions of words together for users, but their offerings are usually useful, amusing, or harmless. This week, Google’s Gemini had some scary stuff to say.