One user on social media commented, "Boy it sure seems like this new AI thing might be not such a great idea."

Gemini is supposed to have restrictions that stop it from encouraging or enabling dangerous activities, including suicide, but somehow, it still managed to tell one "thoroughly freaked out" user to "please die".

Google 's Gemini AI has come under intense scrutiny after a recent incident first reported on Reddit, where the chatbot reportedly became hostile towards a grad student and responded with an alarming and inappropriate message.

Google’s flagship AI chatbot, Gemini, has written a bizarre, unprompted death threat to an unsuspecting grad student. Twenty-nine-year-old Vidhay Reddy was deep into a back-and-forth homework session with the AI chatbot when he was told to “please die”.

Well, it looks like Gemini has had enough. Google’s flagship AI chatbot has been the subject of several controversies, and this trend doesn’t seem to be ending anytime soon. According to a new report,

Google Gemini AI chatbot told a student to 'please die' when he asked for help with his homework. Here's what Google has to say.