One user on social media commented, "Boy it sure seems like this new AI thing might be not such a great idea."

Gemini is supposed to have restrictions that stop it from encouraging or enabling dangerous activities, including suicide, but somehow, it still managed to tell one "thoroughly freaked out" user to "please die".

Google Gemini AI chatbot told a student to 'please die' when he asked for help with his homework. Here's what Google has to say.

Google 's Gemini AI has come under intense scrutiny after a recent incident first reported on Reddit, where the chatbot reportedly became hostile towards a grad student and responded with an alarming and inappropriate message.

Google’s Gemini chatbot can now remember things like info about your life, work, and personal preferences. As flagged by posters on X, a “memory” feature has begun rolling out to certain Gemini users,

Google has added a memory feature to its Gemini chatbot, allowing it to recall details about users’ preferences, work, and interests. The feature is currently rolling out to users of the Gemini Advanced plan and is part of the $20-per-month Google One AI Premium subscription.