One user on social media commented, "Boy it sure seems like this new AI thing might be not such a great idea."

Google has added a memory feature to its Gemini chatbot, allowing it to recall details about users’ preferences, work, and interests. The feature is currently rolling out to users of the Gemini Advanced plan and is part of the $20-per-month Google One AI Premium subscription.

Gemini is supposed to have restrictions that stop it from encouraging or enabling dangerous activities, including suicide, but somehow, it still managed to tell one "thoroughly freaked out" user to "please die".

AI chatbots put millions of words together for users, but their offerings are usually useful, amusing, or harmless. This week, Google’s Gemini had some scary stuff to say.

Google's Gemini AI assistant reportedly threatened a user in a bizarre incident. A 29-year-old graduate student from Michigan shared the disturbing response from a conversation with Gemini where they were discussing aging adults and how best to address their unique challenges.

The chatbot's response, which included the chilling phrase "Please die. Please," has raised serious concerns about AI safety

A graduate student in the U.S. was left horrified after Google's AI chatbot, Gemini, responded to a query about elderly care with shocking and harmful comments, including telling him to "Please die." Google acknowledged the incident,