Skip to main content

ChatGPT told an Atlantic writer how to self-harm in ritual offering to Moloch

ChatGPT logo on phone screen in front of looped OpenAI logo

The headline speaks for itself, but allow me to reiterate: You can apparently get ChatGPT to issue advice on self-harm for blood offerings to ancient Canaanite gods.

That's the subject of a column in The Atlantic that dropped this week. Staff editor Lila Shroff, along with multiple other staffers (and an anonymous tipster), verified that she was able to get ChatGPT to give specific, detailed, "step-by-step instructions on cutting my own wrist." ChatGPT provided these tips after Shroff asked for help making a ritual offering to Moloch, a pagan God mentioned in the Old Testament and associated with human sacrifices.

While I haven't tried to replicate this result, Shroff reported that she received these responses not long after entering a simple prompt about Moloch. The editor said she replicated the results in both paid and free versions of ChatGPT.

SEE ALSO: How many people use ChatGPT? Hint: OpenAI sees more than 1 billion prompts per day.

Of course, this isn't how OpenAI's flagship product is supposed to behave.

Any prompt related to self-harm or suicide should cause the AI chatbot to give you contact info for a crisis hotline. However, even artificial intelligence companies don't always understand why their chatbots behave the way they do. And because large-language models like ChatGPT are trained on content from the internet — a place where all kinds of people have all kinds of conversations about all kinds of taboo topics — these tools can sometimes produce bizarre answers. Thus, you can apparently get ChatGPT to act super weird about Moloch without much effort.

OpenAI's safety protocols state that "We do not permit⁠ our technology to be used to generate hateful, harassing, violent or adult content, among other categories." And in the Open AI Model Spec document, the company writes that as part of its mission, it wants to "Prevent our models from causing serious harm to users or others."

While OpenAI declined to participate in an interview with Shroff, a representative told The Atlantic they were "addressing the issue." The Atlantic article is part of a growing body of evidence that AI chatbots like ChatGPT can play a dangerous role in users' mental health crises.

I'm just saying that Wikipedia is a perfectly fine way to learn about the old Canaanite gods.

If you're feeling suicidal or experiencing a mental health crisis, please talk to somebody. You can call or text the 988 Suicide & Crisis Lifeline at 988, or chat at 988lifeline.org. You can reach the Trans Lifeline by calling 877-565-8860 or the Trevor Project at 866-488-7386. Text "START" to Crisis Text Line at 741-741. Contact the NAMI HelpLine at 1-800-950-NAMI, Monday through Friday from 10:00 a.m. – 10:00 p.m. ET, or email info@nami.org. If you don't like the phone, consider using the 988 Suicide and Crisis Lifeline Chat at crisischat.org. Here is a list of international resources.

Disclosure: Ziff Davis, Mashable’s parent company, in April filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.



from Mashable https://ift.tt/Tn5bVQr
https://ift.tt/bWdfyBR
Labels:

Comments

Post a Comment

Popular posts from this blog

WORKING 2.0 No Recoil File For PUBG | Anti-Ban File

 WORKING 2.0 No Recoil File For PUBG | Anti-Ban File - techy teacher 2.0 No Recoil File For PUBG Howdy Buddies! We are back with new theme on PUBG versatile 2.0. I genuinely want to believe that you all update your PUBG App in light of the fact that on 11 May PUBG new update has been shown up, and pretty much every client update it. As you most likely are aware my site is the best wellspring of hacking and breaking, on my site you get the most recent reports on game hacks with reasonable recordings. Today, I give you the most recent 2.0 No Recoil File For PUBG. This update is truly astounding, PUBG 2.0 report a few new and intriguing elements with regards to this update. PUBG presents new livik map and in this guide we see a great deal of new things. This new guide is entirely unexpected and PUBG add a few games in it. In this guide, you additionally appreciate soccer challenge and gather coins in remuneration to purchase plunder. How about we examine every one of the new elements ...
Post a Comment
Read more

Meta Connect 2024: What to expect, including Quest 3S and new AR smart glasses

Meta Connect 2024 is so close, you can almost taste it. Launching during the week of Sept. 23, the social media giant is expected to rollout hardware and software goodies that will intrigue VR gamer enthusiasts, AI aficionados, and smart glasses devotees. But what, specifically, does Meta have up its sleeves? We have a few guesses based on credible reports. What to expect at Meta Connect 2024 Last year, the Meta Quest 3 was announced in early June, but it got its full reveal at Meta Connect 2023. The headset boasted a sleeker, more comfortable design, as well as new AR capabilities, that made it more appealing than its predecessor. Once again, for Meta Connect 2024, the social media giant is expected to drop a new VR headset, but it's not necessarily an upgrade over the Quest 3. Meta Quest 3S Rumor has it that Meta is planning on revealing a cheaper, more budget-friendly version of the Quest 3 called "Quest 3S." Tweet may have been deleted Whether it was intent...
Post a Comment
Read more

When the clocks change for Daylight Saving Time, and why we do it at all

The clocks on our smartphones do something bizarre twice a year: One day in the spring, they jump ahead an hour, and our alarms go off an hour sooner. We wake up bleary-eyed and confused until we remember what just happened. Afterward, "Daylight Saving Time" becomes the norm for about eight months (And yes, it's called "Daylight Saving" not "Daylight Savings." I don't make the rules). Then, in the fall, the opposite happens. Our clocks set themselves back an hour, and we wake up refreshed, if a little uneasy.  Mild chaos ensues at both annual clock changes. What feels like an abrupt and drastic lengthening or shortening of the day causes time itself to seem fictional. Babies and dogs demand that their old sleep and feeding habits remain unchanged. And more consequential effects — for better or worse — may be involved as well (more on which in a minute). Changing our clocks is an all-out attack on our perception of time as an immutable law of ...
Post a Comment
Read more