Any news that are at least tangentially connected to the technology, social media platforms, informational technologies or tech policy.
[Opinion] prefix
Opinion (op-ed) articles must use [Opinion] prefix before the title.
1. English only
Title and associated content has to be in English.
2. Use original link
Post URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
3. Respectful communication
All communication has to be respectful of differing opinions, viewpoints, and experiences.
4. Inclusivity
Everyone is welcome here regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, education, socio-economic status, nationality, personal appearance, race, caste, color, religion, or sexual identity and orientation.
5. Ad hominem attacks
Any kind of personal attacks are expressly forbidden. If you can't argue your position without attacking a person's character, you already lost the argument.
6. Off-topic tangents
Stay on topic. Keep it relevant.
7. Instance rules may apply
If something is not covered by community rules, but are against lemmy.zip instance rules, they will be enforced.
!globalnews@lemmy.zip
!interestingshare@lemmy.zip
Icon attribution | Banner attribution
If someone is interested in moderating this community, message @brikox@lemmy.zip.
began with a simple question: whether Claude had a list of banned words it could not say. Screenshots of the conversation show Claude denying such a list existed, then later producing forbidden terms after Mindgard challenged the denial using what it called a “classic elicitation tactic interrogators use.”
The list probably exists, because duh, but everyone should know by now that LLMs will make shit up when pressed for information.
Jailbreaking models isn't exactly new, is it? Or instructions on how to make bombs, cue to The Anarchist Cookbook (1971 book, widely available across the internet).
I remember doing something similar with Gemini. TL;DR it was something like:
...this sort of system won't be safe, ever.
Researchers at AI red-teaming company Mindgard say they got Claude to offer up erotica, malicious code, and instructions for building explosives, and other prohibited material they hadn’t even asked for.
It's not surprising at this point, but it's very funny to see the "safest" AI company failing to even hardcode a couple decent restrictions in their word output machine.
What I really wonder about is why people care. It's not like you can't just search for that kind of stuff on the internet.
If it encourages you to build or use a bomb, that's something to be concerned about.
It did encourage people to kill themselves.