Skip to main content

Reddit Mod Warns 'Do Not Trust' AI-Powered 'Reddit Answers' After It Posts Dangerous Health Advice

3 months 2 weeks ago
In Reddit's "Family Medicine" subreddit, a moderator noticed earlier this week that the AI-powered "Reddit Answers" was automatically responding to posters, typically with "something related to what was posted." Unfortunately, that moderator says, Reddit Answers "has been spreading grossly dangerous misinformation."And yet Reddit's moderators "cannot disable this feature." Elsewhere a healthcare worker described what happened when they tested Reddit Answers: I made a post in r/familymedicine and a link appeared below it with information on treating chronic pain. The first post it cited urged people to stop their prescribed medications and take high-dose kratom which is an illegal (in some states) and unregulated substance. I absolutely do not endorse this... I also asked about the medical indications for heroin. One answer warned about addiction and linked to crisis and recovery resources. The other connects to a post where someone claims heroin saved their life and controls their chronic pain. The post was encouraging people to stop prescribed medications and use heroin instead. Heroin is a schedule I drug in the US which means there are no acceptable uses. It's incredibly addictive and dangerous. It is responsible for the loss of so many lives... The AI-generated answers could easily be mistaken as information endorsed by the sub it appears in. r/familymedicine absolutely does not endorse using heroin to treat chronic pain. This feature needs to be disabled in medical and mental health subs, or allow moderators of these subreddits to opt out. Better filters are also needed when users ask Reddit Answers health related questions. If this continues there will be adverse outcomes. People will be harmed. This needs to change. Two days ago an official Reddit "Admin" posted that "We've made some changes to where Answers appears based on this feedback," adding that beyond that Reddit "will continue to tweak based on what we're seeing and hearing." But the "Family Medicine" subreddit still has a top-of-page announcement warning every user there... "We do NOT and CANNOT endorse Reddit Answers at this time and urge every user of this sub to disregard anything it says."

Read more of this story at Slashdot.

EditorDavid

Email Bombs Exploit Lax Authentication In Zendesk

3 months 2 weeks ago
Cybercriminals are exploiting weak email authentication settings in Zendesk, using the platform's customer support systems to bombard targets with thousands of spam and harassing messages that appear to come from legitimate companies like The Washington Post, Discord, and NordVPN. KrebsOnSecurity reports: Zendesk is an automated help desk service designed to make it simple for people to contact companies for customer support issues. Earlier this week, KrebsOnSecurity started receiving thousands of ticket creation notification messages through Zendesk in rapid succession, each bearing the name of different Zendesk customers, such as CapCom, CompTIA, Discord, GMAC, NordVPN, The Washington Post, and Tinder. The abusive missives sent via Zendesk's platform can include any subject line chosen by the abusers. In my case, the messages variously warned about a supposed law enforcement investigation involving KrebsOnSecurity.com, or else contained personal insults. Moreover, the automated messages that are sent out from this type of abuse all come from customer domain names -- not from Zendesk. [...] In all of the cases above, the messaging abuse would not have been possible if Zendesk customers validated support request email addresses prior to sending responses. Failing to do so may make it easier for Zendesk clients to handle customer support requests, but it also allows ne'er-do-wells to sully the sender's brand in service of disruptive and malicious email floods. "We recognize that our systems were leveraged against you in a distributed, many-against-one manner," said Carolyn Camoens, communications director at Zendesk. "We are actively investigating additional preventive measures. We are also advising customers experiencing this type of activity to follow our general security best practices and configure an authenticated ticket creation workflow."

Read more of this story at Slashdot.

BeauHD