As Russia and China 'Seed Chatbots With Lies', Any Bad Actor Could Game AI the Same Way
"Russia is automating the spread of false information to fool AI chatbots," reports the Washington Post. (When researchers checked 10 chatbots, a third of the responses repeated false pro-Russia messaging.)
The Post argues that this tactic offers "a playbook to other bad actors on how to game AI to push content meant to inflame, influence and obfuscate instead of inform," and calls it "a fundamental weakness of the AI industry."
Chatbot answers depend on the data fed into them. A guiding principle is that the more the chatbots read, the more informed their answers will be, which is why the industry is ravenous for content. But mass quantities of well-aimed chaff can skew the answers on specific topics. For Russia, that is the war in Ukraine. But for a politician, it could be an opponent; for a commercial firm, it could be a competitor. "Most chatbots struggle with disinformation," said Giada Pistilli, principal ethicist at open-source AI platform Hugging Face. "They have basic safeguards against harmful content but can't reliably spot sophisticated propaganda, [and] the problem gets worse with search-augmented systems that prioritize recent information."
Early commercial attempts to manipulate chat results also are gathering steam, with some of the same digital marketers who once offered search engine optimization — or SEO — for higher Google rankings now trying to pump up mentions by AI chatbots through "generative engine optimization" — or GEO.
Our current situation "plays into the hands of those with the most means and the most to gain: for now, experts say, that is national governments with expertise in spreading propaganda."
Russia and, to a lesser extent, China have been exploiting that advantage by flooding the zone with fables. But anyone could do the same, burning up far fewer resources than previous troll farm operations... In a twist that befuddled researchers for a year, almost no human beings visit the sites, which are hard to browse or search. Instead, their content is aimed at crawlers, the software programs that scour the web and bring back content for search engines and large language models. While those AI ventures are trained on a variety of datasets, an increasing number are offering chatbots that search the current web. Those are more likely to pick up something false if it is recent, and even more so if hundreds of pages on the web are saying much the same thing...
The gambit is even more effective because the Russian operation managed to get links to the Pravda network stories edited into Wikipedia pages and public Facebook group postings, probably with the help of human contractors. Many AI companies give special weight to Facebook and especially Wikipedia as accurate sources. (Wikipedia said this month that its bandwidth costs have soared 50 percent in just over a year, mostly because of AI crawlers....) Last month, other researchers set out to see whether the gambit was working. Finnish company Check First scoured Wikipedia and turned up nearly 2,000 hyperlinks on pages in 44 languages that pointed to 162 Pravda websites. It also found that some false information promoted by Pravda showed up in chatbot answers.
"They do even better in such places as China," the article points out, "where traditional media is more tightly controlled and there are fewer sources for the bots." (The nonprofit American Sunlight Project calls the process "LLM grooming".)
The article quotes a top Kremlin propagandist as bragging in January that "we can actually change worldwide AI."
Read more of this story at Slashdot.
Celebrity Big Brother fans go wild over latest 'feral' instalment as Chris Hughes and Chesney Hawkes clash before Tiffany Pollard blasts 'rotten' Daley Thompson in heated exchange
Chris Hughes , 32, and Cheney Hawkes, 53, were the first to fall out after Big Brother rewarded the housemates with a karaoke party after succeeding in a cat themed task.
Furr-ious action! Corgis go head to head in action-packed race held to celebrate dog breed beloved by Queen Elizabeth II
For Juno, the winner of the Musselburgh race course corgi derby, the roar of the crowd and the inspirational presence of Judy Murray, mother of former Wimbledon champion Andy, were decisive.
Bishop of Chelmsford delivers Easter message to residents across Essex
The Right Reverend Dr Guli Francis-Dehqani addressed the county, drawing parallels between current times and the first Easter.
Bishop of Chelmsford delivers Easter message to residents across Essex
The Right Reverend Dr Guli Francis-Dehqani addressed the county, drawing parallels between current times and the first Easter.
The 8 most commonly mispronounced places across north and mid Essex
Some locations in north and mid Essex trouble people in terms of pronunciation and here are some of the most commonly mistaken.
The 'calm' Essex seaside town with a gorgeous beach that's often overshadowed
One coastal town is often overshadowed - and it really shouldn't be
Church crimewave: Crooks hit places of worship on average eight times a DAY, stealing silver and setting fires
There were a whopping 9,148 records of theft, burglary, criminal damage, vandalism and assault in churches and other religious properties from January 2022 to December 2024.
DAN HODGES: Hope you enjoyed your break, Sir Keir - you're about to walk into a political firestorm that will reignite Labour MPs' demands for a wealth tax
Number 10 officials are glad Keir Starmer chose the past week to be on holiday. 'With Arsenal beating Real Madrid, he'd have been insufferable,' one senior staffer joked.
The real life 'Below Deck' - shocking demands of rich 'yachties' and sentence that got a crew member fired
In order to sail the seven seas with the ultra-wealthy, crew members are expected to follow strict rules or risk being thrown overboard for silly mistakes.
Kanye West's unhinged demands at intimate Las Vegas party revealed by staff
The 47-year-old rapper's rental of a room at the Sin City staple was marked by mishaps, sources told Dailymail.com, with his conduct raising eyebrows.
Vladimir Putin declares Easter truce with Ukraine and vows his troops will stop 'all military operation's until Monday but Zelensky accuses Russia of 'playing with human lives'
Russian President Vladimir Putin has announced a temporary ceasefire with Ukraine as an 'Easter truce.'
Jennifer Lopez, 55, turns heads in a pink leather catsuit as she arrives at the F1 Grand Prix in Saudi Arabia ahead of her headline performance
The singer, 55, put on an age-defying display as she flaunted her toned physique in the figure-hugging Barbie pink one-piece.
The disastrous attempt at flattery by Donald Trump's envoy that got Ukraine peace summit in Paris off to the worst possible start
Top officials from around the world travelled to Paris on Thursday to discuss the war with Russia and Kyiv's security.
Expert issues dire warning over dual-threat that could put your favourite chocolate at risk - and why it might have caused the price of your Easter egg to soar
Dr James Richardson, a research associate at Royal Botanic Garden Edinburgh , has said the clock is ticking to safeguard cacao - with the cost of chocolate already having soared this Easter.
The Real Housewives who make Cheshire's feuding Wags look like pussycats: SARAH RAINEY reveals the tackiest houses, the biggest bust-ups and jaw-dropping moments from the 32 addictive spin-off shows around the world, from Australia to Nigeria
Draped in designer labels, hooked on plastic surgery and partial to the odd wine-fuelled cat fight, their lives are like a rolling soap opera.
A mother of three's wish for a divorce turned into sadistic suburban nightmare with an unimaginable ending
Kristil Krug wanted to split from her husband Daniel. Then she started getting threatening messages from a previous boyfriend, or so she thought.
Engineers Want To Bring Home the World's Oldest Satellite
Launched in 1958, the "awkward-looking" Vanguard-1 satellite ("the size of a grapefruit") is the oldest artificial object orbiting Earth.
"A team of researchers and engineers want to retrieve the satellite for closer inspection and are currently working to find a way to bring Vanguard-1 home," writes Gizmodo:
Other satellites of its time have reentered through Earth's atmosphere, burning up in a fiery death, but Vanguard-1 is still in orbit, silently zooming through the void of space... A team of researchers and engineers from Virginia-based consulting firm Booz Allen Hamilton have put together a proposal on how to retrieve the satellite from space, bringing it back to Earth to study how its equipment has fared over the years, according to a report by Space.com. The team's proposal is detailed in a study published in the Aerospace Research Center earlier this year...
Considering how old Vanguard-1 is, the astronauts would need to handle it with care, according to the team behind the proposal. Before a retrieval attempt, the team suggests that a spacecraft be sent to rendezvous with the satellite to inspect its condition up-close. The engineers suggested partnering with a wealthy space enthusiast willing to fund the outer space venture, or using a SpaceX vehicle to bring the satellite home. Once it's brought back to Earth, experts would examine Vanguard-1 to assess its condition — whether it was struck by space debris, if it's still holding together, and how its time in orbit has affected the satellite. The satellite could then be placed at the Smithsonian for display as a sort of time capsule, a reminder of the history of spaceflight, the team suggests.
"Future missions (space debris removal, materials capture for on-orbit manufacturing, and even deep space exploration) could build on techniques demonstrated in the retrieval of Vanguard 1," the paper read. "Retrieving Vanguard 1 would be a challenge, but an achievable and invaluable step forward for the entire U.S. space community."
"The researchers suggest that the satellite can be placed in a lower orbit and snagged from space, or reeled into the International Space Station," according to the article.
Space.com shares this assessment from Bill Raynor, the associate superintendent of the Naval Research Laboratory's spacecraft engineering division. "For material and radiation effects scientists and engineers, it would be an unprecedented opportunity for investigating the effects of long-term space environmental exposure."
Thanks to long-time Slashdot reader AmiMoJo for sharing the news.
Read more of this story at Slashdot.
Sir Chris Hoy issues health update after his terminal cancer diagnosis as Team GB Olympian explains why he has 'hope' for outliving his prognosis
Sir Chris Hoy has revealed that his fitness is improving despite a terminal cancer diagnosis - and the six-time Olympic champion has found comfort from the longevity of others affected by the same condition.
My dad was a grooming gangs predator... he raped my mother when she was a schoolgirl - but we're STILL fighting for justice
Jayden Sheeran's mother was just 14 years old when she was raped by a member of a grooming gang in Blurton, near Stoke on Trent.