Skip to main content

OpenAI Says Models Programmed To Make Stuff Up Instead of Admitting Ignorance

4 months 3 weeks ago
AI models often produce false outputs, or "hallucinations." Now OpenAI has admitted they may result from fundamental mistakes it makes when training its models. The Register: The admission came in a paper [PDF] published in early September, titled "Why Language Models Hallucinate," and penned by three OpenAI researchers and Santosh Vempala, a distinguished professor of computer science at Georgia Institute of Technology. It concludes that "the majority of mainstream evaluations reward hallucinatory behavior." The fundamental problem is that AI models are trained to reward guesswork, rather than the correct answer. Guessing might produce a superficially suitable answer. Telling users your AI can't find an answer is less satisfying. As a test case, the team tried to get an OpenAI bot to report the birthday of one of the paper's authors, OpenAI research scientist Adam Tauman Kalai. It produced three incorrect results because the trainers taught the engine to return an answer, rather than admit ignorance. "Over thousands of test questions, the guessing model ends up looking better on scoreboards than a careful model that admits uncertainty," OpenAI admitted in a blog post accompanying the release.

Read more of this story at Slashdot.

msmash

Tariff threat plays havoc with US PC market, economy not helping

4 months 3 weeks ago
American businesses join Win 10 upgrade train, consumers happy to sit on the platform

World War Fee  The US PC industry is suffering from inventory indigestion caused by resellers over-ordering hardware to avoid Donald Trump's expected import taxes on China-made kit.…

Paul Kunert

Corals Won't Survive a Warmer Planet, a New Study Finds

4 months 3 weeks ago
If global temperatures continue rising, virtually all the corals in the Atlantic Ocean will stop growing and could succumb to erosion by the end of the century, a new study finds. From a report: The analysis of over 400 existing coral reefs across the Atlantic Ocean estimates that more than 70 percent of the region's reefs will begin dying by 2040 even under optimistic climate warming scenarios. And if the planet exceeds 2 degrees Celsius of warming above preindustrial temperatures by the end of the century, 99 percent of corals in the region would meet this fate. Today, the planet has warmed about 1.3 degrees Celsius over preindustrial temperatures. The implications are grave. Corals act as the fundamental building blocks of reefs, providing habitat for thousands of species of fish and other marine life. They are also bulwarks that break up waves and help protect shorelines from rising sea levels. A quarter of all ocean life depends on coral reefs and over a billion people worldwide benefit from them, according to the National Oceanic and Atmospheric Administration.

Read more of this story at Slashdot.

msmash