Skip to main content

After Meta Cheating Allegations, 'Unmodified' Llama 4 Maverick Model Tested - Ranks #32

2 months 1 week ago
Remember how last weekend Meta claimed its "Maverick" AI model (in the newly-released Llama-4 series) beat GPT-4o and Gemini Flash 2 "on all benchmarks... This thing is a beast." And then how within a day several AI researchers pointed out that even Meta's own announcement admitted the Maverick tested on LM Arena was an "experimental chat version," as TechCrunch pointed out. ("As we've written about before, for various reasons, LM Arena has never been the most reliable measure of an AI model's performance. But AI companies generally haven't customized or otherwise fine-tuned their models to score better on LM Arena — or haven't admitted to doing so, at least.") Friday TechCrunch on what happened when LMArena tested the unmodified release version of Maverick (Llama-4-Maverick-17B-128E-Instruct). It ranked 32nd. "For the record, older models like Claude 3.5 Sonnet, released last June, and Gemini-1.5-Pro-002, released last September, rank higher," notes the tech site Neowin.

Read more of this story at Slashdot.

EditorDavid

Three Million Child Deaths Linked To Drug Resistance, Study Shows

2 months 1 week ago
"More than three million children around the world are thought to have died in 2022 as a result of infections that are resistant to antibiotics," reports the BBC, citing a study by two leading experts in child health that used data from sources including the World Health Organization and the World Bank: Experts say this new study highlights a more than tenfold increase in AMR-related infections in children in just three years. The number could have been made worse by the impact of the Covid pandemic... The report's lead authors, Doctor Yanhong Jessika Hu of Murdoch Children's Research Institute in Australia and Professor Herb Harwell of the Clinton Health Access Initiative, point to a significant growth in the use of antibiotics that are meant to only be held back for the most serious infections. Between 2019 and 2021 the use of "watch antibiotics", drugs with a high risk of resistance, increased by 160% in South East Asia and 126% in Africa. Over the same period, "reserve antibiotics" — last-resort treatments for severe, multidrug-resistant infections — rose by 45% in South East Asia and 125% in Africa. The authors warn that if bacteria develop resistance to these antibiotics, there will be few, if any, alternatives for treating multidrug-resistant infections. "Antibiotics are ubiquitous around us," Professor Harwell warns in the article. "They end up in our food and the environment and so coming up with a single solution is not easy." The article also quotes a senior lecturer in microbiology at King's College London, who says the new study "marks a significant and alarming increase compared to previous data". "These findings should serve as a wake-up call for global health leaders. Without decisive action, AMR could undermine decades of progress in child health, particularly in the world's most vulnerable regions." Thanks to Slashdot reader Bruce66423 for sharing the article.

Read more of this story at Slashdot.

EditorDavid