Aggregator

Google has released (PDF) a new analysis of its AI's environmental impact, showing that it has cut the energy use of AI text queries by a factor of 33 over the past year. Each prompt now consumes about 0.24 watt-hours -- the equivalent of watching nine seconds of TV. An anonymous reader shares an excerpt from an Ars Technica article: "We estimate the median Gemini Apps text prompt uses 0.24 watt-hours of energy, emits 0.03 grams of carbon dioxide equivalent (gCO2e), and consumes 0.26 milliliters (or about five drops) of water," they conclude. To put that in context, they estimate that the energy use is similar to about nine seconds of TV viewing. The bad news is that the volume of requests is undoubtedly very high. The company has chosen to execute an AI operation with every single search request, a compute demand that simply didn't exist a couple of years ago. So, while the individual impact is small, the cumulative cost is likely to be considerable. The good news? Just a year ago, it would have been far, far worse. Some of this is just down to circumstances. With the boom in solar power in the US and elsewhere, it has gotten easier for Google to arrange for renewable power. As a result, the carbon emissions per unit of energy consumed saw a 1.4x reduction over the past year. But the biggest wins have been on the software side, where different approaches have led to a 33x reduction in energy consumed per prompt. The Google team describes a number of optimizations the company has made that contribute to this. One is an approach termed Mixture-of-Experts, which involves figuring out how to only activate the portion of an AI model needed to handle specific requests, which can drop computational needs by a factor of 10 to 100. They've developed a number of compact versions of their main model, which also reduce the computational load. Data center management also plays a role, as the company can make sure that any active hardware is fully utilized, while allowing the rest to stay in a low-power state. The other thing is that Google designs its own custom AI accelerators, and it architects the software that runs on them, allowing it to optimize both sides of the hardware/software divide to operate well with each other. That's especially critical given that activity on the AI accelerators accounts for over half of the total energy use of a query. Google also has lots of experience running efficient data centers that carries over to the experience with AI. The result of all this is that it estimates that the energy consumption of a typical text query has gone down by 33x in the last year alone.

Read more of this story at Slashdot.

The tour bus crashed and rolled over along I-90 in Pembroke, near Buffalo, killing at least five people as more than 20 passengers were rushed to hospital.

Dexter prequel Original Sin has been canceled despite being previously renewed for a second season - in a bombshell backtrack that has left fans reeling.

Lionel Richie has become the latest Hollywood star to become the victim of a wave of burglaries sweeping Los Angeles.

It was billed as a triumph of diplomacy when Donald Trump yet with Vladimir Putin in Alaska. Yet, a source close to Mr Trump told the Daily Mail it was a move by Melania that turned out to be crucial.

Ghislaine Maxwell paints herself as the ultimate victim in a newly released interview that lays bare her humiliations at the hands of Jeffrey Epstein.

One scene from Princess Andre 's fly-on-the-wall documentary must have left even the most hardened, celebrity-weary cynic a little teary eyed.

Florida death row inmate Matthew Caylor, who was awaiting execution for the horrific murder and rape of a 13-year-old girl, has died by suicide in prison.

Jack Fahri, then 19, was sentenced to life after he threw a large glass dish that shattered, severing an artery in the 16-year-old's neck, at a bakery in Lee, south-east London in 2008.

The broadcaster, who celebrated her 50th birthday in May, has been a staple of the ITV breakfast programme since its launch in 2014 after she left Sky News .

Car thefts have soared due to a lack of policing at Britain's busiest port, allowing criminals to ship stolen vehicles to the Middle East and Africa. 

The jihadist organisation, which lost its final stronghold in Syria in 2019, is posing a new challenge to security services, a UN Security Council meeting was told this week.

After the show revealed its full line-up last week, it was been hit by fresh claims that bosses have called in police to investigate a new allegation into the show.

'I will definitely buy some more in different colours'

The Met said 21 people were recalled to prison, and 11 firearms and more than 40 knives seized in a bid to target those who 'pose the greatest risk' of causing trouble.

The party leader said the five year plan, called Operation Restoring Justice, would bar small boat migrants from claiming asylum in the UK.

UK-based brand and PR expert, Chad Teixeira, has revealed how the social media posts might work against the mother-of-two and deter customers from purchasing her products.

A record 50,000 migrants arrived illegally on small boats in the first 12 months of Keir Starmer 's watch, up 27 per cent on the previous 12 months.

The man on the doorstep had a friendly face and a rich, West Country accent. 'I'm Fred West,' he said, as he led me and my sister, Deirdre, into the living room at 25 Cromwell Street.

I'll never forget the first time that I held a woman's hand as she slipped away. I was volunteering at a local hospice and had been asked to sit with her because she was constantly crying out.