Technology

74594 readers

4029 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related news or articles.
Be excellent to each other!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
Check for duplicates before posting, duplicates may be removed
Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago

MODERATORS

L3s@lemmy.world

enu@lemmy.world

technopagan@lemmy.world

L4s@lemmy.world

L3s@hackingne.ws

L4s@hackingne.ws

638

ChatGPT 5 power consumption could be as much as eight times higher than GPT 4 — research institute estimates medium-sized GPT-5 response can consume up to 40 watt-hours of electricity (www.tomshardware.com)

submitted 2 weeks ago by homesweethomeMrL@lemmy.world to c/technology@lemmy.world

155 comments fedilink hide all child comments

The University of Rhode Island's AI lab estimates that GPT-5 averages just over 18 Wh per query, so putting all of ChatGPT's reported 2.5 billion requests a day through the model could see energy usage as high as 45 GWh.

A daily energy use of 45 GWh is enormous. A typical modern nuclear power plant produces between 1 and 1.6 GW of electricity per reactor per hour, so data centers running OpenAI's GPT-5 at 18 Wh per query could require the power equivalent of two to three nuclear power reactors, an amount that could be enough to power a small country.

(page 2) 50 comments

sorted by: hot top controversial new old

[–] Melonpoly@lemmy.world 6 points 2 weeks ago (6 children)

It takes less energy to dry a full load of clothes

[–] LodeMike@lemmy.today 6 points 2 weeks ago (2 children)

40 watt-hours? That's the energy usage of a very small laptop.

[–] jj4211@lemmy.world 2 points 2 weeks ago (1 children)

Well over the course of an hot or two, but it's correct that a dryer run even with heat pump is significantly more than 40wh

load more comments (1 replies)

load more comments (5 replies)

[–] DrFistington@lemmy.world 5 points 2 weeks ago

But we get a huge increase in accuracy, from 30% to 30.5%! And it only took 5x the energy consumption!

[–] RememberTheApollo_@lemmy.world 5 points 1 week ago (6 children)

Help me out here. What designates the “response” type? Someone asking it to make a picture? Write a 20 page paper? Code a small app?

load more comments (6 replies)

[–] stevedice@sh.itjust.works 4 points 1 week ago (1 children)

The team measured GPT-5’s power consumption by combining two key factors: how long the model took to respond to a given request, and the estimated average power draw of the hardware [they believe is] running it.

load more comments (1 replies)

[–] pHr34kY@lemmy.world 4 points 2 weeks ago (3 children)

Tech hasn't improved that much in the last in the last decade. All that's happened is that more cores have been added. The single-thread speed of a CPU is stagnant.

My home PC consumes more power than my Pentium 3 consumed 25 years ago. All efficiency gains are lost to scaling for more processing power. All improvements in processing power are lost to shitty, bloated code.

We don't have the tech for AI. We're just scaling up to the electrical senand demand of a small country and pretending we have the tech for AI.

[–] ChokingHazard@lemmy.world 5 points 2 weeks ago

This is nonsense, an M1 runs many multiples faster and at much lower wattage.

load more comments (2 replies)

load more comments