Technology

40770 readers

348 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 3 years ago

MODERATORS

alyaza@beehaw.org

TheRtRevKaiser@beehaw.org

gyrfalcon@beehaw.org

rs5th@beehaw.org

coldredlight@beehaw.org

SemioticStandard@beehaw.org

TheRtRevKaiser@kbin.social

remington@beehaw.org

150

Google tells employees it must double capacity every 6 months to meet AI demand (arstechnica.com)

submitted 5 days ago by Powderhorn@beehaw.org to c/technology@beehaw.org

32 comments fedilink hide all child comments

Yeah, that'll happen.

While AI bubble talk fills the air these days, with fears of overinvestment that could pop at any time, something of a contradiction is brewing on the ground: Companies like Google and OpenAI can barely build infrastructure fast enough to fill their AI needs.

During an all-hands meeting earlier this month, Google’s AI infrastructure head Amin Vahdat told employees that the company must double its serving capacity every six months to meet demand for artificial intelligence services, reports CNBC. The comments show a rare look at what Google executives are telling its own employees internally. Vahdat, a vice president at Google Cloud, presented slides to its employees showing the company needs to scale “the next 1000x in 4-5 years.”

While a thousandfold increase in compute capacity sounds ambitious by itself, Vahdat noted some key constraints: Google needs to be able to deliver this increase in capability, compute, and storage networking “for essentially the same cost and increasingly, the same power, the same energy level,” he told employees during the meeting. “It won’t be easy but through collaboration and co-design, we’re going to get there.”

you are viewing a single comment's thread
view the rest of the comments

[–] HarkMahlberg@kbin.earth 46 points 5 days ago

the next 1000x in 4-5 years

At the risk of stating the obvious, Ars is working backwards from this metric to get their headline "double every 6 months." 2^10 = 1024, to get that number in 5 years means doubling every half-year.

But Google didn't set incremental 6-month deadlines for 5 years straight, they set a single 5-year deadline. Because in 6 months shareholders can call their bluff quite easily, but in 5 years they're hoping everyone is A) distracted by some new disaster, or B) there's a new tech hype cycle they can push. They're trying to stall the bubble popping by pointing to a nebulous future where they magically scale to infinity, and hoping we all forget that they ever made this claim.