lets_get_off_lemmy

What should we do?

That's fair

Should've kept your eye out for snipers I say

But real snipers camp (and then move if they're smart). But that shouldn't be contingent upon an omniscient view. It should be contingent on other people seeing where the shot came from or otherwise surveying the area. If you want realism in your game, no kill cams.

Ya know you can swear on the Internet right? It's not even a swear word.

Edit: okay I see I got whooshed

I like that as well, thank you! Yeah, the "Daily AI Habit" in the MIT article was described as...

Let’s say you’re running a marathon as a charity runner and organizing a fundraiser to support your cause. You ask an AI model 15 questions about the best way to fundraise.

Then you make 10 attempts at an image for your flyer before you get one you are happy with, and three attempts at a five-second video to post on Instagram.

You’d use about 2.9 kilowatt-hours of electricity—enough to ride over 100 miles on an e-bike (or around 10 miles in the average electric vehicle) or run the microwave for over three and a half hours.

As a daily AI user, I almost never use image or video generation and it is basically all text (mostly in the form of code), so I think this daily habit likely wouldn't fit for most people that use it on a daily basis, but that was their metric.

The MIT article also mentions that we shouldn't try and reverse engineer energy usage numbers and that we should encourage companies to release data because the numbers are invariably going to be off. And Google's technical report affirms this. It shows that non-production estimates for energy usage by AI are over-estimating because of the economies of scale that a production system is able to achieve.

Edit: more context: my daily AI usage, on the extremely, extremely high end, let's say is 1,000 median text prompts from a production-level AI provider (code editor, chat window, document editing). That's equivalent to watching TV for 36 minutes. The average daily consumption of TV in the US is around 3 hours per day.

Do you have a source for this claim? I see this report by Google and MIT Tech Review that says image/video generation does use a lot of energy compared to text generation.

Taking the data from those articles, we get this table:

Could you explain further?

This feels like it would make people buy it more because it's such a rad sticker to have on a box. It's like the Parental Advisory notice on CDs. It just made them way cooler and were like a badge of honor.

This further points to the solution being smaller models that know less and are trained for smaller tasks. Instead of gargantuan models that require an insane amount of resources to answer easy questions. Route queries to smaller, more specialized models, based on queries. This was the motivation behind MoE models, but I think there are other architectures and paradigms to explore.

Boomer meme alert

absolutely no one:

me: this meme format sucks