this post was submitted on 14 Jul 2026
326 points (94.3% liked)
Technology
86484 readers
4391 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Oh probably not, but it is really really expensive to run. If they continue on with unlimited funding, they can eventually replace mid to upper level experts in most fields.
We've likely hit the limit for the current LLM approach. Training/Pruning/Distilling can't get us much further on their own, so now we're strapping on code, having it plan, parallel execute, test. Tokens are likely 10x less expensive on the market than they cost to generate. Every advance we make now is by making each request fire off many more requests. Improvements are getting exponentially expensive.
We'll have to slow because financially * it's not profitable. Maybe hardware will catch back up. Maybe they'll find ways to make it more efficient. Maybe we'll figure out a more elegant way to do the math for the weights. We just can't keep making it more deeply complicated because it's not cost/energy/time effective
edit: deleted a word