this post was submitted on 14 Sep 2025
186 points (97.4% liked)
chat
8506 readers
203 users here now
Chat is a text only community for casual conversation, please keep shitposting to the absolute minimum. This is intended to be a separate space from c/chapotraphouse or the daily megathread. Chat does this by being a long-form community where topics will remain from day to day unlike the megathread, and it is distinct from c/chapotraphouse in that we ask you to engage in this community in a genuine way. Please keep shitposting, bits, and irony to a minimum.
As with all communities posts need to abide by the code of conduct, additionally moderators will remove any posts or comments deemed to be inappropriate.
Thank you and happy chatting!
founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I kept saying it. Internet is an ocean of bigotry and ignorance. The worst possible place for an LLM to learn from.
I feel like eventually we'll see an "evolution" of LLMs where the big innovation will be cutting 90% of the Internet out of the training data without breaking the whole thing. Imagine if LLM output was as dry, neutral, and reliable as the average encyclopedia (yes I know those aren't perfect either but it's an improvement over reddit threads at least).
I don’t know if it’ll be framed as an innovation, per se, but that’s going to be the main utility for this technology. Small, focused models that can help you turn a large amount of pre-qualified data into something usable. That would be pretty cool. Wasn’t ever going to be anything more than that, but we’ll have to watch a trillion dollar market bubble pop before people start to narrow their ambitions and actually make something useful out of these things.
It’s such a depressingly stupid time to waste a bunch of information and digital tech so you can have Racist Google instead of what it was 20 years ago. We’re on the cusp of environmental changes brought about by wasting resources. That they built a giant wasteful bubble is the least surprising part of their behavior.