32
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 21 Jul 2024
32 points (100.0% liked)
TechTakes
1416 readers
149 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 1 year ago
MODERATORS
News article about how hard it is to block AI scraping: https://www.404media.co/websites-are-blocking-the-wrong-ai-scrapers-because-ai-companies-keep-making-new-ones/
At this point, I wouldn't fault anyone for blanket-blocking all scrapers/robots - sure, doing that will make you unfindable by search engines, but search is basically useless nowadays for finding anything actually interesting, and trying to play whack-a-mole with AI scrapers just means you're gonna get your shit stolen.
Might as well go back to word-of-mouth.