this post was submitted on 30 Dec 2025
546 points (98.8% liked)
Microblog Memes
9981 readers
1862 users here now
A place to share screenshots of Microblog posts, whether from Mastodon, tumblr, ~~Twitter~~ X, KBin, Threads or elsewhere.
Created as an evolution of White People Twitter and other tweet-capture subreddits.
Rules:
- Please put at least one word relevant to the post in the post title.
- Be nice.
- No advertising, brand promotion or guerilla marketing.
- Posters are encouraged to link to the toot or tweet etc in the description of posts.
Related communities:
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
This is a terrible analogy.
First off, robots.txt has no force of law. It’s just a curtesy. You are free to ignore it (except where prohibited by EULA or contract).
Secondly, this is more similar to a supermarket hanging a sign that you can only access 3 of their 11 aisles.
What this is doing is if you try to access the 7 aisles they requested you not to use, you have to solve a math problem or two.
Ai scrapers are obnoxious loud drunk people who take way more than their fair share.
If you truly have something private (like your house) you should not expose it publically on the internet.
Well, let's turn this situation around then and see how it changes.
I hammer Meta's backend services with 6.8m requests per second, ignoring all posted guidelines, absorbing all the data I can get my hands on from them and feeding it to my machine which is busy trying to build BaseFook based on Meta's data that I've harvested from them.
Criminal DDOS? What's that?
Copyright law? Surely this doesn't apply to this.
Unauthorized access to backend systems? Nah, we'll be fine, that's definitely legal.
....
It is currently true that robots.txt doesn't have legal teeth and relies on voluntary compliance, but there have been court cases involving it in the past, and in my opinion they should have resulted in an established legal precedent. Check these out (courtesy of Wikipedia:)