this post was submitted on 29 Jan 2026
59 points (100.0% liked)

Fuck AI

5486 readers
571 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

founded 2 years ago
MODERATORS
VerbFlow@lemmy.world
MrMcGasion@lemmy.world
TootSweet@lemmy.world
BigMikeInAustin@lemmy.world
cynar@lemmy.world
drmeanfeel@lemmy.world
pavnilschanda@lemmy.world
CriticalMedicine@lemmy.world
WonderfulWanderer@lemmy.world
Communist@lemmy.ml
eatCasserole@lemmy.world
SpaceNoodle@lemmy.world
NutWrench@lemmy.world
Soup@lemmy.cafe
iAvicenna@lemmy.world
Tinks@lemmy.world
wizblizz@lemmy.world
corus_kt@lemmy.world
Prandom_returns@lemm.ee
JimSamtanko@lemm.ee
TrickDacy@lemmy.world
TheFriar@lemm.ee
ArmokGoB@lemmy.dbzer0.com
HawlSera@lemm.ee
andrew_bidlaw@sh.itjust.works
MeDuViNoX@sh.itjust.works
33550336@lemmy.world
Nougat@fedia.io
Lost_My_Mind@lemmy.world
Sterile_Technique@lemmy.world
Quill7513@slrpnk.net
glowing_hans@sopuli.xyz
e8d79@discuss.tchncs.de
ThefuzzyFurryComrade@pawb.social
59
ClaudeBot crawled within minutes of a new site going live (lemmy.world)
submitted 3 days ago by nucleative@lemmy.world to c/fuck_ai@lemmy.world
10 comments fedilink hide all child comments
 

Today I set up a little project website on a new subdomain. It's not a www subdomain or a newly registered domain, which is easy to detect. We're talking about:

Randomchars.mydomain.com

Within 20 minutes, the anthropic ClaudeBot was on it. I could tell because the nginx access log showed a hit to robots.txt and then a handful of pages.

First off, how the hell did they find it? Next, is my DNS provider, Amazon Route 53 selling this kind of data now? Or is there some kind of DNS wildcard query?

you are viewing a single comment's thread
view the rest of the comments
[–] Taldan@lemmy.world 5 points 2 days ago* (last edited 2 days ago) (1 children)

I'm a bit confused about your DNS config. DNS is generally public, that's the point of it

AI scrapers, like most scrapers, just crawls every new DNS entry that is created

[–] cron@feddit.org 4 points 2 days ago (1 children)

How exactly can you find all subdomains of a given domain?

Sure, it is possible with misconfigured DNSSEC (zone walking), but otherwise I‘d say it is not possible.

[–] ramble81@lemmy.zip 5 points 2 days ago (1 children)

I could see accidentally having XFER enabled (not even DNSSEC related) and they transfer your entire zone.

[–] cron@feddit.org 2 points 2 days ago

Thats possible, though probably not the most likely option (misconfigured webserver, certificate transparency logs).