this post was submitted on 03 Aug 2026
59 points (90.4% liked)

Programming

28256 readers
214 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev

founded 3 years ago
MODERATORS
snowe@programming.dev
Ategon@programming.dev
UlrikHD@programming.dev
bugsmith@programming.dev
Spyro@programming.dev
59
Hugging Face scraps GitHub repositories without prior consent (huggingface.co)
submitted 3 weeks ago by pylapp@programming.dev to c/programming@programming.dev
9 comments fedilink hide all child comments
 

Hugging Face crawls as many GitHub repositories as it can with the help of the Software Heritage Archive so as to create their Stack v2 LLM for code. And of course without consent of rights holders.

Opt-out is possible.

you are viewing a single comment's thread
view the rest of the comments
[–] misk@piefed.social 30 points 3 weeks ago* (last edited 3 weeks ago)

My code was scraped according to this website but let’s not kid ourselves that any kind of opt-out will prevent this. Any corpo knows that you can outsource all of your shady dealings to a couple of layers of third party vendors and pretend you didn’t know any better. It’s safe to assume that if you use an LLM that you didn’t train yourself you’re violating copyleft of some GPL project.