this post was submitted on 03 Aug 2026
59 points (90.4% liked)

Programming

28256 readers
330 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev



founded 3 years ago
MODERATORS
 

Hugging Face crawls as many GitHub repositories as it can with the help of the Software Heritage Archive so as to create their Stack v2 LLM for code. And of course without consent of rights holders.

Opt-out is possible.

top 9 comments
sorted by: hot top controversial new old
[–] BrianTheeBiscuiteer@lemmy.world 34 points 3 weeks ago

Oh, scrapes.

[–] misk@piefed.social 30 points 3 weeks ago* (last edited 3 weeks ago)

My code was scraped according to this website but let’s not kid ourselves that any kind of opt-out will prevent this. Any corpo knows that you can outsource all of your shady dealings to a couple of layers of third party vendors and pretend you didn’t know any better. It’s safe to assume that if you use an LLM that you didn’t train yourself you’re violating copyleft of some GPL project.

[–] one_old_coder@piefed.social 22 points 3 weeks ago

The opt-out procedure is on display in the bottom of a locked filing cabinet stuck in a disused lavatory with a sign on the door saying 'Beware of the Leopard'.

[–] trevor@lemmy.blahaj.zone 7 points 3 weeks ago

The datasets are stored in a git repository, so even when your opt-out request is "honored", the "deleted" data remains in the repository history.

[–] thingsiplay@lemmy.ml 7 points 3 weeks ago
[–] Grimy@lemmy.world 6 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

Hugging face open sourced a dataset every big AI company already has privately. We need to get mad about this because hugging face is the last target to take down, to finish the regulatory capture started at the behest of openAI and company.

Even if scrapping GitHub was made illegal, does anybody here really think the money would go to them and not Microsoft?

[–] dil@piefed.zip 3 points 3 weeks ago (1 children)

I'm supposed to be upset about ai using opensource code now?

[–] Grimy@lemmy.world 2 points 3 weeks ago

The second part of my first paragraph is sarcastic. I realize I worded it weirdly.

That being said, they need us upset so it's easier to pass laws that make developing AI models impossible for smaller players.

Most are begging for stronger copyright laws. It's nuts.

[–] vala@lemmy.dbzer0.com 2 points 3 weeks ago

I checked and 52 of my repos are in this.