GitHub

314 readers

1 users here now

A community for discussion and posts relating to github https://github.com/

founded 2 years ago

MODERATORS

pylapp@programming.dev

Hugging Face scraps GitHub repositories without prior consent (huggingface.co)

submitted 3 weeks ago by pylapp@programming.dev to c/github@programming.dev

1 comments fedilink hide all child comments

Hugging Face crawls as many GitHub repositories as it can with the help of the Software Heritage Archive so as to create their Stack v2 LLM for code. And of course without consent of rights holders.

Opt-out is possible.

you are viewing a single comment's thread
view the rest of the comments

[–] Grimy@lemmy.world 2 points 3 weeks ago

You don't need consent. It's better to have an open dataset, since all the big AI companies have their own private dataset anyways (which isn't opt-out).

So it starts I guess. Hugging face holds basically all the open source data and models, the government will start going after them now that they are getting copyright wins. It's regulatory capture. They are doing it at the behest of big AI companies to kill the competition.