Write a web scraper but don't tell anyone.
There's probably a few already made ones on github
do i need to use reddit's api? i think api is paid.
i think only beyond a certain amount of requests. For your cases it should be fine
bdfr would be a good start, then you can find or create a script to merge the files into one
We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.