Do you have any luck crawling this directory? If so, how? in c/datahoarder@selfhosted.forum
[-] That_Acanthisitta305@alien.top 1 points 10 months ago

tldr:Offline Explorer by Metaproducts

https://metaproducts.com/products/product-comparison-chart

In Offline Explorer, there is a sequencer that allow you to autocheck a website/webpage for any updates in timed task and download the update. I have not use that features. Cant afford it haha.

For general site mirroring, for me, wget and Offline Explorer that I usually go to. Also in JDownloader there is Scheduler plugin, have not use it also.

Do you have any luck crawling this directory? If so, how? in c/datahoarder@selfhosted.forum
[-] That_Acanthisitta305@alien.top 1 points 10 months ago

tldr:Offline Explorer by Metaproducts

In Offline Explorer, there is a sequencer that allow you to autocheck a website/webpage for any updates in timed task and download the update. I have not use that features. Cant afford it haha.

For general site mirroring, for me, wget and Offline Explorer that I usually go to. Also in JDownloader there is Scheduler plugin, have not use it also.

That_Acanthisitta305

joined 10 months ago