12
Benefits of using scrapy over requests/selenium
(lemmy.world)
Welcome to the Python community on the programming.dev Lemmy instance!
October 2023
November 2023
Past
July 2023
August 2023
September 2023
Oh shit that sounds useful. I just did a project where I implemented a custom stream class to chain together calls to requests and beautifulsoup.
Yep try scrapy. And also it handles for you the concurrency of your pipelines items, configuration for every part,...