How are private front-ends built without APIs? (self.asklemmy)

submitted 5 months ago by governorkeagan to c/asklemmy@lemmy.ml

15 comments fedilink hide all child comments

I'm referring to projects like redlib or invidious.

I was thinking about doing something similar for a local second-hand marketplace and got curious. Redlib seems to use token spoofing to get past rate limits and Invidious doesn't even use the official YouTube API.

The only way I thought of, which would be slow, is to scrape the site (like you would with Beautiful Soup).

you are viewing a single comment's thread
view the rest of the comments

[-] brokenlcd@feddit.it 5 points 5 months ago

Don't ever attempt to use regex for scraping.

Proceeds to implement a scraper in bash with grep and awk because it's the only way i know how to

[-] SubArcticTundra@lemmy.ml 3 points 5 months ago

Why not at least use Python?

[-] brokenlcd@feddit.it 1 points 5 months ago

I've always been searching for the time to learn python, but between uni and work i wake up at 5 and go back home at 10; + they where not going to pay me for this fix

Tldr; couldn't be fucked to study a whole other language in my nonexistent free time for a fix that they wouldn't pay me for anyways

this post was submitted on 22 Jul 2024

41 points (100.0% liked)

Asklemmy

44149 readers

1421 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

Open-ended question
Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
Not ad nauseam inducing: please make sure it is a question that would be new to most members
An actual topic of discussion

Looking for support?

Looking for a community?

Lemmyverse: community search
sub.rehab: maps old subreddits to fediverse options, marks official as such
!lemmy411@lemmy.ca: a community for finding communities

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 5 years ago

MODERATORS