thomas

joined 2 years ago
MODERATOR OF
[–] thomas@lemmy.douwes.co.uk 1 points 2 years ago (2 children)

Webtorrent seems to have some issues with peer discovery. I've tried the instant.io site they have linked on webtorrent.io and I can't get it to download or share anything, the desktop client managed to download a torrent from my peertube instance over normal BitTorrent but I can't share it over webtorrent. I downloaded a video from my peertube instance using btorrent.xyz over webtorrent but I can't seed new files because the peers don't find each other. when I use a webtorrent with a tracker (like peertube) it works fine but how were sites like instant.io supposed to discover peers without trackers? I don't think DHT exists for webtorrent yet.

You can manually seed videos on instances using redundancy but I was thinking automatic redundancy for watched videos might be a good idea, I guess you can do automatic redundancy for entire instances but that would take up a lot of storage space.

One of the nice thing with BitTorrent is the high reliability so I assumed that was what peertube was trying to do, I guess the idea is not to provide data redundancy but to split load instead?

[–] thomas@lemmy.douwes.co.uk 1 points 2 years ago (4 children)

why? if 5 instances are seeding the video, clients should be able to download from all 5 instances and spread the bandwidth usage right?

[–] thomas@lemmy.douwes.co.uk 1 points 2 years ago (6 children)

Why not also use the instance to re-seed? it could keep seeding after the visitor closed the video.

[–] thomas@lemmy.douwes.co.uk 3 points 2 years ago (8 children)

Would it not make more sense if your instance downloaded and redistributed the torrent? then you could keep seeding after the tab closed. it also wouldn't leak your IP then.
What about peer discovery? I opened that webtorrent website in two browsers and they didn't peer, is that demo real?

[–] thomas@lemmy.douwes.co.uk 2 points 2 years ago (1 children)

This is wrong, I use IPTables but the device is absolutely not dedicated lol.

[–] thomas@lemmy.douwes.co.uk 4 points 2 years ago* (last edited 2 years ago) (3 children)

Download ML thing.
make new venv.
pip install -r requirements.txt.
pip can't find the right versions.
pip install --update pip.
pip still can't find the right versions.
install conda.
conda breaks for some reason.
fix conda.
install with conda.
pytorch won't compile with CUDA support.
install 2,000,000GB of nvidia crap from conda.
pytorch still won't compile.
install older version of gcc with conda.
pytorch still won't compile.
reinstall the entire operating system with debian 11.
apt can't find shitlib-1.
install shitlib-2.
it's not compatible with shitlib-1.
compile it from source.
automake breaks.
install debian 10.
It actually works.
"Join our discord to get the model".
give up.

[–] thomas@lemmy.douwes.co.uk 1 points 2 years ago (8 children)

Nah, I can't see any reason to make more than one account.

[–] thomas@lemmy.douwes.co.uk 1 points 2 years ago

The file you downloaded is a compressed JSON file, it's not something you can really just look at. But it contains all the data needed to build a nice UI around.
I don't know what OS you are on but on linux you can run zstd -d -c file.zst | jq . and it will print everything in the file. It's not really readable though. Also it doesn't have any of the media content, only the text

[–] thomas@lemmy.douwes.co.uk 2 points 2 years ago* (last edited 2 years ago) (9 children)

I hate reddit. But it feels like the library of Alexandria burning down (yea I know). All those google search results and educational subreddits that are shutting down forever, and because they are too small reddit won't force open them again.
A lot are in the pushshift archive, but that cuts of at 2022. Also, it doesn't include a lot of the smaller subreddits.
I have had my PC running 24/7 with multiple VPNs to avoid rate limits downloading as much as I can before the API dies, but with some blackouts moving forward a day I have already missed a few.
Like many others, I would often add "reddit" to the end of my searches to get better results, half the websites on web searches now are either AI generated, copies or are completely AD ridden websites that ask you to turn off your AD blocker.

view more: ‹ prev next ›