53
What is Swarm Merging? (lemmy.dbzer0.com)

Every now and then, when I'm connected to a torrent a peer will connect that has a reference to "Swarm Merging" in their name. What is swarm merging?

you are viewing a single comment's thread
view the rest of the comments
[-] lvxferre@lemmy.ml 47 points 1 year ago

It's a way to share files across seeders/peers of different torrents, as long as the torrents contain at least one identical file. For example, let's say that:

  • you're downloading torrent1. It shares the files A and B. You got A already, but since the number of seeders dropped considerably, you're having a really hard time downloading B.
  • there's also torrent2, sharing files B and C. Fairly active, with lots of seeders.

Without swarm merging, you're stuck waiting for new seeders or peers from torrent1 that have the file B. With swarm merging, your torrent program will get the file B from people sharing torrent2 too.

I recall this feature from Vuze; but apparently BiglyBT also uses it.

[-] dragonfly4933@lemmy.dbzer0.com 13 points 1 year ago

BitTorrent v2 allows this also. In v1, torrents with multiple files are hashed continuously (cat) together without respect to file boundaries. A side effect of this that many people notice is that to grab a specific file may require downloading some of the files before or after the one you want.

Under v2, each file is hashed separately, so this fixes the aforementioned problem and should allow sharing of files across torrent files.

[-] lvxferre@lemmy.ml 1 points 1 year ago

That's good to know!

[-] bear_with_a_hammer@lemm.ee 1 points 1 year ago* (last edited 1 year ago)

You can extract, calculate and compare those hashes using this tool.

In the next bug-fix release of libtorrent the tool will have ability to generate magnet links to download torrents without duplicate files, saving storage, bandwidth and most importantly time.

Very useful for dumps, libraries, video/photo archives ;)

load more comments (3 replies)
this post was submitted on 11 Jul 2023
53 points (98.2% liked)

Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ

53795 readers
568 users here now

⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.

Rules • Full Version

1. Posts must be related to the discussion of digital piracy

2. Don't request invites, trade, sell, or self-promote

3. Don't request or link to specific pirated titles, including DMs

4. Don't submit low-quality posts, be entitled, or harass others



Loot, Pillage, & Plunder


💰 Please help cover server costs.

Ko-FiLiberapay


founded 1 year ago
MODERATORS