Looking for some advice on moving 100TBs of data from the cloud to tape (lemmy.world)

submitted 6 months ago* (last edited 6 months ago) by cm0002@lemmy.world to c/datahoarder@lemmy.ml

14 comments fedilink hide all child comments

With Google Workspace cracking down on storage (Been using them for unlimited storage for years now) I was lucky to get a limit of 300TBs, but now I have to actually watch what gets stored lol

A good portion is uh "Linux ISOs", but the rest is very seldom (In many cases last access was years ago) accessed files that I think would be perfect for tape archival. Things like byte-to-byte drive images and old backups. I figure these would be a good candidate for tape and estimate this portion would be about 100TBs or more

But I've never done tape before, so I'm looking for some purchasing advice and such. I seen from some of my research that I should target picking up an LTO8 drive as it's compatible with LTO9 for when they come down in price.

And then it spiraled from there with discussions on library tape drives that are cheaper but need modifications and all sorts of things

you are viewing a single comment's thread
view the rest of the comments

[-] constantokra@lemmy.one 2 points 6 months ago

Do you have any distro or hardware advice? I have an external drive, and I've bought several fiber channel cards for it and none of them seem to work either with my motherboard or distribution.

[-] scrubbles@poptalk.scrubbles.tech 3 points 6 months ago* (last edited 6 months ago)

I used an LSI 8i SAS card, with a standard SAS cable to my internal SAS tape drive. Then I just used plain ubuntu to get it up and running. The LSI cards are my go-to for anything SAS, used them for 10 years and never had a single one fail.

Edit @constantokra@lemmy.one I remembered I had this saved, this saved me a ton of time setting up my drive last time, everything I needed: https://www.linuxquestions.org/questions/linux-hardware-18/lto-tape-drive-linux-experience-4175620090/

[-] constantokra@lemmy.one 3 points 6 months ago

I probably should have gotten a sad drive, but I found a good deal on an external fiber channel one and I didn't realize how difficult fiber channel cards could be.

[-] scrubbles@poptalk.scrubbles.tech 3 points 6 months ago

I'd be interested to hear how it goes, I'm looking at replacing mine. If you get yours to work, please report back. I'm actively looking for a new LTO8 drive

[-] constantokra@lemmy.one 3 points 6 months ago

That's a great resource. Thanks for sharing.

this post was submitted on 16 May 2024

30 points (94.1% liked)

datahoarder

6766 readers

10 users here now

Who are we?

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

We are one. We are legion. And we're trying really hard not to forget.

-- 5-4-3-2-1-bang from this thread

founded 4 years ago

MODERATORS

archivist@lemmy.ml