this post was submitted on 19 Jul 2023
80 points (96.5% liked)
main
1450 readers
1 users here now
Default community for midwest.social. Post questions about the instance or questions you want to ask other users here.
founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I'm not sure what I could do with it unfortunately. If it can recover itself, that would be awesome.
I don't think there's an easy way to "replay" them. But in theory, you should be able to take the entries in that table related to midwest social from any other instance and start broadcasting them anew. The remote instances will reject them because to them they are duplicates, but you would be able to recover lost content.
Now I realize this is far more complex, but in theory it should be possible to create a tool that does this specifically for these scenarios.
I'm sorry this happened to you :(
Thanks. Yeah, this is what happens when my need to try everything to resolve an issue gets the better of me too fast. My filesystem was 90% full and I didn't want it to run out, so I deleted something I shouldn't have. If you have any idea why my disk would be using up lots of storage even though I'm using an S3 bucket and have my logs limited let me know.
Thanks for the transparency! I don't mind, mistakes happen, but I understand it's frustrating and a bit problematic with the lost content.
There was a post about that on a Lemmy admin community a few days ago. Someone with a ~1k userbase was eating up a GB/day on average. IIRC, there were lots of logs, but also if I understand correctly, every server stores mirrors of the data from anything users subscribe to. That could eat up a lot of data pretty quickly as the fedeverse scales up.
If you wanted to suggest a shift for improved scalability, maybe servers could form tight pacts with a few who mirror each other's content, and then more loosely federated servers load data directly from the pact. A compromise between ultimate content preservation and every larger server having to host the entire fedeverse.
So basically, a few servers would form a union. Each union would be a smaller fedeverse (like cells in an organ), and they'd connect to other organs to form the fedeverse/body.
Also, are users who joined in the past few days affected? I suppose they might need to sign up again.
Yeah, if they signed up in the last few days they'll need to do it again. Ugh.