Their explanation for having no backups was that 858 TB of data was “due to its large capacity”. They stored eight years of data without backups. Even with systems where they had backups, it sounds like there’s no redundancy – nobody can work because the single building where all the servers are located is currently out of order.
Sounds like the acute symptoms of chronic penny-pinching when it comes to IT infrastructure. I hope they take some good lessons from it at least. Just a shame that it’s such a devastating way to learn.
Some moron deleted 75 TB of prod database the other day and sure that was catastrophic (for him, mostly) but it was backed up. We are a mid-size company, maybe a few hundred people across the country. I can’t imagine the governement of freaking Korea, land of fiber years before everyone else, running so short on storage they can’t do backups.
This shit is gonna go into It school books, like the OVH data center fire from 2018 (iirc)
“we can’t ensure the data is safe because there’s too much of it”
…sounds like an especially big reason to figure something out, huh? Not to mention, 858 TB isn’t even that much for a whole ass government. For a consumer it might be 10$ per TB for a new drive, so it would be less when you’re a government, which makes it just a bit under 10 000 USD for a full backup. That’s it. Even if you budget in having to replace all drives once a year, 10 000 USD/yr is a bargain
New drives are more like 20€ per TB. Factor in redundancy with something like raid 5 and boom, off-site storage costs you a government toppling 20 000€ in hard drives.
And then you buy the storage from Dell or some other big player and the disk array with controllers, warranties and the kitchen sink costs 100k€. Which is still almost a rounding error on that scale.
Their explanation for having no backups was that 858 TB of data was “due to its large capacity”. They stored eight years of data without backups. Even with systems where they had backups, it sounds like there’s no redundancy – nobody can work because the single building where all the servers are located is currently out of order.
Sounds like the acute symptoms of chronic penny-pinching when it comes to IT infrastructure. I hope they take some good lessons from it at least. Just a shame that it’s such a devastating way to learn.
Some moron deleted 75 TB of prod database the other day and sure that was catastrophic (for him, mostly) but it was backed up. We are a mid-size company, maybe a few hundred people across the country. I can’t imagine the governement of freaking Korea, land of fiber years before everyone else, running so short on storage they can’t do backups.
This shit is gonna go into It school books, like the OVH data center fire from 2018 (iirc)
“we can’t ensure the data is safe because there’s too much of it”
…sounds like an especially big reason to figure something out, huh? Not to mention, 858 TB isn’t even that much for a whole ass government. For a consumer it might be 10$ per TB for a new drive, so it would be less when you’re a government, which makes it just a bit under 10 000 USD for a full backup. That’s it. Even if you budget in having to replace all drives once a year, 10 000 USD/yr is a bargain
New drives are more like 20€ per TB. Factor in redundancy with something like raid 5 and boom, off-site storage costs you a government toppling 20 000€ in hard drives.
And then you buy the storage from Dell or some other big player and the disk array with controllers, warranties and the kitchen sink costs 100k€. Which is still almost a rounding error on that scale.
deleted by creator