• Ch3rry314@piefed.social
      link
      fedilink
      English
      arrow-up
      30
      ·
      11 hours ago

      Yeah, I agree I was chuckling till I saw the last article and audibly said oooooh. A real sobering moment.

      • death_to_carrots@feddit.org
        link
        fedilink
        arrow-up
        9
        arrow-down
        1
        ·
        edit-2
        7 hours ago

        This was propably some honor thing. Or avoidence of responsibilty. Or maybe taking one for the team as scape goat. I don’t know. Nevertheless, it is sad.

        Edit: If you or someone you know is feeling emotionally distressed or struggling with thoughts of suicide, you can find international contacts at https://befrienders.org/.

  • Damage@feddit.it
    link
    fedilink
    arrow-up
    6
    ·
    8 hours ago

    You can’t lose computerised services if you don’t have computerised services. Checkmate SysAdmins.

    • Railcar8095@lemmy.world
      link
      fedilink
      arrow-up
      10
      ·
      9 hours ago

      My ex company had for more than 10 years keept all the data customers shared with us. Structured and standardized, should have been easy peasy.

      Somehow they were “appending wrong” in some way and data was useless. In think they were trying to reduce the size by aggregating a bit, but they did in a way that rendered the data useless.

      Of course the CEO wanted to train models with it anyway…

      • unphazed@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        1 hour ago

        10 years and no one bothered to pull some information at random? I mean generally companies have a schedule of assessments to ensure records. Even if it’s as simple as checksum.

    • luciferofastora@feddit.org
      link
      fedilink
      arrow-up
      4
      arrow-down
      1
      ·
      8 hours ago

      The person in charge of allotting budget. “You want how many thousands for backup solutions? Here, take this flashdrive I picked up in the parking lot and use it for backups, that should be plenty enough. I mean, how many bytes can our data be? Two, three maybe?”

    • palordrolap@fedia.io
      link
      fedilink
      arrow-up
      8
      ·
      11 hours ago

      Backups are always considered to be too expensive up until the point that not having backups becomes more expensive. This applies to redundancy of all kinds except the one that means firing employees for not setting up the other kinds.

      • unphazed@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        1 hour ago

        Even at home. I do one usb backup and one internal backup of photos, home videos and documents. I would love to make backups of other stuff, but I can replace a lot of the other crap if need be, because hard drives kinda stalled in price drops.

    • Ephera@lemmy.ml
      link
      fedilink
      English
      arrow-up
      1
      ·
      8 hours ago

      I doubt anyone said it verbatim, but it happens that they’re deemed lower priority ad infinitum.

  • shalafi@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    ·
    10 hours ago

    I collect stories like this for when I need to make a case for purchasing new gear or services.

    • marcos@lemmy.world
      link
      fedilink
      arrow-up
      16
      ·
      12 hours ago

      Last time we lost disks at work, there were full backups.

      They were just in the same disks as the data. And because everything is abstracted two times into virtual disks on virtual machines, and containers and volumes, the people responsible for the backups didn’t even know it.

      • Winter_Oven@piefed.social
        link
        fedilink
        English
        arrow-up
        11
        ·
        edit-2
        11 hours ago

        But won’t you like…check? That the backups are own their own drive? The whole 3-2-1 rule kinda make you want to check this, no?

        Or was it like they knew where the drives of the backups were, but they didn’t know those drives were being virtualized away and were in like production use?

        • marcos@lemmy.world
          link
          fedilink
          arrow-up
          10
          ·
          edit-2
          10 hours ago

          I dunno what possibilities they actually had. But knowing the place, I can fully believe both that they weren’t allowed to check and that they never bothered.

          The most likely scenario in my head was that they sent a request to the provisioning team asking for the volume to be in a different disk, and that detail never made into the technician actually doing the work (that sits on the next chair, but the requests have to come from the system).

          (And the long term backups were fine. We lost 3 days of data.)