Last night, Lemmygrad went down due to a hardware glitch on our VPS provider. Unfortunately, they were unable to do anything to help me fix the issue, and asked that I reinstall from scratch 🙁 . They did inform me that the hardware issue at fault is fixed at least.

I do daily backups, so we lost a day of posts.

Pictures are in the process of being restored now, but it should take a day or so to restore them all.

Let me know if there are any other ongoing issues so I can fix them. Again, sorry everyone.

  • Capitalist Tears
    link
    fedilink
    121 year ago

    Being involved in devops, I can relate to how much this sucks and I appreciate you taking the time to fix it. o7

    • Muad'DibberOPM
      link
      fedilink
      81 year ago

      Thanks comrade, ya these can be nightmare scenarios. I at least have several backup locations, so at most we lose a day’s worth of data.

    • @panic@lemmygrad.ml
      link
      fedilink
      61 year ago

      I’m not involved in this type of work but I would just pull the plug, I can’t understand the amount of patience you need for this shit

      • Muad'DibberOPM
        link
        fedilink
        31 year ago

        Everything will be going fine for weeks, and then: oopsie poopsie everything’s gone!

    • Capitalist Tears
      link
      fedilink
      51 year ago

      Anecdotally, my instances have poofed into thin air even on AWS, so this seems not too rare. You use a managed database or something you’ve setup yourself?

      • Muad'DibberOPM
        link
        fedilink
        41 year ago

        Set up ourselves. Its postgres running in a docker container, with daily backups.