Whew! Holding steady now.

January 31, 2008

Yesterday was a wild one, but we seem to have gotten the “rogue mongrels” (some of you may know about those) and other software/hardware canines under control. This is what happened:

1st outage - 11:32pm est, 29 Jan - Matt takes the call - we’re back online shortly after that

2nd outage - 3:00am EST, 30 Jan - Matt gets woken up again - we’re back online shortly after that

3rd outage - 5:00am EST, 30 Jan - Matt can’t remember what planet he’s on, but takes the call - we’re back online shortly after that

4th outage - 6:50am EST, 30 Jan - down again - Matt staggers in to the mother ship - all hands on deck for the fight

Back up and holding steady at 2:00pm EST, 31 Jan. The outages were caused by crashes in our shared storage array which is used to host all customer data and images. No data was lost or compromised during all of the thrashing about.

Thank you for your patience (we hope) while we got things straightened out. We’ll be continuing to make improvemenets to prevent future problems. Matt hopes to get some extra sleep soon.

Posted by dswavely Filed in Outages

3 Responses to “Whew! Holding steady now.”

  1. Matt Baron Says:
    January 31, 2008 at

    Hah! Sleep is for the weak!

    Matt

  2. dswavely Says:
    January 31, 2008 at

    Spoken like a true Sparton! Fight on!

    Don

  3. Bye, bye Beta « SupplierSource Blog Says:
    March 5, 2008 at

    [...] Well, in my experience, that condition applies to all software, all the time. So, if anything, we’ve just been more honest. Like everything else: sometimes we break (Yes, the SupplierSource site is currently down and up and down again) and then we fix it (Whew! Holding steady now). [...]

Leave a Reply