Double ARGH!
Feb. 10th, 2008 11:36 am![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
dsrtaoWe've all had the experience of Not Doing Anything and having the behavior of the complex system change, right? The answer, generally, is to look at the asterisk and ask what little thing we Just Poked At A Little.
My first ARGH was Saturday, early evening, when a major complex system at work to which we had Not Been Doing Anything, No Really suddenly stopped working at all. When we got it back up, it was mostly up but not entirely. I poked at it some more, and then announced I would fix it in the morning rather than touch critical systems while tired. My minion was extremely helpful.
This morning I grabbed the whole config, diff'd against an archived version,
and saw... nothing significant. So I wrote a note to the team saying I was still banging my head against the problem, and started to retest everything.
Second ARGH: the things which were broken were now healed.
I'm now suspecting a completely different system is broken.
My first ARGH was Saturday, early evening, when a major complex system at work to which we had Not Been Doing Anything, No Really suddenly stopped working at all. When we got it back up, it was mostly up but not entirely. I poked at it some more, and then announced I would fix it in the morning rather than touch critical systems while tired. My minion was extremely helpful.
This morning I grabbed the whole config, diff'd against an archived version,
and saw... nothing significant. So I wrote a note to the team saying I was still banging my head against the problem, and started to retest everything.
Second ARGH: the things which were broken were now healed.
I'm now suspecting a completely different system is broken.
