Here's one for you:
Worked at a large (possibly the largest in the world) IT hardware / services company, was working on a Y2K compliance project - one of the most difficult as the client was a major bank, and upgrading / replacing
some systems was going to be a bitch due to one major fact, outlined below.
At certain "key" locations the bank could not afford to lose connectivity / network services for any period greater than a couple of hours due to the volume of transactions going through these locations, when I say "couldn't afford" I mean we we're told, in explicit detail, that the knock-on effects of a service loss of greater than 4 hours would be
terminal for both the bank
and the British economy.
The work required was fairly simple, in theory, bring down the server at a pre-arranged time, upgrade the OS, check the servers were OK on the hardware front and if all looked bad, use the mirrored, supplied-in-advance new spare server as a back-up plan but do everything in your power to fit this into the 4 hour window we had been given.
Some of these servers had been running 24/7 for
years, so you can guess that some suffered critical failure just by rebooting, and a lot of the spare new servers got used in their place.
Nobody, in the whole multi-million pound, economy-critical project had planned what to do if the old servers died / were faulty
and the supplied spares were Dead on Arrivals as well, one regional project manager who got a call from the onsite engineer that
both servers were dead actually cried on the phone and effectively shut down in panicked fear. (I know, because I was the engineer that made the call)
Multiple times this happened and the British economy has some very resourceful, absolutely panicked contracted, cheap 3rd party field service engineers to thank as they did everything in their power to make sure that
a server was back up at the end of the window regardless. (Not easy, these were, don't laugh, OS/2 set-ups with specific cryptographic hardware used by banks, not something you could get drivers for and knock up a server with easily.)
Both the Bank and the IT services company asked us politely that we not share just how close to collapse the bank and the British economy as a whole had come.
However they we're in such a rush at the outset of the project, that they never actually had us sign an NDA about it.
