War story

The server everyone forgot was still in production

· Adrian Sullivan

Every estate has one. The server nobody mentions on the tour. It does not appear on the diagram. It is not in the monitoring. The person who built it has moved on, possibly to another country. And it is running something the business cannot live without.

We find it during the inventory, every time. Usually the conversation goes like this. “What’s this one?” “Oh. That’s, I think that runs the thing for the warehouse?” Nobody is quite sure. It has not been patched since an operating system that is now old enough to drive. Its backups go to a disk on the same machine, which is a bit like keeping the spare key inside the locked car.

One of these, a few years back, turned out to be the database behind a company’s entire dispatch operation. Forgotten. Unpatched. Backed up to itself. If it had died on a Monday morning, they would not have been able to send a single order out the door, and they would have found out the hard way that the backup was useless.

It had been sitting there for years, quietly waiting, in plain sight of anyone who went looking. Nobody went looking, because everything was fine. Everything is always fine, right up until 2:39 in the morning.

The reason these servers survive is that they never cause trouble. That is exactly what makes them dangerous. A loud problem gets fixed. A silent one gets inherited.

We go looking, on purpose, before the server picks the date. The check is free and it is read-only. The worst case is you find out you are fine. The realistic case is we find the one nobody remembered.

Free health check

Want to know if this is sitting in your estate? We run a read-only check and hand you a graded report in plain English.

Get your free health check

← All posts