The old system is still answering
We thought we had retired the old copies of one of our own products. An outside sweep found more than 1,700 addresses still serving it. Retiring a system means checking every door, not the ones you remember.
We had a plan to retire the old copies of one of our own products. It was a good plan. It had a check at the end: look at every address from the outside and make sure nothing old still answers.
The first look was a sample. Four old test addresses were behind a login wall. Job done, you might think.
Nobody had actually swept them all. So we did.
The count was not four
Every time you build and test a product, the tooling can leave a copy behind at its own address. Over months those copies pile up. Nobody decides to keep them. Nobody decides to delete them either.
We probed 2,186 addresses once each, from the outside, without following redirects. More than 1,700 of them were not the live product and were still serving it. A few hundred were behind a login wall, which is what we wanted. Two were meant to be live. None of the rest showed a “this has moved” notice.
Nothing had visibly gone wrong. That is the point. An old copy that still answers looks exactly like a working one until somebody needs it not to.
Then a second sweep found six more
We put a retired notice on the first batch and swept again. The second sweep covered 418 addresses and found six more that still served the product. We closed four and logged the other two as a separate job, because they sat outside the card that was open.
Each pass still found something the one before had called clean.
A memory is not an inventory
The sample we started with was not careless. It was the addresses people remembered. That is how most retirements run in any business. The team closes the systems it knows about, and the ones it forgot carry on.
Hospitality has its own versions of this. Think of an old booking widget on a pub’s page that still takes bookings into a mailbox nobody reads, last year’s menu PDF that a search engine still serves, a listing that still shows the old opening hours, or a supplier login that still works for someone who has left.
The cost is not usually dramatic. It is a customer who books and is never answered. It is a guest quoted last year’s price. It is a leaver with access they should not have. Small, quiet and avoidable.
Done means checked from outside
The test that worked for us was simple. Do not ask the owners what they switched off. Go and knock on every door from the street, write down what answers, and keep going until a full sweep comes back clean.
We have not finished. At the last sweep two addresses were still open. But we know that, which we did not a few days ago.
What leaders should do next
- Pick one thing you believe you have retired, a booking tool, a menu, a listing or a supplier login, and check it from outside as a customer would. Do not ask the team whether it is off.
- Write the check into the plan before you start. “Closed” should mean a full sweep came back clean, not that the list of known items is ticked.
- Ask who owns the list of old things. If the answer is “whoever remembers”, you do not have a list.
- When a sweep finds something, fix it and sweep again. Treat the second pass as part of the job, not a sign the first one failed.