This post from the Twitter blog is astonishing and wonderful.
We’ve gone through our various databases, caches, web servers, daemons, and despite some increased traffic activity across the board, all systems are running nominally. The truth is we’re not sure what’s happening. It seems to be occurring in-between these parts.
I added the emphasis above. I’ve worked for companies that provide services and have run into technical problems - every company that provides an IT-based service has run into problems at some point - and the idea that the people at Twitter are actually telling us that they haven’t figured it out is amazing.
Some might say it’s amazingly foolish - won’t users lose confidence in them? I think users will appreciate the honesty. Because nobody gets a lot of confidence from the way service providers usually respond to these things: “Because our service is so industry-leading, unexpected demand has strained our network, but we are addressing it with new technology investments that will support our ground-breaking product roadmap which includes even more leading-edge features!” Meanwhile, elsewhere in the building, an engineer is saying, “I don’t know why the damn thing keeps crashing!”
Having seen all of that up close, hearing “We don’t know, but we are working on it” is very refreshing. It’s like something an actual human being would tell you. And that’s followed by this:
We’re busy working on instrumenting and adding meters to provide visibility into what’s slowing Twitter down. We’ll use this data both to alleviate the current woes and to help inform our long-term architecture work to make Twitter a utility service people can count on. We’ve definitely failed that aim this week.
“We’ve definitely failed.” We’ve all seen companies fail at something. It’s so rare for them to bluntly admit it. And that, too, is refreshing.
None of this gets Twitter off the hook for making their service work properly. I think, though, that users are a bit more patient when they are hearing the people there talk about what’s going on in an honest, human way.