Another illogicality is that we always go 'up' to London, regardless of where you're travelling from. And it often gets referred to as 'town'. Eg. if you're having a weekend in the country and you're about to travel back to London, you might ask when we were heading back to town.