One of the quirkier examples is Holland/the Netherlands. From what I can tell they are synonymous in English. I can't think of another country with two names in English (aside from those that have changed names and are still occasionally referred to by the old one). To add to the fun, the inhabitants of the country are Dutch!