Not to mention Rensselaer or Poughkeepsie or Chautauqua.

But in fairness, New York isn't unique in this regard. Massachusetts has Worcester (I should know!), and Leicester, and any number of inscrutable names of Indian origin...