There really *is a Podunk, in upstate New York. This link tells us it means "swampy place," I'm guessing from one of the Iroquois languages. I understand the townsfolk don't put up an "Entering Podunk" sign any more because people keep stealing it.

http://www.epodunk.com/cgi-bin/genInfo.php?locIndex=1449