What's a skivvy?

I've heard it used in the plural to mean underwear... any connection?