It comes from the mantle of invisibility. The usage was taken from the wordorigins message board. I forget where it was from ultimately, probably some old folk tale device.