Interesting idiom.. i would guess, Damn gave way to dang.. and dang morphed into hang..
"as if i could give a damn" = "as if i could give a hang"

just as "YO" is realy "here"-- it followed the same path as Whore did to end up as "hoe". William Safire covered the changes some years ago..