Buff is also used to mean cut, ripped, muscular or well-defined (which are all the same thing really) but I assume this developed from buff=polish rather than in the buff.