I think this may be a stretch, Bill; the more likely meaning seems to me to be based on a process of synecdoche, where a socially prestigious material becomes an eponym for 'high quality'. Does that cut the mustard for you?

http://phrases.shu.ac.uk/meanings/107200.html