i've always seen it termed "high-end". i think that gets the point across clearly. "specialty" would be another option.

upscale, to me at least, brings connotations of the neuveau riche.