I think there ought to be a word for dress that is not casual, but not necessarily formal.
One can look out of place at a beach party in a business suit which is not actually formal.
But I don't have a good word for it.