I've slept on it.

I noted a reference to greek yoghurt as coming from ewe's milk. I think that is the key. There is a missing word. We don't get the cheese from the goat but from the milk of the goat. It is really goat's milk cheese (or if we don't buy the farmer with his/her single goat) goats' milk cheese and we have lost the word milk over the years.