When is a goose a duck? When it's a merganser. Merganser is literally "sea goose".
Ein gut gebratene Gans ist eine gute Gabe Gottes.

P.S. Oh, dear. Wordwi;nd has caught me committing a folk etymology.
When a duck do? it submerges.