If you want to compound the ambiguity with bad grammar, you might consider the "Doctor's visit" to mean a visit WITH the doctor. That way it doesn't matter whether there's an apostrophe or not, or who went to whose place, and it has the perverse added attraction of having no grammatical consistency whatsoever. (Well, maybe the consistency of watery gruel. If you insist.)