I'm more inclined to say "I have a doctor's appointment" rather than "visit." "Visit" is much too social for anything that often involves needles and specimens.