I quote from alt.lefthanders FAQ:

It seems that on many (most) baseball diamonds the left hand side of the pitcher's mound would face south. At one time, most ball-parks were constructed so that the setting sun was behind the batter so as not to be in his eyes. The LH pitcher's throwing arm would then be toward the South as he faced the plate.