I don't quite live in the South, but one way or another I've heard southern expressions all my life, and I have never heard of this one. The best I can figure is that it's devilish hard to make a harelip go away...

Olly, this def. from Webster's 1828 dictionary may enlighten you:
A divided upper lip, like that of a hare.