Wow, I believe you recall correctly. I have a vague memory of reading that Thanksgiving was first designated a holiday under the Lincoln administration, and was on-and-off*, and changed dates a couple of times before settling on the fourth Thursday in November.

*Aenigma suggests "onanism"