According to the stylebook of the US Government Printing Office:

3.21. A descriptive term used to denote a definite region, locality, or geographic feature is a proper name and is therefore capitalized; also for temporary distinction a coined name of a region is capitalized.

3.22. A descriptive term used to denote mere direction or position is not a proper name and is therefore not capitalized.

and there you are.