"We've reached the crest of the pass, boys, its all downhill from here"

Rusty, the usage of the word downhill in that particular sentence seems pretty literal, not figurative. The speaker is describing the downhill nature of the slope, (or the down slope of the hill!) more like an adverb. Doesnt sound like a metaphor, does it?
Still thinking abt the phenomenon though!