Still trying to think of others besides hymns, of which there are several. Since CK diverted a bit, I thought I would too: my college roommate took a General Music class, and they developed mnemonics for different classical works.
For Mozart's 41st. symphony, it was, "Old Mozart's in the closet, gethimout gethimout gethimout".