>East Sussex, where I live
Is that the same as South Essex then, FoaB?


No!

There's certainly reason to your rhyme though - Sussex is a shortening of South Saxons and Essex of East Saxons. The split between East and West Sussex, however, was a relatively recent political/administrative thing.
http://www.camelotintl.com/heritage/counties/england/sussex.html