The gaol sense is always 'up the river' though; it comes from England, does it not?

BY, if I parse of Troy correctly, the term "up the river" comes from New York, where city prisoners-to-be were sent up the Hudson River to Sing-Sing.