does the 'count' here refer to what was once owned by a count?

Yup. Compare comitatus with the French comte. Count, meaning enumerating, comes from computare.
http://www.bartleby.com/61/36/C0693600.html