that's as may be; but here's a word more specific to the question, and probly wrong as well:

cryptoscopophilia - the urge to look through the windows of homes you walk past