Another shot in the dark: at one point, including in the 1400s when Hieronymous Bosch was putting them in all of his paintings, owls were a symbol of evil. Perhaps it is in this capacity that the phrase began?