a "lid" can be a hat or cap, and "pop" can mean an elderly man While this is correct, there is no widespread cultural idea or even myth of a man, elderly or not, having particular attachment to his hat. Individuals, yes; society-wide, no. So I don't think this explanation fits, here.

explain why he would make a place he didn't like "a temporary spiritual home" At first reading, I assumed (nope, still haven't learned!) that the last sentence in the quote was referring back to his initial impression of the place. Upon reading the quote I put in blue, I am now wondering whether ALL of my first impression was wrong...