Okay, I'll try again...

If "I'm lost to its appeal", I like it.
If "it has lost its appeal", I don't like it.

"I'm lost in your eyes" doesn't mean "your eyes have lost me" or "I have lost your eyes", "in your eyes, I have lost", does it?

If you're still lost, explain why he would make a place he didn't like "a temporary spiritual home" -- some sort of self-loathing perhaps?