I had a similar experience when I moved to a very rural house for a couple of years. It was extremely comfortable.

Whenever I got back to the city, I felt overwhelmed.

I ended up living in the city and getting used to the noise again. I made the conscious decision to do so because I felt like I limited myself a lot in the places that were acceptable.

Comfort is it's own prison.

I wonder, though, if there is some kind of gain I miss out on by getting used to discomfort.