I was the same way for a while. I used the SE and swore I could never use one of the huge phones. Then I got an iPhone 11 Pro after I realized people weren't really designing with the small phone in mind and that it wasn't the future. It took ~2wks but now I can't believe I was using the SE for as long as I did. The larger format is superior in my experience after having forced myself to give it a go.
I would agree that a larger screen is superior but that doesn't mean that is it preferable for everyday usage. I've used phones ranging from 2.5" screens (Unihertz Jelly) to 6.6" screens (Honor Note 6) and it depends on what the phone is going to be used for. I think a larger phone will generally coincide with increased media consumption on the phone and not everyone wants that. It was great being able to comfortably read books on my Note 6, but I didn't like how big it was when all I might need one day is calls and texts. It depends on use case and I think its a fair sacrifice to make trading screen size for portability, especially when I want to cut down media consumption on my phone.
