I can relate to this too - I also sometimes feel anxious when going to sleep, there's something strange about going away and coming back and continuity of self. I think the only reason people aren't afraid of it is that everyone is used to it.

One thing that helped was recognizing that I've never failed at eventually going to sleep - which then relaxes me and makes it easier to actually fall asleep.