The partial absence of Austria and the German-speaking cantons of Switzerland, Italy, Belgium and perhaps France in all possible variations of these “concepts” means that a United Germany has never been truly achieved I suppose. Probably a good thing for those folks own cultural and dialect identity…
Language is just one element of identity anyway. Also, the concept of "United Country X" is a XIX century invention, largely based on now-discredited racist ideologies. We should aim for something better.