One example for a non-nationalist conservative party would the German CDU (Merkel's party): They were one of the driving powers behind the ECSC, EEC and later EU, and staunchly pro-NATO, even at the cost of German sovereignty.