I'm Swiss and I have been working in the US for a few years and some prejudices resonate with me. However, there are also some explanations for this:
Xenophobia: Swiss are probably less xenophobic than other countries I have experienced (including the US where I was mildly surprised about some things. Of course you shouldn't tell it loudly at your work-place). About one third of the population in Switzerland are foreigners and the number has been strongly increasing in the last few years. I think Swiss are fed up about "soldiers" (aka expats) and other foreigners that don't want to integrate. I had some bosses that didn't speak German and also didn't understand that some things are socially unacceptable. Unlike other countries, there is rarely violence towards foreigners.
Banks: I worked in banking. Other countries do the same as Switzerland. When you go to a German bank just over the border as a Swiss until recently, they will tell you that you can hide your money there and tax authorities in Switzerland won't know. I won't speak of Delaware, Miami, Singapore, Hong Kong and all these other places. The US is well-know for having ambiguous policies. Bankers in Miami are specialized in taking money from Latin America.
Prices: Prices are a lot higher for certain things. You can go shopping in Germany to save money. Some other items, e.g. electronics, are cheaper except for the US. Expect to pay high prices for rent, meat, vegetable, other fixed costs (health insurance, electricity etc.). However, the money left after your fixed costs is a lot more than the average person in another country. And to revert back to xenophobia, there are foreigners that somehow are unaware of the prices and accept low offers. Swiss don't like them very much.
Working: I worked in New York (not the US I know). I worked on a fixed two-year contract, so I couldn't be terminated. My US colleagues had an at-will contract. I always thought it crazy what my colleagues were willing to put up with. When they got a better offer, they just disappeared within a few days. But I had to adapt because I was the foreigner and the Swiss nowadays also expect you better adapt and integrate (see xenophobia) or you better leave Switzerland.
Although I lived in the US for some time, I'm a strong supporter of limiting the number of foreigners in Switzerland. It's not in Switzerland's interest but more in the interest of employers who try to take advantage of it.