Yes, my monitors when I had them were on arms - they wouldn't work great in my current setup due to its density, and the things I've put around the desk.
I certainly could make adjustments to accommodate a monitor - I just don't want to, and would love for there to be a way to not have to and still get to use a large display.
I'm on the same boat as you, but ended up just getting a long table so I can move to the empty side when I need it.