It worked out for you because USA - Australia visa requirements are pretty lax. Generally speaking, developed countries have relaxed (or no) visa requirements for each other. Had you been traveling to say China, India, or basically any global south country, it wouldn't have worked out.
Yep, definitely American privilege making up for American bad assumptions. I have reliably gotten my visa requirements right the rest of the time across said global South.