I think it varies considerably depending on the company culture- in particular, how remote-oriented the company is. (Yeah, I know that sounds buzzwordy, but hear me out.)
At "remote friendly" companies I've worked at in the past, most people were in the office at least 80% of the time- and because of that, there was sort of a general mindset that if someone wasn't in the office, they "weren't there"... which lead to the same sorta assumption that you mentioned.
On the other hand, at the place I'm at now, I would guess that less than half the company are in the office on any given day. This leads to an amusing inversion of what you're talking about, because if a normally-remote colleague needs to come into the office, it usually means they won't get as much done that day, because of the overhead of travel time! :P
At "remote friendly" companies I've worked at in the past, most people were in the office at least 80% of the time- and because of that, there was sort of a general mindset that if someone wasn't in the office, they "weren't there"... which lead to the same sorta assumption that you mentioned.
On the other hand, at the place I'm at now, I would guess that less than half the company are in the office on any given day. This leads to an amusing inversion of what you're talking about, because if a normally-remote colleague needs to come into the office, it usually means they won't get as much done that day, because of the overhead of travel time! :P