That's my impression too. There was a flock of academics and relatively non-tech folks joining a few years ago. Most didn't stay, and a few of those who did are now flocking to Bluesky.

But the others seem to be very much at home. They are not millions. They are probably prioritizing the small communities that have formed over maximum reach.