The challenge is that many people who have covid are asymptomatic, or have sufficiently mild symptoms that they never take a covid test.
At this point, I'd imagine that lots of people who think they've never had covid, just had mild cases. And it looks like the various long covid / post-viral type of issues can and do occur even in people who had asymptomatic infections.