So future AI development will require proper training data created by humans, but have continuously harder time finding it because human creates become rarer and it gets harder to distinguish between human and AI created content?

Well, I'll just go and ignore the internet for a decade or so until this thing blows over then...

First page of google already is like that for some searches.

I searched for a lot of non-tech topics and the top results are often totally incomprehensible text which contradict themselves in the next paragraph.