I believe that what we're not accounting for is the belief among many wealthy people that scientific research and all other intellectual labor will soon be automated by AI.
I believe that what those wealthy people aren't accounting for is the need for some class of humans to act as a translation layer between the expert AI systems and the rest of us in order to allow the discoveries and results to percolate through human institutions.
Or, rather, they may be underestimating the bottleneck that will be introduced by trying to hoard all of those results within their own circles of trust and influence.
More fucking morons. The gap with biomedical research isn't in the realm of language models, but in the amount of information that exists in biology that we don't know. I'm not sure what percentage of all the genetic data on Earth we've sequenced, but it's not much, and we still don't quite have a mechanical understand of a single cell, much less some complex multicellular organisms with proteins affecting gene expression, cell membrane receptors being reused in 50 different tissue types, molecular secretion and diffusion altering our minds functioning, and electrical currents synchronizing brain firing at a distance.
No LLM trained on PubMed will be able to suss this all out - more data is needed.
Even in pure mathematics, where I am currently a grad student and as needed a big fan of trying to get LLMs to explain stuff to me at 1 am, they just aren't that good. If it's a popular question where I could have tried math overflow, sure, it's probably just going to get some details weirdly wrong, but for subtle complex concepts, it's not making some golden age of truth and understanding.
And God help the LLMs trying to understand physics that are trained on all the BS on Youtube and the blogs.
But are they wrong? I'm pretty sure that I can ask any LLM to produce a followup for "Transformative Hermeneutics of Quantum Gravity" and get one as good, or even better than the original. Lack of percolation would actually be an improvement.
Sure, LLMs may indeed produce plausible bs akin to the classic bs paper you mention. But it should be considered that all science is being gutted, including unambiguously substantial fields (biology, physics, chemistry).
I believe that what those wealthy people aren't accounting for is the need for some class of humans to act as a translation layer between the expert AI systems and the rest of us in order to allow the discoveries and results to percolate through human institutions.
Or, rather, they may be underestimating the bottleneck that will be introduced by trying to hoard all of those results within their own circles of trust and influence.