Was Teletubbies a useful source for our current jobs? Probably not directly but these things help for general understanding of the world when starting off with zero understanding
Not a lot of call to discern a hawk from a heronsaw (or handsaw) anymore, although that does say something about the power of LLM's, transcription errors and judgement.
It seems testable in the sense that you could train a small model, like GPT-2, on the whole dataset, then on the dataset - Shakespeare and compare the loss after training.
In the long tail of questions people ask, I would think asking about Shakespeare is relatively common (explain a play, explain a character, identify a quote, ...).
Unless you want to “write a Shakespearean sonnet about Bayes’ rule”. Here’s what Claude sonnet (ahem) came up with:
"Bayes's Revelation"
What knowledge held before new facts arrive,
Our prior thoughts, though incomplete they be,
Must yield and change as evidence does strive
To shape posterior probability.
Through multiplicative steps we find our way,
As likelihood with prior beliefs combine,
The normalizing constant holds its sway,
While truth emerges, clearer line by line.
O Reverend Bayes, thy theorem divine
Shows how our minds should learn from what we see,
Each observation helps our thoughts refine,
Till posterior wisdom sets uncertainty free.
In statistics' realm, this rule holds fast:
Each present builds upon what's known from past.
The sonnet weaves together the key components of Bayes' theorem - prior probability, likelihood, and how they combine to form the posterior probability. Would you like me to explain any of these statistical concepts in more detail?
Although it would be an easier change now that Bard is Gemini…