The real advantage of LLMs is not search -- that's just something that's easy to show people. No one really wants to talk to an LLM instead of using Google search.
The real value is being general reasoning machines. Being able to accomplish basic tasks, retrieve information, etc. is the key value.
Somebody else mentioned the phase of the moon when John Lennon died (which will be ruined in a few days when google indexs this site). There are results for that on the internet, google fails, Kagi fail, but Bings chat pulled the two different sources (one for the day and one for the phases of the moon).