I think LLMs are great, but most companies have not figured out what they are truly useful for. Hint: it's not for search. LLMs are not knowledge databases, and should not be relied on for unknown information. In my opinion, they are more useful 24/7 editing service. Write a paragraph and ask it to paraphrase. Ask it to make a new story that can be edited. If you don't have any idea what the answer to the thing you're asking is, you shouldn't rely on the response from the bot.
Search can be achieved reasonably well using LLM embeddings to draw edges in a knowledge graph, which is called a "Semantic Knowledge Graph".
But your broader point remains, LLMs are a small improvement for search technology and a quantum leap forward for editing, cheating on leetcode, consulting, etc.
