If your issue is "incorrect answers" (hallucination) then an embedding search will naturally also produce "incorrect answers" because an embedding is a lossy compression of the source.