From a scientific explanatory perspective, the old models are not obsolete because they are explanatory whereas LLMs do not explain anything about human linguistic behaviour.
What do you mean "work"? Their goal is not to be some general purpose AI. (To be clear I'm talking narrowly about computational linguistics, not old fashioned NLP more broadly).