> My guess: Your domain is weird/rare, so LLMs are terrible because their training data is very limited.
The training data is always limited, because if there was an existing software that already did what I'm doing, I'd be using it instead of writing it :)
So by definition, unless I'm learning how to program and doing exercises that thousands have done before me, I'm doing something for which there is no training data.
It's great that you work on truly novel, unseen problems. The rest of us peasants tends to recombine previously solved problems into to novel solutions to solve business needs, and that works rather well with LLMs.
> The rest of us peasants tends to recombine previously solved problems into to novel solutions to solve business needs, and that works rather well with LLMs.
You took the words right out of my mouth! I wrote a draft reply to OP (but discarded it) with similar thoughts -- roughly: I work on CRUD apps, and so do most other devs; LLMs are a terrific fit for this subject matter.
The training data is always limited, because if there was an existing software that already did what I'm doing, I'd be using it instead of writing it :)
So by definition, unless I'm learning how to program and doing exercises that thousands have done before me, I'm doing something for which there is no training data.