> I am sure this software did not somehow exist fully formed in the training data!
I'm sure it did exist in the training data. It's trained on Github and Stackoverflow. You "custom" application has already been written many times before.
And every time I tested a feature and changed my mind about the minutia of how it should work, and I gave the AI new instructions and it complied--every permutation of that already existed in some GitHub repository somewhere?
I'm sorry, I just find that exceedingly hard to believe. There is a lot of legacy code out there in the world, but not that much!
I'm sure it did exist in the training data. It's trained on Github and Stackoverflow. You "custom" application has already been written many times before.