You don't need AGI for that, just compute. As soon as you formulate the requirements to the model (objective function) and the dataset, methods can be iterated and found automatically, in principle.
If it can program a desktop application it can program and evolve tensorflow/pytorch scripts.
With the amount of people using GitHub and Copilot (including me) even with all the controversy surrounding it, I'm sure the assumption will hold true. Most people simply don't care enough about their code to make it stop being trained on a neural net, and if they get benefits from it in the form of stuff like ChatGPT or Copilot, then they're even more so not gonna care.