> Even if you allow collaboration, then when (2) goes away, your question is trivially answered "yes" because we just feed into the model the same experiences that were fed into the human(s) who invented the model, and the simulation then simulates them inventing the same model.

These models doesn't work that way. Its probably possible to make such a model, but currently we don't know how to make them.