You can add hooks to functions and “fork” binaries, which is a pretty similar effort to adding training data to given model weights.

Nobody does that because if you only have binaries you probably don't have permission to do that. Plus it's impractical to make any significant changes that way.

If you have binaries you almost always have “permission” to do that — you can do whatever you’d like with files on your own system.