“Just make it generate YAML and cache that until the prompt changes!”

Orrrrr… just keep that YAML as the sole configuration input in the first place. Use AI to write it if you wish, but then leave it alone.