This problem won’t work for code assistants. No way those queries have high repetition. Not when you’re uploading user files.

I assume the best strategy is to shrink the models and tune them more.