Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I assume they use a conversation, so if you compress the prompt immediately you should only break cache once, and still hit cache on subsequent prompts?

So instead of Write Hit Hit Hit

It's Write Write Hit Hit Hit



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: