I was thinking about that when working on https://eli5.gg. I implemented a caching system internally but it would have been simpler to connect to an OpenAI proxy that handled this automagically.