That's me, currently. At a small startup and no one else seemed to be as interested in LLMs, so they made me the guy. Still a dev, deploying various models, integrating with our services, instrumentation, prompt management, etc.

Basically architecting LLM-related infrastructure to enable the product features they want, while managing expectations.

I moved into content moderation, which basically does all the engineering around ML models (logging, queuing, caching, databases, etc.) with limited opportunities to create my own models. Unfortunately, the barrier to entry is high, and it has been difficult for me to find the time to step out of my comfort zone.