In the model's community section Goog confirms they're working on a gguf version so you can host it like most other models.

https://huggingface.co/google/gemma-3n-E4B-it-litert-preview...