How do I use it as a frontend for a locally hosted llm?

I have a 3090gtx, but never actually run/hosted any locally.

Cheers