Run Mellum2.1 locally and check its first response
JetBrains’ current GGUF repository documents a llama.cpp path for serving Mellum2.1 locally. Install the runtime, request a completion, and check it before trying an agent.
The big change
You can now follow a published llama.cpp quickstart for a quantized Mellum2.1 build and query it through a local OpenAI-compatible endpoint. That makes a first self-hosted inference check practical without relying on an inference-provider deployment for the BF16 repository. A response proves the serving path works; it does not prove agent quality, fit, privacy across an entire toolchain, or readiness for production.







