Lakuna · docs

Quickstart: run the router

npm install -g lakuna   # thin launcher, needs uv - see below

lakuna init             # detect models + hardware, write lakuna.yaml
lakuna check            # validate the config, print your fleet

export ANTHROPIC_API_KEY=sk-ant-...   # your own frontier key
lakuna serve

This npm package is a launcher, not the router itself - the real backend is a Python project at github.com/chinmayi-r/lakuna, run for you via uv. Install uv first (curl -LsSf https://astral.sh/uv/install.sh | sh), and the CLI tells you if it's missing. There is no hosted middleman and no API key to mint from us - the only key in this picture is your own, with your own frontier provider.

Commands

CommandWhat it does
lakuna initDetects local models (Ollama, LM Studio, llama.cpp) and hardware, writes a pre-filled config - frontier-only and honest about it if it finds nothing local.
lakuna checkValidates the config and prints your fleet. Rejects a bad config with a line number instead of failing silently at request time.
lakuna serveRuns the proxy. Point any OpenAI- or Anthropic-compatible client at it; nothing about your calls changes except a receipt on every response.