Lakuna · docs
Documentation
Everything a person or an agent needs to run Lakuna: how routing works and how to run the local-first router. This page and the button below return the same content, one to read, one to paste into a prompt.
Overview
Lakuna is a local-first router for LLM requests. Two pieces work together:
01 · the router
A Python backend (github.com/chinmayi-r/lakuna) you run on your own machine or server, co-located with your local model (Ollama, LM Studio, llama.cpp, or anything OpenAI-compatible). This npm package is a thin launcher for it, run via uv.
02 · your frontier key
No hosted middleman. When a request needs to escalate, the router calls your own frontier provider with your own API key - never through us.
Every request tries the cheapest option first - local, then sampled local, then frontier - and is admitted to the next tier only on measured, calibrated confidence, never a guess. If the local tier passes, you're done at zero cost and nothing leaves your machine. Every response, either way, carries a receipt (tier, confidence, cost, latency), logged locally in SQLite.