Hello PH 👋
I am Ivan, Harbor’s creator.
Been running in this for just about two years. Harbor began as a result of I used to be bored with spending evenings debugging Docker Compose recordsdata each and every time I sought after to take a look at a brand new native LLM mission. It used to be intended to be a weekend script, however the issue became out to be larger than I believed and it grew right into a catalog of 129 products and services.
The core concept is that native AI products and services will have to paintings in combination out of the field. harbor up offers you Open WebUI and Ollama. You upload extra products and services by way of title, like harbor up searxng speaches comfyui, and Harbor handles the wiring between them. SearXNG is already hooked up for your chat UI. Voice already works. Symbol gen already works. No Compose recordsdata to write down, no ports to keep in mind.
The catalog covers a large number of floor. There are 16 chat and inventive frontends (Open WebUI, LibreChat, SillyTavern, ComfyUI and others), 21 LLM backends (Ollama, llama.cpp, vLLM, SGLang, KTransformers and others), and 90+ satellites for information superhighway seek, voice, RAG, vector databases, workflow engines like n8n and Dify, fine-tuning with Unsloth, eval harnesses, tracking, and extra.
The whole lot runs in the community, talks to one another, and is one harbor up away. The most recent liberate provides harbor release, which is the function I am maximum interested by. It runs coding brokers like Claude Code, Codex, Copilot, and OpenCode towards your native stack with out touching a unmarried env var. harbor release –web provides them information superhighway seek too and spins up the entire pipeline at the back of the scenes. Harbor additionally exposes an OpenAI-compatible API, so any software or SDK code that speaks OpenAI can level at your native fashions as a drop-in alternative.
MIT authorized, no telemetry, the whole thing remains to your system. CLI and desktop app for Linux and macOS. When you run native fashions and are bored with gluing issues in combination manually, give it a take a look at.
Satisfied to respond to questions concerning the structure, supported products and services, or how particular workflows paintings.
