Local LLM server that provides drop-in API compatibility with both Ollama and OpenAI, using your locally installed [llama.cpp](https://github.com/ggerganov/llama.cpp) 's `llama-server` as the inference backend.
LlamaOrch is simple Bash-based CLI Orchestrator for llama.cpp server.
Experiments running offline LLMs in Python and Rust locally using Ollama and llama.cpp
MCP for searching the web and fetching website contents.
Add a description, image, and links to the llamacpp-server topic page so that developers can more easily learn about it.
To associate your repository with the llamacpp-server topic, visit your repo's landing page and select "manage topics."