HostAI - Android LLM API Server

A lightweight LiteLLM server boilerplate pre-configured with uv and Docker for hosting your own OpenAI- and Anthropic-compatible endpoints. Includes LibreChat as an optional web UI.

Function-calling API for LLM from multiple providers

Self-hosted local LLM server & AI control plane — OpenAI-compatible proxy for Ollama, multi-agent orchestration, unified dashboard, and zero API bills.

A complete, menu-driven AI model interface for Windows that simplifies running local GGUF language models with llama.cpp. This tool automatically manages dependencies, provides multiple interaction modes, and prioritizes user privacy through fully offline operation.

API server for `llm` CLI tool

PHP Frontend for Hosting local LLM's (run via VSCode or basic php execution methods/ add to project)

OpenAI-compatible local inference server for Apple Silicon using MLX. FastAPI server with Chat Completions and Responses APIs, multi-turn conversations, and streaming support.

A flexible FastAPI-based framework for handling AI tasks using Large Language Models (LLMs). Supports multiple providers, extensible tasks and routers, Redis caching, and OpenAI integration. Easily scalable for various LLM-based applications.

Unified simple LLM server wrapper with intelligent routing based on model ID

Host an LLM and make it accessible on a network via API.

Run local AI models in VS Code with automatic model detection, server start, and built-in MCP endpoint—no cloud or manual setup required.