Skip to content
@EmbeddedLLM

EmbeddedLLM

We are committed to making production-grade AI inference as accessible and reliable as electricity, powered by vLLM.

Pinned Loading

  1. JamAIBase JamAIBase Public

    The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate…

    Python 1.1k 39

  2. vllm vllm Public

    Forked from vllm-project/vllm

    vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 95 6

  3. embeddedllm embeddedllm Public

    EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

    Python 51 4

Repositories

Showing 10 of 74 repositories

Top languages

Loading…

Most used topics

Loading…