Open Source AI Radar
← All categories

Model Serving

1 approved project

All projects

1 project

  • vLLM
    vllm-project/vllm
    Newly tracked

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Model Serving86.4K / 7dPython4 hours ago