All topics
Model Serving
Open-source projects tagged Model Serving, ranked by transparent GitHub momentum.
2 approved projects
Projects
| Project | Category | Stars | 7-day | Momentum | Language | Active |
|---|---|---|---|---|---|---|
| vLLM vllm-project/vllm A high-throughput and memory-efficient inference and serving engine for LLMs | Model ServingInstitutional | 87.5K | +687 | 76.7 | Python | 3 hours ago |
| Ollama ollama/ollama Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. | Local AIStartup | 177.2K | +543 | 37.9 | Go | 6 hours ago |
- vLLM76.7vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Model ServingInstitutional★ 87.5K+687 / 7dPython3 hours ago - Ollama37.9ollama/ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Local AIStartup★ 177.2K+543 / 7dGo6 hours ago