All topics
Model Serving
Open-source projects tagged Model Serving, ranked by transparent GitHub momentum.
2 approved projects
Projects
| Project | Category | Stars | 7-day | Momentum | Language | Active |
|---|---|---|---|---|---|---|
| vLLM vllm-project/vllm A high-throughput and memory-efficient inference and serving engine for LLMs | Model ServingInstitutional | 91.7K | +551 | 72.5 | Python | 5 hours ago |
| Ollama ollama/ollama Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. | Local AIStartup | 180.8K | +514 | 43.8 | Go | 5 hours ago |
- vLLM72.5vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Model ServingInstitutional★ 91.7K+551 / 7dPython5 hours ago - Ollama43.8ollama/ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Local AIStartup★ 180.8K+514 / 7dGo5 hours ago