GPU Inference

Open-source projects tagged GPU Inference, ranked by transparent GitHub momentum.

3 approved projects

Projects

Project	Category	Stars	7-day	Momentum	Language	Active
vLLM vllm-project/vllm A high-throughput and memory-efficient inference and serving engine for LLMs	Model ServingInstitutional	87.5K	+687	76.7	Python	3 hours ago
llama.cpp ggml-org/llama.cpp LLM inference in C/C++	Model InferenceIndependent	121.9K	+704	67.9	C++	8 hours ago
Transformers huggingface/transformers 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.	Model InferenceStartup	163.1K	+270	32.1	Python	3 hours ago

vLLM
vllm-project/vllm
76.7
A high-throughput and memory-efficient inference and serving engine for LLMs
Model ServingInstitutional★ 87.5K+687 / 7dPython3 hours ago
llama.cpp
ggml-org/llama.cpp
67.9
LLM inference in C/C++
Model InferenceIndependent★ 121.9K+704 / 7dC++8 hours ago
Transformers
huggingface/transformers
32.1
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Model InferenceStartup★ 163.1K+270 / 7dPython3 hours ago